forked from tensorflow/tensorflow
-
Notifications
You must be signed in to change notification settings - Fork 94
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge pull request #2704 from ROCm/develop-upstream-sync-241001
Develop upstream sync 241001
- Loading branch information
Showing
2,047 changed files
with
53,657 additions
and
29,083 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,44 @@ | ||
################################################################################ | ||
FROM ubuntu:22.04@sha256:58b87898e82351c6cf9cf5b9f3c20257bb9e2dcf33af051e12ce532d7f94e3fe AS devel | ||
################################################################################ | ||
|
||
# Install devtoolset build dependencies | ||
COPY setup.sources.sh /setup.sources.sh | ||
COPY setup.packages.sh /setup.packages.sh | ||
COPY builder.packages.txt /builder.packages.txt | ||
|
||
RUN /setup.sources.sh && /setup.packages.sh /builder.packages.txt | ||
|
||
# Install devtoolset-9 in /dt9 with glibc 2.17 and libstdc++ 4.8, for building | ||
# manylinux2014-compatible packages. | ||
COPY builder.devtoolset/fixlinks.sh /fixlinks.sh | ||
COPY builder.devtoolset/rpm-patch.sh /rpm-patch.sh | ||
COPY builder.devtoolset/build_devtoolset.sh /build_devtoolset.sh | ||
COPY builder.devtoolset/glibc2.17-inline.patch /glibc2.17-inline.patch | ||
RUN /build_devtoolset.sh devtoolset-9 /dt9 | ||
|
||
# Make sure clang is on the path | ||
RUN ln -s /usr/lib/llvm-18/bin/clang /usr/bin/clang | ||
|
||
# Install various tools. | ||
# - bats: bash unit testing framework | ||
# - bazelisk: always use the correct bazel version | ||
# - buildifier: clean bazel build deps | ||
# - buildozer: clean bazel build deps | ||
# - gcloud SDK: communicate with Google Cloud Platform (GCP) for RBE, CI | ||
# - patchelf: Utility tool to modify existing ELF executables and libraries | ||
RUN git clone --branch v1.11.0 https://github.com/bats-core/bats-core.git && bats-core/install.sh /usr/local && rm -rf bats-core | ||
RUN wget https://github.com/bazelbuild/bazelisk/releases/download/v1.21.0/bazelisk-linux-amd64 -O /usr/local/bin/bazel && chmod +x /usr/local/bin/bazel | ||
RUN wget https://github.com/bazelbuild/buildtools/releases/download/v7.3.1/buildifier-linux-amd64 -O /usr/local/bin/buildifier && chmod +x /usr/local/bin/buildifier | ||
RUN wget https://github.com/bazelbuild/buildtools/releases/download/v7.3.1/buildozer-linux-amd64 -O /usr/local/bin/buildozer && chmod +x /usr/local/bin/buildozer | ||
RUN curl -sSL https://sdk.cloud.google.com > /tmp/gcloud && bash /tmp/gcloud --install-dir=~/usr/local/bin --disable-prompts | ||
# Download and install patchelf v0.18.0 from GitHub. The default Ubuntu focal | ||
# packages only provide the "0.10-2build1" version. We use patchelf to manipulate | ||
# certain shared libraries during the wheel building process (https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tools/pip_package/build_pip_package.sh#L255-L262). | ||
# When we use Patchelf versions <0.12, those shared libraries end up with a | ||
# corrupted PT_NOTE program header. This was fixed in v0.12, see https://github.com/NixOS/patchelf/commit/43a33482b501b0f5ee9da312aabfca3806570cc9. | ||
RUN wget https://github.com/NixOS/patchelf/releases/download/0.18.0/patchelf-0.18.0-x86_64.tar.gz && tar -zxvf patchelf-0.18.0-x86_64.tar.gz -C /usr && rm -rf patchelf-0.18.0-x86_64.tar.gz | ||
|
||
# Don't use the bazel cache when a new docker image is created. | ||
RUN echo build --action_env=DOCKER_CACHEBUSTER=$(date +%s%N)$RANDOM >> /etc/bazel.bazelrc | ||
RUN echo build --host_action_env=DOCKER_HOST_CACHEBUSTER=$(date +%s%N)$RANDOM >> /etc/bazel.bazelrc |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,8 @@ | ||
WIP ML Build Docker container for ML repositories (Tensorflow, JAX and XLA). | ||
|
||
This container branches off from | ||
/tensorflow/tools/tf_sig_build_dockerfiles/. However, since | ||
hermetic CUDA and hermetic Python is now available for Tensorflow, a lot of the | ||
requirements installed on the original container can be removed to reduce the | ||
footprint of the container and make it more reusable across different ML | ||
repositories. |
Oops, something went wrong.