From d0def62f72cb88ce656028913d629a33d3e14b00 Mon Sep 17 00:00:00 2001 From: Vladi Date: Thu, 31 Aug 2023 13:50:23 -0600 Subject: [PATCH] Add support for Amazon EFA Issue addressed #167 The upstream JAX container contains only MOFED NIC support. The MOFED package from Mellanox that we use installs *ibverbs* libraries which do not contain libefa*.so which are required for AWS. A temporary solution is to provide a script as a part of base container (/usr/local/bin/install-efa.sh) that AWS user can run inside the container to handle this issue. The script does the following: 1. Remove all *ibverbs* and RDMA related libraries 2. Download Amazon EFA installer 3. Install EFA --- .github/container/install-efa.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.github/container/install-efa.sh b/.github/container/install-efa.sh index bc7165301..14b744b8a 100755 --- a/.github/container/install-efa.sh +++ b/.github/container/install-efa.sh @@ -25,7 +25,7 @@ pushd ${WORKDIR} AMAZON_EFA_LINK="https://efa-installer.amazonaws.com/aws-efa-installer-${EFA_INSTALLER_VERSION}.tar.gz" curl -O "$AMAZON_EFA_LINK" tar -xf aws-efa-installer-${EFA_INSTALLER_VERSION}.tar.gz && cd aws-efa-installer -./efa_installer.sh -y --skip-kmod +./efa_installer.sh -y -g -d --skip-kmod --skip-limit-conf --no-verify popd