SageMaker HyperPod AMI releases for Amazon EKS - Amazon SageMaker AI
May 22, 2025May 07, 2025April 28, 2025April 18, 2025February 18, 2025January 22, 2025December 21, 2024December 13, 2024November 24, 2024November 15, 2024November 11, 2024October 21, 2024September 10, 2024
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

SageMaker HyperPod AMI releases for Amazon EKS

The following release notes track the latest updates for Amazon SageMaker HyperPod AMI releases for Amazon EKS orchestration. Each release note includes a summarized list of packages pre-installed or pre-configured in the SageMaker HyperPod DLAMIs for Amazon EKS support. Each DLAMI is built on Amazon Linux 2 (AL2) and supports a specific Kubernetes version. For HyperPod DLAMI releases for Slurm orchestration, see SageMaker HyperPod AMI releases for Slurm. For information about Amazon SageMaker HyperPod feature releases, see Amazon SageMaker HyperPod release notes.

SageMaker HyperPod AMI releases for Amazon EKS: May 22, 2025

AMI general updates

SageMaker HyperPod DLAMI for Amazon EKS support

Deep Learning Base AMI AL2

  • Latest NVIDIA Driver: 550.163.01

  • CUDA Stack updates:

    • Default CUDA: 12.1

    • NCCL Version: 2.22.3

  • EFA Installer: 1.38.0

  • Amazon OFI NCCL: 1.13.2

  • Linux Kernel: 5.10

  • GDRCopy: 2.4

Important

  • NVIDIA Container Toolkit 1.17.4 update: CUDA compat libraries mounting is now disabled

  • EFA Updates from 1.37 to 1.38:

    • Amazon OFI NCCL plugin now located in /opt/amazon/ofi-nccl

    • Previous location /opt/aws-ofi-nccl/ is deprecated

Neuron SDK Updates

  • aws-neuronx-dkms.noarch: 2.20.74.0 (from 2.20.28.0)

  • aws-neuronx-collectives.x86_64: 2.25.65.0_9858ac9a1-1 (from 2.24.59.0_838c7fc8b-1)

  • aws-neuronx-runtime-lib.x86_64: 2.25.57.0_166c7a468-1 (from 2.24.53.0_f239092cc-1)

  • aws-neuronx-tools.x86_64: 2.23.9.0 (from 2.22.61.0)

  • aws-neuronx-gpsimd-customop-lib.x86_64: 0.15.12.0 (from 0.14.12.0)

  • aws-neuronx-gpsimd-tools.x86_64: 0.15.1.0_5d31b6a3f (from 0.14.6.0_241eb69f4)

  • aws-neuronx-k8-plugin.x86_64: 2.25.24.0 (from 2.24.23.0)

  • aws-neuronx-k8-scheduler.x86_64: 2.25.24.0 (from 2.24.23.0)

Support notes:

  • AMI components including CUDA versions may be removed or changed based on framework support policy

  • Kernel version is pinned for compatibility. Users should avoid updates unless required for security patches

  • For EC2 instances with multiple network cards, please refer to EFA configuration guide for proper setup

SageMaker HyperPod AMI releases for Amazon EKS: May 07, 2025

Installed the latest version of Amazon Neuron SDK

  • tensorflow-model-server-neuron.x86_64 2.8.0.2.3.0.0-0 neuron

SageMaker HyperPod AMI releases for Amazon EKS: April 28, 2025

Improvements for K8s

SageMaker HyperPod DLAMI for Amazon EKS support

Installed the latest version of Amazon Neuron SDK

  • aws-neuronx-dkms.noarch: 2.20.28.0-dkms

  • aws-neuronx-oci-hook.x86_64: 2.4.4.0-1

  • aws-neuronx-tools.x86_64: 2.18.3.0-1

  • aws-neuron-dkms.noarch: 2.3.26.0-dkms

  • aws-neuron-k8-plugin.x86_64: 1.9.3.0-1

  • aws-neuron-k8-scheduler.x86_64: 1.9.3.0-1

  • aws-neuron-runtime.x86_64: 1.6.24.0-1

  • aws-neuron-runtime-base.x86_64: 1.6.21.0-1

  • aws-neuron-tools.x86_64: 2.1.4.0-1

  • aws-neuronx-collectives.x86_64: 2.24.59.0_838c7fc8b-1

  • aws-neuronx-gpsimd-customop.x86_64: 0.2.3.0-1

  • aws-neuronx-gpsimd-customop-lib.x86_64: 0.14.12.0-1

  • aws-neuronx-gpsimd-tools.x86_64: 0.14.6.0_241eb69f4-1

  • aws-neuronx-k8-plugin.x86_64: 2.24.23.0-1

  • aws-neuronx-k8-scheduler.x86_64: 2.24.23.0-1

  • aws-neuronx-runtime-lib.x86_64: 2.24.53.0_f239092cc-1

  • aws-neuronx-tools.x86_64: 2.22.61.0-1

  • tensorflow-model-server-neuronx.x86_64: 2.10.1.2.12.2.0-0

SageMaker HyperPod AMI releases for Amazon EKS: April 18, 2025

AMI general updates

  • New SageMaker HyperPod AMI for Amazon EKS 1.32.1.

SageMaker HyperPod DLAMI for Amazon EKS support

The AMIs include the following:

Deep Learning EKS AMI 1.32.1

  • Amazon EKS Components

    • Kubernetes Version: 1.32.1

    • Containerd Version: 1.7.27

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.29

  • Amazon SSM Agent: 3.3.1611.0

  • Linux Kernel: 5.10.235

  • OSS Nvidia driver: 550.163.01

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.38.0

  • GDRCopy: 2.4.1-1

  • Nvidia container toolkit: 1.17.6

  • Amazon OFI NCCL: 1.13.2

  • aws-neuronx-tools: 2.18.3.0

  • aws-neuronx-runtime-lib: 2.24.53.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.20.28.0

  • aws-neuronx-collectives: 2.24.59.0

SageMaker HyperPod AMI releases for Amazon EKS: February 18, 2025

Improvements for K8s

  • Upgraded Nvidia container toolkit from version 1.17.3 to version 1.17.4.

  • Fixed the issue where customers were unable to connect to nodes after a reboot.

  • Upgraded Elastic Fabric Adapter (EFA) version from 1.37.0 to 1.38.0.

  • The EFA now includes the Amazon OFI NCCL plugin, which is located in the /opt/amazon/ofi-nccl directory instead of the original /opt/aws-ofi-nccl/ path. If you need to update your LD_LIBRARY_PATH environment variable, make sure to modify the path to point to the new /opt/amazon/ofi-nccl location for the OFI NCCL plugin.

  • Removed the emacs package from these DLAMIs. You can install emacs from GNU emac.

SageMaker HyperPod DLAMI for Amazon EKS support

Installed the latest version of neuron SDK

  • aws-neuronx-dkms.noarch: 2.19.64.0-dkms @neuron

  • aws-neuronx-oci-hook.x86_64: 2.4.4.0-1 @neuron

  • aws-neuronx-tools.x86_64: 2.18.3.0-1 @neuron

  • aws-neuronx-collectives.x86_64: 2.23.135.0_3e70920f2-1 neuron

  • aws-neuronx-gpsimd-customop.x86_64: 0.2.3.0-1 neuron

  • aws-neuronx-gpsimd-customop-lib.x86_64

  • aws-neuronx-gpsimd-tools.x86_64: 0.13.2.0_94ba34927-1 neuron

  • aws-neuronx-k8-plugin.x86_64: 2.23.45.0-1 neuron

  • aws-neuronx-k8-scheduler.x86_64: 2.23.45.0-1 neuron

  • aws-neuronx-runtime-lib.x86_64: 2.23.112.0_9b5179492-1 neuron

  • aws-neuronx-tools.x86_64: 2.20.204.0-1 neuron

  • tensorflow-model-server-neuronx.x86_64

SageMaker HyperPod AMI releases for Amazon EKS: January 22, 2025

AMI general updates

  • New SageMaker HyperPod AMI for Amazon EKS 1.31.2.

SageMaker HyperPod DLAMI for Amazon EKS support

The AMIs include the following:

Deep Learning EKS AMI 1.31

  • Amazon EKS Components

    • Kubernetes Version: 1.31.2

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987

  • Linux Kernel: 5.10.230

  • OSS Nvidia driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.37.0

  • GDRCopy: 2.4.1-1

  • Nvidia container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.13.0

  • aws-neuronx-tools: 2.18.3

  • aws-neuronx-runtime-lib: 2.23.112.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.23.133.0

SageMaker HyperPod AMI releases for Amazon EKS: December 21, 2024

SageMaker HyperPod DLAMI for Amazon EKS support

The AMIs include the following:

K8s v1.28

  • Amazon EKS Components

    • Kubernetes Version: 1.28.15

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987

  • Linux Kernel: 5.10.228

  • OSS NVIDIA driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.37.0

  • GDRCopy: 2.4

  • NVIDIA container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.13.0

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.23.112.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.23.135.0

K8s v1.29

  • Amazon EKS Components

    • Kubernetes Version: 1.29.10

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987

  • Linux Kernel: 5.15.0

  • OSS Nvidia driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.37.0

  • GDRCopy: 2.4

  • Nvidia container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.13.0

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.23.112.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.23.135.0

K8s v1.30

  • Amazon EKS Components

    • Kubernetes Version: 1.30.6

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987.0

  • Linux Kernel: 5.10.228

  • OSS Nvidia driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.37.0

  • GDRCopy: 2.4

  • Nvidia container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.13.0

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.23.112.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.23.135.0

SageMaker HyperPod AMI releases for Amazon EKS: December 13, 2024

SageMaker HyperPod DLAMI for Amazon EKS upgrade

  • Updated SSM Agent to version 3.3.1311.0.

SageMaker HyperPod AMI releases for Amazon EKS: November 24, 2024

AMI general updates

  • Released in MEL (Melbourne) Region.

  • Updated SageMaker HyperPod base DLAMI to the following versions:

    • Kubernetes: 2024-11-01.

SageMaker HyperPod AMI releases for Amazon EKS: November 15, 2024

SageMaker HyperPod DLAMI for Amazon EKS support

The AMIs include the following:

Deep Learning EKS AMI 1.28

  • Amazon EKS Components

    • Kubernetes Version: 1.28.15

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987

  • Linux Kernel: 5.10.228

  • OSS NVIDIA driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.34.0

  • GDRCopy: 2.4

  • NVIDIA container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.11.0

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.22.19.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.22.33.0

Deep Learning EKS AMI 1.29

  • Amazon EKS Components

    • Kubernetes Version: 1.29.10

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987

  • Linux Kernel: 5.10.228

  • OSS Nvidia driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.34.0

  • GDRCopy: 2.4

  • Nvidia container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.11.0

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.22.19.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.22.33.0

Deep Learning EKS AMI 1.30

  • Amazon EKS Components

    • Kubernetes Version: 1.30.6

    • Containerd Version: 1.7.23

    • Runc Version: 1.1.14

    • Amazon IAM Authenticator: 0.6.26

  • Amazon SSM Agent: 3.3.987

  • Linux Kernel: 5.10.228

  • OSS Nvidia driver: 550.127.05

  • NVIDIA CUDA: 12.4

  • EFA Installer: 1.34.0

  • GDRCopy: 2.4

  • Nvidia container toolkit: 1.17.3

  • Amazon OFI NCCL: 1.11.0

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.22.19.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.18.20.0

  • aws-neuronx-collectives: 2.22.33.0

SageMaker HyperPod AMI releases for Amazon EKS: November 11, 2024

AMI general updates

  • Updated SageMaker HyperPod DLAMI with Amazon EKS versions 1.28.13, 1.29.8, 1.30.4.

SageMaker HyperPod AMI releases for Amazon EKS: October 21, 2024

AMI general updates

  • Updated SageMaker HyperPod base DLAMI to the following versions:

    • Amazon EKS: 1.28.11, 1.29.6, 1.30.2.

SageMaker HyperPod AMI releases for Amazon EKS: September 10, 2024

SageMaker HyperPod DLAMI for Amazon EKS support

The AMIs include the following:

Deep Learning EKS AMI 1.28

  • Amazon EKS Components

    • Kubernetes Version: 1.28.11

    • Containerd Version: 1.7.20

    • Runc Version: 1.1.11

    • Amazon IAM Authenticator: 0.6.21

  • Amazon SSM Agent: 3.3.380

  • Linux Kernel: 5.10.223

  • OSS NVIDIA driver: 535.183.01

  • NVIDIA CUDA: 12.2

  • EFA Installer: 1.32.0

  • GDRCopy: 2.4

  • NVIDIA container toolkit: 1.16.1

  • Amazon OFI NCCL: 1.9.1

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.21.41.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.17.17.0

  • aws-neuronx-collectives: 2.21.46.0

Deep Learning EKS AMI 1.29

  • Amazon EKS Components

    • Kubernetes Version: 1.29.6

    • Containerd Version: 1.7.20

    • Runc Version: 1.1.11

    • Amazon IAM Authenticator: 0.6.21

  • Amazon SSM Agent: 3.3.380

  • Linux Kernel: 5.10.223

  • OSS Nvidia driver: 535.183.01

  • NVIDIA CUDA: 12.2

  • EFA Installer: 1.32.0

  • GDRCopy: 2.4

  • Nvidia container toolkit: 1.16.1

  • Amazon OFI NCCL: 1.9.1

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.21.41.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.17.17.0

  • aws-neuronx-collectives: 2.21.46.0

Deep Learning EKS AMI 1.30

  • Amazon EKS Components

    • Kubernetes Version: 1.30.2

    • Containerd Version: 1.7.20

    • Runc Version: 1.1.11

    • Amazon IAM Authenticator: 0.6.21

  • Amazon SSM Agent: 3.3.380

  • Linux Kernel: 5.10.223

  • OSS Nvidia driver: 535.183.01

  • NVIDIA CUDA: 12.2

  • EFA Installer: 1.32.0

  • GDRCopy: 2.4

  • Nvidia container toolkit: 1.16.1

  • Amazon OFI NCCL: 1.9.1

  • aws-neuronx-tools: 2.18.3.0-1

  • aws-neuronx-runtime-lib: 2.21.41.0

  • aws-neuronx-oci-hook: 2.4.4.0-1

  • aws-neuronx-dkms: 2.17.17.0

  • aws-neuronx-collectives: 2.21.46.0