Release Notes Archive

• Added support for P5.4xlarge instances

• Upgraded EFA to 1.43.1

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 81.2

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 81.2

• Upgraded Nvidia driver from version 550.144.03 to 550.163.01 to address CVEs present in the NVIDIA GPU Display Driver Security Bulletin for April 2025

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 80.6

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 80.4

• Updated NVIDIA Container Toolkit from version 1.17.3 to version 1.17.4

  • Please see the release notes page here for more information: https://github.com/NVIDIA/nvidia-container-toolkit/releases/tag/v1.17.4

  • In Container Toolkit version 1.17.4, the mounting of CUDA compat libraries is now disabled. In order to ensure compatibility with multiple CUDA versions on container workflows, please ensure you update your LD_LIBRARY_PATH to include your CUDA compatibility libraries as shown in under the "If you use a CUDA compatibility layer" tutorial here - https://docs.aws.amazon.com/sagemaker/latest/dg/inference-gpu-drivers.html#collapsible-cuda-compat

• Removed user space libraries cuobj and nvdisasm provided by NVIDIA CUDA toolkit to address CVEs present in the NVIDIA CUDA Toolkit Security Bulletin for February 18, 2025

AMI names

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 80.2

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 80.4

• Upgraded EFA version from 1.37.0 to 1.38.0

  • EFA now bundles the Amazon OFI NCCL plugin, which can now be found in /opt/amazon/ofi-nccl rather than the original /opt/aws-ofi-nccl/. If updating your LD_LIBRARY_PATH variable, please ensure that you modify your OFI NCCL location properly.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 80.3

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 80.1

• Upgraded Nvidia driver from version 550.127.05 to 550.144.03 to address CVEs present in the NVIDIA GPU Display Driver Security Bulletin for January 2025

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 80.1

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 79.9

• Upgraded Nvidia Container Toolkit from version 1.17.0 to 1.17.3

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 79.9

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 79.7

• Upgraded Nvidia Container Toolkit from version 1.16.2 to 1.17.0, addressing the security vulnerability CVE-2024-0134.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 79.6

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 79.6

• Upgraded Nvidia driver from version 550.90.07 to 550.127.05 to address CVEs present in the NVIDIA GPU Display Security Bulletin for October 2024

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 79.3

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 79.3

• Upgraded Nvidia Container Toolkit from version 1.16.1 to 1.16.2, addressing the security vulnerability CVE-2024-0133.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 78.6

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 78.7

• Removed aws_neuron_pytorch_p38 and aws_neuron_tensorflow_p38 conda environments from the Deep Learning Proprietary Nvidia Driver AMI.

• Removed Inf1 instance family support from the Deep Learning Proprietary Nvidia Driver AMI.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 78.5

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 78.5

• Updated Nvidia driver version to 535.183.01 from 535.161.08

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 78.1

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 78.1

• Updated torchserve from v0.8.2 to v0.11.0 in the pytorch_p310 environment.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 78.0

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 78.0

• TensorFlow version updated from 2.15 to 2.16 in the tensorflow2_p310 environment.

• Updated EFA version from version 1.30 to version 1.32

• Updated Amazon OFI NCCL plugin from version 1.7.4 to version 1.9.1

• Updated Nvidia container toolkit from version 1.13.5 to version 1.15.0

  • NOTE: Version 1.15.0 does NOT include the nvidia-container-runtime and nvidia-docker2 packages. It is recommended to use nvidia-container-toolkit packages directly by following Nvidia container toolkit docs.

• Added CUDA12.3 stack with CUDA12.3, NCCL 2.21.5, CuDNN 8.9.7

• Removed CUDA11.7, CUDA12.0 stacks present at /usr/local/cuda-11.7 and /usr/local/cuda-12.0

• Removed nvidia-docker2 package and its command nvidia-docker as part of Nvidia container toolkit update from 1.13.5 to 1.15.0 which does NOT include the nvidia-container-runtime and nvidia-docker2 packages.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 77.0

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 77.0

• PyTorch version updated from 2.1 to 2.2 in the pytorch_p310 environment.

• For OSS Nvidia driver DLAMIs, added G6 and Gr6 EC2 instances support. Please refer EC2 instance selection page for more information.

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 76.8

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 76.9

• Updated Nvidia driver from 535.104.12 to 535.161.08 in both Proprietary and OSS Nvidia driver DLAMIs.

• The new supported instances for each DLAMI are as follows:

  • Deep Learning with Proprietary Nvidia Driver supports G3 (G3.16x not supported), P3, P3dn, Inf1

  • Deep Learning with OSS Nvidia Driver supports G4dn, G5, P4d, P4de.

• Removed G4dn, G5, G3.16x EC2 instances support from Proprietary Nvidia driver DLAMI.

AMI names

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 76.8

• Added awscliv2 in the AMI as /usr/local/bin/aws2, alongside awscliv1 as /usr/local/bin/aws on Proprietary Nvidia Driver AMI

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 76.7

• Added awscliv2 in the AMI as /usr/local/bin/aws2, alongside awscliv1 as /usr/local/bin/aws on OSS Nvidia Driver AMI

• Updated OSS Nvidia driver DLAMI with G4dn and G5 support, based on it current support looks like below:

  • Deep Learning Base Proprietary Nvidia Driver AMI (Amazon Linux 2) supports P3, P3dn, G3, G5, G4dn.

  • Deep Learning Base OSS Nvidia Driver AMI (Amazon Linux 2) supports G4dn, G5, P4, P5.

• OSS Nvidia driver DLAMIs are recommended to be used for G4dn, G5, P4, P5.

• Updated TensorFlow from 2.13.0 to 2.15.0

• Updated EFA from 1.29.0 to 1.30.0

• Updated Amazon-OFI-NCCL from 1.7.3-aws to 1.7.4-aws

• Updated Nvidia Driver to 535.104.12 on Deep Learning Proprietary Nvidia Driver AMI

• Updated Nvidia Driver to 535.154.05 on Deep Learning OSS Nvidia Driver AMI

AMI names

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 76.2

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 76.4

• Updated runc package version to consume patch for CVE-2024-21626.

• Updated PyTorch from 2.0.1 to 2.1.0

AMI names

• Deep Learning OSS Nvidia Driver AMI (Amazon Linux 2) Version 75.1

• Deep Learning Proprietary Nvidia Driver AMI (Amazon Linux 2) Version 75.1

• Amazon Deep Learning AMI (DLAMI) is split into two separate groups:

  • DLAMI that uses Nvidia Proprietary Driver (to support P3, P3dn, G3, G5, G4dn).

  • DLAMI that uses Nvidia OSS Driver to enable EFA (to support P4, P5).

• Please refer to public announcement for more information on DLAMI split.

• Amazon cli queries for above are in the release notes under bullet point Query AMI-ID with AWSCLI (example region is us-east-1)

• EFA updated from 1.26.1 to 1.29.0

• GDRCopy updated from 2.3 to 2.4