Amazon Deep Learning ARM64 Base GPU AMI (Amazon Linux 2023)

• Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Amazon Linux 2023) ${YYYY-MM-DD}

• G5g

• Supported Amazon Service: Amazon EC2

• Operating System: Amazon Linux 2023

• Compute Architecture: ARM64

• Linux Kernel: 6.12

• NVIDIA Driver: 570.133.20

• NVIDIA CUDA 12.4, 12.5, 12.6, 12.8 stack:

  • CUDA, NCCL and cuDDN installation directories: /usr/local/cuda-xx.x/

    • Example: /usr/local/cuda-12.8/ , /usr/local/cuda-12.8/

  • Compiled NCCL Version:

    • For CUDA directory of 12.4, compiled NCCL Version 2.22.3+CUDA12.4

    • For CUDA directory of 12.5, compiled NCCL Version 2.22.3+CUDA12.5

    • For CUDA directory of 12.6, compiled NCCL Version 2.24.3+CUDA12.6

    • For CUDA directory of 12.8, compiled NCCL Version 2.26.2+CUDA12.8

  • Default CUDA: 12.8

    • PATH /usr/local/cuda points to CUDA 12.8

    • Updated below env vars:

      • LD_LIBRARY_PATH to have /usr/local/cuda-12.8/lib:/usr/local/cuda-12.8/lib64:/usr/local/cuda-12.8:/usr/local/cuda-12.8/targets/sbsa-linux/lib:/usr/local/cuda-12.8/nvvm/lib64:/usr/local/cuda-12.8/extras/CUPTI/lib64

      • PATH to have /usr/local/cuda-12.8/bin/:/usr/local/cuda-12.8/include/

      • For any different CUDA version, please update LD_LIBRARY_PATH accordingly.

• Amazon CLI v2 at /usr/local/bin/aws

• EBS volume type: gp3

• Nvidia container toolkit: 1.17.4

  • Version command: nvidia-container-cli -V

• Docker: 25.0.5

• Python: /usr/bin/python3.9

• Query AMI-ID with SSM Parameter (example region is us-east-1):

  aws ssm get-parameter --name/aws/service/deeplearning/ami/arm64/base-oss-nvidia-driver-gpu-amazon-linux-2023/latest/ami-id --region us-east-1 --query "Parameter.Value" --output text

• Query AMI-ID with AWSCLI (example region is us-east-1):

  aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Amazon Linux 2023) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text

Kernel

• Kernel version is pinned using command:

  sudo dnf versionlock kernel*

• We recommend that users avoid updating their kernel version (unless due to a security patch) to ensure compatibility with installed drivers and package versions. If users still wish to update they can run the following commands to unpin their kernel versions:

  sudo dnf versionlock delete kernel*
  sudo dnf update -y

• For each new version of DLAMI, latest available compatible kernel is used.

• Upgraded Nvidia driver from version 570.86.15 to 570.133.20 to address CVEs present in the NVIDIA GPU Display Driver Security Bulletin for April 2025

• Updated CUDA12.8 stack with NCCL 2.26.2

• Updated default CUDA from 12.6 to 12.8

• Upgraded Nvidia driver from version 570.124.06 to 570.133.20 to address CVEs present in the NVIDIA GPU Display Driver Security Bulletin for April 2025

• Kernel version updated from 6.1 to 6.12

• Nvidia driver from 550.144.03 to 570.86.15

• Default CUDA is changed from CUDA12.4 to CUDA12.6

• CUDA directory of 12.5 with compiled NCCL Version 2.22.3+CUDA12.5 and CuDNN 9.7.1.26

• CUDA directory of 12.6 with compiled NCCL Version 2.24.3+CUDA12.6 and CuDNN 9.7.1.26

• CUDA directory of 12.8 with compiled NCCL Version 2.25.1+CUDA12.8 and CuDNN 9.7.1.26

• Initial release of the Deep Learning ARM64 Base OSS DLAMI for Amazon Linux 2023