Amazon Deep Learning ARM64 Base GPU AMI (Amazon Linux 2)

• Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Amazon Linux 2) ${YYYY-MM-DD}

• G5g

• Supported Amazon Service: Amazon EC2

• Operating System: Amazon Linux 2

• Compute Architecture: ARM64

• Linux Kernel: 5.10

• NVIDIA Driver: 550.144.03

• NVIDIA CUDA12.1, 12.2, 12.3 stack:

  • CUDA, NCCL and cuDDN installation directories:

    • Example: /usr/local/cuda-12.1/ , /usr/local/cuda-12.1/

  • Compiled NCCL Version:

    • For CUDA directory of 12.3, compiled NCCL Version 2.21.5+CUDA12.4

    • For CUDA directory of 12.1, 12.2, compiled NCCL Version .18.5+CUDA12.2

  • Default CUDA: 12.1

    • PATH /usr/local/cuda points to CUDA 12.1

    • Updated below env vars:

      • LD_LIBRARY_PATH to have /usr/local/cuda-12.1/lib:/usr/local/cuda-12.1/lib64:/usr/local/cuda-12.1:/usr/local/cuda-12.1/targets/sbsa-linux/lib:/usr/local/cuda-12.1/nvvm/lib64:/usr/local/cuda-12.1/extras/CUPTI/lib64

      • PATH to have /usr/local/cuda-12.1/bin/:/usr/local/cuda-12.1/include/

      • For any different CUDA version, please update LD_LIBRARY_PATH accordingly.

• Amazon CLI v2 at /usr/local/bin/aws2 and Amazon CLI v1 at /usr/bin/aws

• EBS volume type: gp3

• Nvidia container toolkit: 1.16.2

  • Version command: nvidia-container-cli -V

• Docker: 26.1.2

• Python: /usr/bin/python3.10

• Query AMI-ID with SSM Parameter (example Region is us-east-1):

  aws ssm get-parameter --region us-east-1 \
      --name/aws/service/deeplearning/ami/arm64/base-oss-nvidia-driver-gpu-amazon-linux-2/latest/ami-id  \
      --query "Parameter.Value" \
      --output text

• Query AMI-ID with AWSCLI (example Region is us-east-1):

  aws ec2 describe-images --region us-east-1 \
      -owners amazon \
      --filters 'Name=name,Values=Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Amazon Linux 2) ????????' 'Name=state,Values=available' \
      --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' \
      --output text

Kernel

• Kernel version is pinned using command:

  sudo yum versionlock kernel*

• We recommend that users avoid updating their kernel version (unless due to a security patch) to ensure compatibility with installed drivers and package versions. If users still wish to update they can run the following commands to unpin their kernel versions:

  sudo yum versionlock delete kernel*
  sudo yum update -y

• For each new version of DLAMI, latest available compatible kernel is used.

• Updated NVIDIA Container Toolkit from version 1.17.3 to version 1.17.4

  • Please see the release notes page here for more information: https://github.com/NVIDIA/nvidia-container-toolkit/releases/tag/v1.17.4

  • In Container Toolkit version 1.17.4, the mounting of CUDA compat libraries is now disabled. In order to ensure compatibility with multiple CUDA versions on container workflows, please ensure you update your LD_LIBRARY_PATH to include your CUDA compatibility libraries as shown in the If you use a CUDA compatibility layer tutorial.

• Removed user space libraries cuobj and nvdisasm provided by NVIDIA CUDA toolkit to address CVEs present in the  NVIDIA CUDA Toolkit Security Bulletin for February 18, 2025

• Upgraded Nvidia driver from version 550.127.05 to 550.144.03 to address CVEs present in the NVIDIA GPU Display Driver Security Bulletin for January 2025

• Upgraded Nvidia driver from version 550.90.07 to 550.127.05 to address CVEs present in the NVIDIA GPU Display Security Bulletin for October 2024

• Upgraded Nvidia Container Toolkit from version 1.16.1 to 1.16.2, addressing the security vulnerability CVE-2024-0133.

• Updated Nvidia driver version to 535.183.01 from 535.161.08

• Initial release of the Deep Learning ARM64 Base OSS DLAMI for Amazon Linux 2