Amazon Deep Learning ARM64 Base GPU AMI (Ubuntu 24.04) - Amazon Deep Learning AMIs
AMI name formatSupported EC2 instancesAMI contentsNoticesRelease Date: 2025-08-08
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon Deep Learning ARM64 Base GPU AMI (Ubuntu 24.04)

For help getting started, see Getting started with DLAMI.

AMI name format

  • Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Ubuntu 24.04) ${YYYY-MM-DD}

Supported EC2 instances

  • G5g

The AMI includes the following:

  • Supported Amazon Service: Amazon EC2

  • Operating System: Ubuntu 24.04

  • Compute Architecture: ARM64

  • Linux Kernel: 6.14

  • NVIDIA Driver: 570.172.08

  • NVIDIA CUDA 12.5, 12.6, 12.8 stack:

    • CUDA, NCCL and cuDDN installation directories: /usr/local/cuda-12.8/

    • Default CUDA: 12.8

      • PATH /usr/local/cuda points to CUDA

      • Updated below env vars:

        • LD_LIBRARY_PATH to have /usr/local/cuda-12.8/lib:/usr/local/cuda-12.8/lib64:/usr/local/cuda-12.8:/usr/local/cuda-12.8/targets/sbsa-linux/lib:/usr/local/cuda-12.8/nvvm/lib64:/usr/local/cuda-12.8/extras/CUPTI/lib64

        • PATH to have /usr/local/cuda-12.8/bin/:/usr/local/cuda-12.8/include/

  • Amazon CLI v2 at /usr/local/bin/aws

  • EBS volume type: gp3

  • Nvidia container toolkit: 1.17.8

    • Version command: nvidia-container-cli -V

  • Docker: 28.3.3

  • Python: /usr/bin/python3.12

  • Query AMI-ID with SSM Parameter (example region is us-east-1):

    export SSM_PARAMETER=base-oss-nvidia-driver-gpu-ubuntu-24.04/latest/ami-id && \
    aws ssm get-parameter --region us-east-1 \
    --name /aws/service/deeplearning/ami/arm64/$SSM_PARAMETER \
    --query "Parameter.Value" \
    --output text

  • Query AMI-ID with AWSCLI (example region is us-east-1):

    aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Ubuntu 24.04) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text

Notices

Release Date: 2025-08-08

AMI name: Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Ubuntu 24.04) 20250806

Added

  • Initial release of Deep Learning ARM64 Base OSS Nvidia Driver GPU AMI (Ubuntu 24.04) series. Complimented with NVIDIA Driver R570, CUDA=12.8, NCCL=2.27.5. and EFA=1.43.1.

Known Issues

  • Amazon FSx for Lustre support has been removed in this release due to incompatibility with the latest Ubuntu 24.04 kernel versions. NVIDIA GDS and FS are currently not supported on the latest Ubuntu 24.04 kernel versions. Support for FSx, GDS, and FS will be reinstated once the latest kernel version is supported.