Amazon Deep Learning ARM64 AMI OSS GPU PyTorch 2.7 (Ubuntu 22.04) - Amazon Deep Learning AMIs
AMI name formatSupported EC2 instancesAMI contentsNoticesRelease Date: 2025-05-22
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon Deep Learning ARM64 AMI OSS GPU PyTorch 2.7 (Ubuntu 22.04)

For help getting started, see Getting started with DLAMI.

AMI name format

  • Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) ${YYYY-MM-DD}

Supported EC2 instances

  • G5g

The AMI includes the following:

  • Supported Amazon Service: Amazon EC2

  • Operating System: Ubuntu 22.04

  • Compute Architecture: ARM64

  • Linux Kernel: 6.8

  • NVIDIA Driver: 570.133.20

  • NVIDIA CUDA 12.8 stack:

    • CUDA, NCCL and cuDDN installation directories: /usr/local/cuda-12.8/

    • Default CUDA: 12.8

      • PATH /usr/local/cuda points to CUDA 12.8

      • Updated below env vars:

        • LD_LIBRARY_PATH to have /usr/local/cuda/lib:/usr/local/cuda/lib64:/usr/local/cuda:/usr/local/cuda/targets/sbsa-

        • PATH to have /usr/local/cuda/bin/:/usr/local/cuda/include/

  • Amazon CLI v2 at /usr/local/bin/aws

  • EBS volume type: gp3

  • Nvidia container toolkit: 1.17.7

    • Version command: nvidia-container-cli -V

  • Docker: 28.2.2

  • Python: /usr/bin/python3.12

  • Query AMI-ID with SSM Parameter (example region is us-east-1):

    aws ssm get-parameter --region us-east-1 \
    --name /aws/service/deeplearning/ami/arm64/oss-nvidia-driver-gpu-pytorch-2.7-ubuntu-22.04/latest/ami-id \
    --query "Parameter.Value" \
    --output text

  • Query AMI-ID with AWSCLI (example region is us-east-1):

    aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text

Notices

PyTorch Deprecation of Anaconda Channel

Starting with PyTorch 2.6, PyTorch has deprecated support for Conda (see official announcement). As a result, PyTorch 2.6 and above will move to using Python Virtual Environments. To activate the PyTorch venv, please use source /opt/pytorch/bin/activate

Release Date: 2025-05-22

AMI name: Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) 20250521

Added

  • Initial release of Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.7 (Ubuntu 22.04) series. Including a Python virtual environment pytorch (source /opt/pytorch/bin/activate) complimented with NVIDIA Driver R570, CUDA=12.8, cuDNN=9.10, and PyTorch NCCL=2.26.2