Amazon Deep Learning ARM64 AMI GPU PyTorch 2.6 (Amazon Linux 2023) - Amazon Deep Learning AMIs
AMI name formatSupported EC2 instancesAMI contentsNoticesRelease Date: 2025-02-21
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon Deep Learning ARM64 AMI GPU PyTorch 2.6 (Amazon Linux 2023)

For help getting started, see Getting started with DLAMI.

AMI name format

  • Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.6.${PATCH-VERSION} (Amazon Linux 2023) ${YYYY-MM-DD}

Supported EC2 instances

  • G5g

The AMI includes the following:

  • Supported Amazon Service: EC2

  • Operating System: Amazon Linux 2023

  • Compute Architecture: ARM64

  • Python: /opt/pytorch/bin/python

  • Python version: 3.12

  • NVIDIA Driver:

    • OSS Nvidia driver:570.86.15

  • NVIDIA CUDA12.6 stack:

    • CUDA, NCCL and cuDDN installation path: /usr/local/cuda-12.6/

    • Default CUDA: 12.6

      • PATH /usr/local/cuda points to /usr/local/cuda-12.6/

      • Updated below env vars:

        • LD_LIBRARY_PATH to have /usr/local/cuda/lib:/usr/local/cuda/lib64:/usr/local/cuda:/usr/local/cuda/targets/sbsa-linux/lib:/usr/local/cuda/nvvm/lib64:/usr/local/cuda/extras/CUPTI/lib64

        • PATH to have /usr/local/cuda/bin/:/usr/local/cuda/include/

    • Compiled system NCCL Version present at /usr/local/cuda/: 2.24.3

    • PyTorch Compiled NCCL Version from PyTorch conda environment: 2.21.5

  • Amazon CLI v2 as aws2 and Amazon CLI v1 as aws

  • EBS volume type: gp3

  • Query AMI-ID with SSM Parameter (example Region is us-east-1):

    aws ssm get-parameter --region us-east-1 \
    --name /aws/service/deeplearning/ami/arm64/oss-nvidia-driver-gpu-pytorch-2.6-amazon-linux-2023/latest/ami-id  \
    --query "Parameter.Value" \
    --output text

  • Query AMI-ID with AWSCLI (example Region is us-east-1):

    aws ec2 describe-images --region us-east-1 \
    --owners amazon \
    --filters 'Name=name,Values=Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.6.? (Amazon Linux 2023) ????????' 'Name=state,Values=available' \
    --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' \
    --output text

Notices

PyTorch Deprecation of Anaconda Channel

Starting with PyTorch 2.6, PyTorch has deprecated support for Conda (see official announcement ). As a result, PyTorch 2.6 and above will move to using Python Virtual Environments. To activate the PyTorch venv, please use source /opt/pytorch/bin/activate

Release Date: 2025-02-21

AMI name: Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.6.0 (Amazon Linux 2023) 20250221

Added

  • Initial release of Deep Learning ARM64 AMI OSS Nvidia Driver GPU PyTorch 2.6.0 (Amazon Linux 2023) series. Including a Python virtual environment pytorch (source /opt/pytorch/bin/activate/), complimented with NVIDIA Driver R570, CUDA=12.6, cuDNN=9.7, PyTorch NCCL=2.21.5.