View a markdown version of this page

Amazon Deep Learning OSS AMI GPU PyTorch 2.13 (Amazon Linux 2023) - Amazon Deep Learning AMIs
NoticesAMI Name FormatSSM Parameter Query Amazon CLI Parameter QueryLatest releases
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon Deep Learning OSS AMI GPU PyTorch 2.13 (Amazon Linux 2023)

Note

For detailed software package information, see the individual release notes pages linked below.

For help getting started, see Getting started with DLAMI.

Notices

  • Starting with PyTorch 2.9, CUDA and related libraries are located in the PyTorch virtual environment at /opt/pytorch/cuda instead of at the system level. This change reduces the image size while maintaining full CUDA functionality. To use CUDA, activate the PyTorch virtual environment using source /opt/pytorch/bin/activate.

  • Fractional GPU instances (G6f, Gr6f): this AMI automatically loads the NVIDIA GRID driver when booted on a fractional-GPU instance type, and the NVIDIA open driver on all other supported instance types. GPUDirect Storage (GDS) and GPUDirect RDMA kernel modules (nvidia_fs, gdrdrv, efa_nv_peermem) are not loaded on fractional GPU instances because the NVIDIA vGPU driver does not support GPUDirect peer-to-peer.

AMI Name Format

  • Deep Learning OSS Nvidia Driver AMI GPU PyTorch 2.13 (Amazon Linux 2023) ${YYYY-MM-DD}

SSM Parameter Query

Use the following Public SSM Parameter Query to find the latest DLAMI: 

export SSM_PARAMETER=oss-nvidia-driver-gpu-pytorch-2.13-amazon-linux-2023/latest/ami-id && \
        aws ssm get-parameter --region us-east-1 \
        --name /aws/service/deeplearning/ami/x86_64/$SSM_PARAMETER \
        --query "Parameter.Value" \
        --output text
Amazon CLI query

Use the following Amazon CLI query to find the latest DLAMI: 

aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning OSS Nvidia Driver AMI GPU PyTorch 2.13 (Amazon Linux 2023) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text
Latest releases
Latest Release Notes for this DLAMI