View a markdown version of this page

Amazon Deep Learning OSS AMI GPU PyTorch 2.12 (Amazon Linux 2023) - Amazon Deep Learning AMIs
NoticesAMI Name FormatSSM Parameter Query Amazon CLI Parameter QueryLatest Releases
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Amazon Deep Learning OSS AMI GPU PyTorch 2.12 (Amazon Linux 2023)

Note

For detailed software package information, please refer to the individual release notes pages linked below

For help getting started, see Getting started with DLAMI.

Notices

  • Starting with PyTorch 2.9, CUDA and related libraries are now located within the Pytorch virtual environment found in /opt/pytorch/cuda instead of being installed at the system level. This change reduces the image size while maintaining full CUDA functionality. Please ensure that the PyTorch virtual environment is activated to utilize CUDA using source /opt/pytorch/bin/activate

  • Fractional GPU instances (G6f, Gr6f): this AMI automatically loads the NVIDIA GRID driver when booted on a fractional-GPU instance type, and the NVIDIA open driver on all other supported instance types. GPUDirect Storage (GDS) and GPUDirect RDMA kernel modules (nvidia_fs, gdrdrv, efa_nv_peermem) are not loaded on fractional GPU instances because the NVIDIA vGPU driver does not support GPUDirect peer-to-peer.

AMI Name Format

  • Deep Learning OSS Nvidia Driver AMI GPU PyTorch 2.12 (Amazon Linux 2023) ${YYYY-MM-DD}

SSM Parameter Query

Please use the following Public SSM Parameter Query to find the latest DLAMI: 

export SSM_PARAMETER=oss-nvidia-driver-gpu-pytorch-2.12-amazon-linux-2023/latest/ami-id && \
        aws ssm get-parameter --region us-east-1 \
        --name /aws/service/deeplearning/ami/x86_64/$SSM_PARAMETER \
        --query "Parameter.Value" \
        --output text
AWSCLI Query

Please use the following Amazon Query to find the latest DLAMI: 

aws ec2 describe-images --region us-east-1 --owners amazon --filters 'Name=name,Values=Deep Learning OSS Nvidia Driver AMI GPU PyTorch 2.12 (Amazon Linux 2023) ????????' 'Name=state,Values=available' --query 'reverse(sort_by(Images, &CreationDate))[:1].ImageId' --output text
Latest Releases
Latest Release Notes for this DLAMI