Install NVIDIA drivers on Windows instances - Amazon Elastic Compute Cloud
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Install NVIDIA drivers on Windows instances

An instance with an attached NVIDIA GPU, such as a P3 or G4dn instance, must have the appropriate NVIDIA driver installed. Depending on the instance type, you can either download a public NVIDIA driver, download a driver from Amazon S3 that is available only to Amazon customers, or use an AMI with the driver pre-installed.

Note

We require TLS 1.2 and recommend TLS 1.3. Your client must meet this requirement to download from Amazon Simple Storage Service (Amazon S3). For more information, see TLS 1.2 to become the minimum TLS protocol level for all Amazon API endpoints.

To install AMD drivers on a Linux instance with an attached AMD GPU, such as a G4ad instance, see Install AMD drivers instead. To install NVIDIA drivers on a Linux instance, see Install NVIDIA drivers on a Linux instance.

Types of NVIDIA drivers

The following are the main types of NVIDIA drivers that can be used with GPU-based instances.

Tesla drivers

These drivers are intended primarily for compute workloads, which use GPUs for computational tasks such as parallelized floating-point calculations for machine learning and fast Fourier transforms for high performance computing applications.

GRID drivers

These drivers are certified to provide optimal performance for professional visualization applications that render content such as 3D models or high-resolution videos. You can configure GRID drivers to support two modes. Quadro Virtual Workstations provide access to four 4K displays per GPU. GRID vApps provide RDSH App hosting capabilities.

Gaming drivers

These drivers contain optimizations for gaming and are updated frequently to provide performance enhancements. They support a single 4K display per GPU.

Configured mode

On Windows, the Tesla drivers are configured to run in Tesla Compute Cluster (TCC) mode. The GRID and gaming drivers are configured to run in Windows Display Driver Model (WDDM) mode. In TCC mode, the card is dedicated to compute workloads. In WDDM mode, the card supports both compute and graphics workloads.

NVIDIA control panel

The NVIDIA control panel is supported with GRID and Gaming drivers. It is not supported with Tesla drivers.

Supported APIs for Tesla drivers
  • OpenCL

  • NVIDIA CUDA and related libraries (for example, cuDNN, TensorRT, nvJPEG, and cuBLAS)

  • NVENC for video encoding and NVDEC for video decoding

Supported APIs for GRID and gaming drivers
  • DirectX, Direct2D, DirectX Video Acceleration, DirectX Raytracing

  • OpenCL, OpenGL, and Vulkan

  • NVIDIA CUDA and related libraries (for example, cuDNN, TensorRT, nvJPEG, and cuBLAS)

  • NVENC for video encoding and NVDEC for video decoding

Available drivers by instance type

The following table summarizes the supported NVIDIA drivers for each GPU instance type.

Instance type Tesla driver GRID driver Gaming driver
G2 Yes No No
G3 Yes Yes No
G4dn Yes Yes Yes
G5 Yes Yes Yes
P2 Yes No No
P3 Yes Yes ² No

¹ This Tesla driver also supports optimized graphics applications specific to the ARM64 platform

Installation options

Use one of the following options to get the NVIDIA drivers required for your GPU instance.

Option 1: AMIs with the NVIDIA drivers installed

Amazon and NVIDIA offer different Amazon Machine Images (AMI) that come with the NVIDIA drivers installed.

If you create a custom Windows AMI using one of the Amazon Web Services Marketplace offerings, the AMI must be a standardized image created using Sysprep to ensure that the GRID driver works.

Option 2: Public NVIDIA drivers

The options offered by Amazon come with the necessary license for the driver. Alternatively, you can install the public drivers and bring your own license. To install a public driver, download it from the NVIDIA site as described here.

Alternatively, you can use the options offered by Amazon instead of the public drivers. To use a GRID driver on a P3 instance, use the Amazon Web Services Marketplace AMIs as described in Option 1. To use a GRID driver on a G5, G4dn, or G3 instance, use the Amazon Web Services Marketplace AMIs, as described in Option 1 or install the NVIDIA drivers provided by Amazon as described in Option 3.

To download a public NVIDIA driver

Log on to your Windows instance and download the 64-bit NVIDIA driver appropriate for the instance type from http://www.nvidia.com/Download/Find.aspx. For Product Type, Product Series, and Product, use the options in the following table.

Instance Product Type Product Series Product
G2 GRID GRID Series GRID K520
G3 Tesla M-Class M60
G4dn Tesla T-Series T4
G5 ¹ Tesla A-Series A10
P2 Tesla K-Series K80
P3 Tesla V-Series V100
P5 ³ Tesla H-Series H100

¹ G5 instances require driver version 470.00 or later

² G5g instances require driver version 470.82.01 or later. The operating systems is Linux aarch64

³ P5 instances require driver version 530 or later.

To install the NVIDIA driver on Windows
  1. Open the folder where you downloaded the driver and launch the installation file. Follow the instructions to install the driver and reboot your instance as required.

  2. Disable the display adapter named Microsoft Basic Display Adapter that is marked with a warning icon using Device Manager. Install these Windows features: Media Foundation and Quality Windows Audio Video Experience.

    Important

    Don't disable the display adapter named Microsoft Remote Display Adapter. If Microsoft Remote Display Adapter is disabled your connection might be interrupted and attempts to connect to the instance after it has rebooted might fail.

  3. Check Device Manager to verify that the GPU is working correctly.

  4. To achieve the best performance from your GPU, complete the optimization steps in Optimize GPU settings.

Option 3: GRID drivers (G5, G4dn, and G3 instances)

These downloads are available to Amazon customers only. By downloading, you agree to use the downloaded software only to develop AMIs for use with the NVIDIA A10G, NVIDIA Tesla T4, or NVIDIA Tesla M60 hardware. Upon installation of the software, you are bound by the terms of the NVIDIA GRID Cloud End User License Agreement.

Important

Windows server 2016 is not supported in NVIDIA GRID driver release 15.0 or later.

Considerations
  • If you launch your Windows instance using a custom Windows AMI, the AMI must be a standardized image created using Sysprep to ensure that the GRID driver works.

  • G3 instances require Amazon provided DNS resolution for GRID licensing to work.

  • IMDSv2 is only supported with NVIDIA driver version 14.0 or greater.

To install the NVIDIA GRID driver on your Windows instance
  1. Connect to your Windows instance and open a PowerShell window.

  2. Configure default credentials for the Amazon Tools for Windows PowerShell on your Windows instance. For more information, see Getting Started with the Amazon Tools for Windows PowerShell in the Amazon Tools for Windows PowerShell User Guide.

    Important

    Your user or role must have the permissions granted that contains the AmazonS3ReadOnlyAccess policy. For more information, see Amazon managed policy: AmazonS3ReadOnlyAccess in the Amazon Simple Storage Service User Guide.

  3. Download the drivers and the NVIDIA GRID Cloud End User License Agreement from Amazon S3 to your desktop using the following PowerShell commands.

    $Bucket = "ec2-windows-nvidia-drivers" $KeyPrefix = "latest" $LocalPath = "$home\Desktop\NVIDIA" $Objects = Get-S3Object -BucketName $Bucket -KeyPrefix $KeyPrefix -Region cn-north-1 foreach ($Object in $Objects) { $LocalFileName = $Object.Key if ($LocalFileName -ne '' -and $Object.Size -ne 0) { $LocalFilePath = Join-Path $LocalPath $LocalFileName Copy-S3Object -BucketName $Bucket -Key $Object.Key -LocalFile $LocalFilePath -Region cn-north-1 } }

    Multiple versions of the NVIDIA GRID driver are stored in this bucket. You can download all of the available Windows versions in the bucket by removing the -KeyPrefix $KeyPrefix option. For information about the version of the NVIDIA GRID driver for your operating system, see the NVIDIA® Virtual GPU (vGPU) Software Documentation on the NVIDIA website.

    Starting with GRID version 11.0, you can use the drivers under latest for both G3 and G4dn instances. We will not add versions later than 11.0 to g4/latest, but will keep version 11.0 and the earlier versions specific to G4dn under g4/latest.

    G5 instances require GRID 13.1 or later (or GRID 12.4 or later).

  4. Navigate to the desktop and double-click the installation file to launch it (choose the driver version that corresponds to your instance OS version). Follow the instructions to install the driver and reboot your instance as required. To verify that the GPU is working properly, check Device Manager.

  5. (Optional) Use the following command to disable the licensing page in the control panel to prevent users from accidentally changing the product type (NVIDIA GRID Virtual Workstation is enabled by default). For more information, see the GRID Licensing User Guide.

    PowerShell

    Run the following PowerShell commands to create the registry value to disable the licensing page in the control panel. The Amazon Tools for PowerShell in Amazon Windows AMIs defaults to the 32-bit version and this command fails. Instead, use the 64-bit version of PowerShell included with the operating system.

    New-Item -Path "HKLM:\SOFTWARE\NVIDIA Corporation\Global" -Name GridLicensing New-ItemProperty -Path "HKLM:\SOFTWARE\NVIDIA Corporation\Global\GridLicensing" -Name "NvCplDisableManageLicensePage" -PropertyType "DWord" -Value "1"
    Command Prompt

    Run the following registry command to create the registry value to disable the licensing page in the control panel. You can run it using the Command Prompt window or a 64-bit version of PowerShell.

    reg add "HKLM\SOFTWARE\NVIDIA Corporation\Global\GridLicensing" /v NvCplDisableManageLicensePage /t REG_DWORD /d 1
  6. (Optional) Depending on your use case, you might complete the following optional steps. If you do not require this functionality, do not complete these steps.

    1. To help take advantage of the four displays of up to 4K resolution, set up the high-performance display protocol, NICE DCV.

    2. NVIDIA Quadro Virtual Workstation mode is enabled by default. To activate GRID Virtual Applications for RDSH Application hosting capabilities, complete the GRID Virtual Application activation steps in Activate NVIDIA GRID Virtual Applications.

Option 4: NVIDIA gaming drivers (G5 and G4dn instances)

These drivers are available to Amazon customers only. By downloading them, you agree to use the downloaded software only to develop AMIs for use with the NVIDIA A10G and NVIDIA Tesla T4 hardware. Upon installation of the software, you are bound by the terms of the NVIDIA GRID Cloud End User License Agreement.

Prerequisites
  • If you launch your Windows instance using a custom Windows AMI, the AMI must be a standardized image created using Sysprep to ensure that the gaming driver works.

  • Configure default credentials for the Amazon Tools for Windows PowerShell on your Windows instance. For more information, see Getting Started with the Amazon Tools for Windows PowerShell in the Amazon Tools for Windows PowerShell User Guide.

  • Your users or role must have the permissions granted that contains the AmazonS3ReadOnlyAccess policy. For more information, see Amazon managed policy: AmazonS3ReadOnlyAccess in the Amazon Simple Storage Service User Guide.

  • G3 instances require Amazon provided DNS resolution for GRID licensing to work.

  • IMDSv2 is only supported with NVIDIA driver version 495.x or greater.

To install the NVIDIA gaming driver on your Windows instance
  1. Connect to your Windows instance and open a PowerShell window.

  2. Configure your Amazon profile to use the Global region as follows:

    $ aws configure AWS Access Key ID [None]: enter a Global region access key AWS Secret Access Key [None]: enter a Global region secret access key Default region name [None]: us-east-1 Default output format [None]: json
  3. Download and install the gaming driver using the following PowerShell commands.

    $Bucket = "nvidia-gaming" $KeyPrefix = "windows/latest" $LocalPath = "$home\Desktop\NVIDIA" $Objects = Get-S3Object -BucketName $Bucket -KeyPrefix $KeyPrefix -Region us-east-1 foreach ($Object in $Objects) { $LocalFileName = $Object.Key if ($LocalFileName -ne '' -and $Object.Size -ne 0) { $LocalFilePath = Join-Path $LocalPath $LocalFileName Copy-S3Object -BucketName $Bucket -Key $Object.Key -LocalFile $LocalFilePath -Region us-east-1 } }

    Multiple versions of the NVIDIA GRID driver are stored in this S3 bucket. You can download all of the available versions in the bucket if you change the value of the $KeyPrefix variable from "windows/latest" to "windows".

  4. Navigate to the desktop and double-click the installation file to launch it (choose the driver version that corresponds to your instance OS version). Follow the instructions to install the driver and reboot your instance as required. To verify that the GPU is working properly, check Device Manager.

  5. Use one of the following methods to register the driver.

    Version 527.27 or above

    Create the following registry key with the 64-bit version of PowerShell, or the Command Prompt window.

    key: HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\nvlddmkm\Global

    name: vGamingMarketplace

    type: DWord

    value: 2

    PowerShell

    Run the following PowerShell command to create this registry value. The Amazon Tools for PowerShell in Amazon Windows AMIs defaults to the 32-bit version and this command fails. Instead, use the 64-bit version of PowerShell included with the operating system.

    New-ItemProperty -Path "HKLM:\SYSTEM\CurrentControlSet\Services\nvlddmkm\Global" -Name "vGamingMarketplace" -PropertyType "DWord" -Value "2"
    Command Prompt

    Run the following registry command to create this registry value. You can run it using the Command Prompt window or a 64-bit version of PowerShell.

    reg add "HKLM\SYSTEM\CurrentControlSet\Services\nvlddmkm\Global" /v vGamingMarketplace /t REG_DWORD /d 2
    Earlier versions

    Create the following registry key with the 64-bit version of PowerShell, or the Command Prompt window.

    key: HKEY_LOCAL_MACHINE\SOFTWARE\NVIDIA Corporation\Global

    name: vGamingMarketplace

    type: DWord

    value: 2

    PowerShell

    Run the following PowerShell command to create this registry value. The Amazon Tools for PowerShell in Amazon Windows AMIs defaults to the 32-bit version and this command fails. Instead, use the 64-bit version of PowerShell included with the operating system.

    New-ItemProperty -Path "HKLM:\SOFTWARE\NVIDIA Corporation\Global" -Name "vGamingMarketplace" -PropertyType "DWord" -Value "2"
    Command Prompt

    Run the following registry command to create this registry key with the Command Prompt window. You can also use this command in the 64-bit version of PowerShell.

    reg add "HKLM\SOFTWARE\NVIDIA Corporation\Global" /v vGamingMarketplace /t REG_DWORD /d 2
  6. Run the following command in PowerShell. This downloads the certification file, renames the file GridSwCert.txt, and moves the file to the Public Documents folder on your system drive. Typically, the folder path is C:\Users\Public\Documents.

    • For version 461.40 or later:

      Invoke-WebRequest -Uri "https://nvidia-gaming.s3.amazonaws.com/GridSwCert-Archive/GridSwCertWindows_2021_10_2.cert" -OutFile "$Env:PUBLIC\Documents\GridSwCert.txt"
    • For version 445.87:

      Invoke-WebRequest -Uri "https://nvidia-gaming.s3.amazonaws.com/GridSwCert-Archive/GridSwCert-Windows_2020_04.cert" -OutFile "$Env:PUBLIC\Documents\GridSwCert.txt"
    • For earlier versions:

      Invoke-WebRequest -Uri "https://nvidia-gaming.s3.amazonaws.com/GridSwCert-Archive/GridSwCert-Windows_2019_09.cert" -OutFile "$Env:PUBLIC\Documents\GridSwCert.txt"
  7. Reboot your instance.

  8. Verify the NVIDIA Gaming license using the following command.

    C:\Windows\System32\DriverStore\FileRepository\nvgrid*\nvidia-smi.exe -q

    The output should be similar to the following.

    vGPU Software Licensed Product Product Name : NVIDIA Cloud Gaming License Status : Licensed (Expiry: N/A)
  9. (Optional) To help take advantage of the single display of up to 4K resolution, set up the high-performance display protocol NICE DCV. If you do not require this functionality, do not complete this step.

Install an additional version of CUDA

After you install an NVIDIA graphics driver on your instance, you can install a version of CUDA other than the version that is bundled with the graphics driver. The following procedure demonstrates how to configure multiple versions of CUDA on the instance.

To install the CUDA toolkit
  1. Connect to your Windows instance.

  2. Open the NVIDIA website and select the version of CUDA that you need.

  3. For Installer Type, select exe (local) and then choose Download.

  4. Using your browser, run the downloaded install file. Follow the instructions to install the CUDA toolkit. You might be required to reboot the instance.