Optimize GPU settings - Amazon Elastic Compute Cloud
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China.

Optimize GPU settings

There are several GPU setting optimizations that you can perform to achieve the best performance on NVIDIA GPU instances. With some of these instance types, the NVIDIA driver uses an autoboost feature, which varies the GPU clock speeds. By disabling autoboost and setting the GPU clock speeds to their maximum frequency, you can consistently achieve the maximum performance with your GPU instances.

To optimize GPU settings

  1. Open a PowerShell window and navigate to the NVIDIA installation folder.

    cd "C:\Program Files\NVIDIA Corporation\NVSMI"
  2. [G2, G3, and P2 instances only] Disable the autoboost feature for all GPUs on the instance.

    .\nvidia-smi --auto-boost-default=0
  3. Set all GPU clock speeds to their maximum frequency. Use the memory and graphics clock speeds specified in the following commands.

    Some versions of the NVIDIA driver do not support setting the application clock speed, and display the error "Setting applications clocks is not supported for GPU...", which you can ignore.

    • G3 instances:

      .\nvidia-smi -ac "2505,1177"
    • G4dn instances:

      .\nvidia-smi -ac "5001,1590"
    • G5 instances:

      .\nvidia-smi -ac "6250,1710"
    • P2 instances:

      .\nvidia-smi -ac "2505,875"
    • P3 and P3dn instances:

      .\nvidia-smi -ac "877,1530"