Specifications for Amazon EC2 high-performance computing instances
High-performance computing instances are purpose built to offer the best price performance for running HPC workloads at scale on Amazon. These instances are ideal for applications that benefit from high-performance processors, such as large, complex simulations and deep learning workloads.
Contents
Instance families and instance types
Instance family | Available instance types |
---|---|
Hpc6a | hpc6a.48xlarge |
Hpc6id | hpc6id.32xlarge |
Hpc7a | hpc7a.12xlarge | hpc7a.24xlarge | hpc7a.48xlarge | hpc7a.96xlarge |
Hpc7g | hpc7g.4xlarge | hpc7g.8xlarge | hpc7g.16xlarge |
Instance family summary
Instance family | Hypervisor | Processor type (architecture) | Metal instances available | Dedicated Hosts support | Spot support | Hibernation support | Supported operating systems |
---|---|---|---|---|---|---|---|
Hpc6a | Nitro v4 | AMD (x86_64) | ✗ | ✗ | ✗ | ✗ | Linux |
Hpc6id | Nitro v4 | Intel (x86_64) | ✗ | ✗ | ✗ | ✗ | Windows | Linux |
Hpc7a | Nitro v4 | AMD (x86_64) | ✗ | ✗ | ✗ | ✗ | Windows | Linux |
Hpc7g | Nitro v5 | Amazon Graviton (arm64) | ✗ | ✗ | ✗ | ✗ | Linux |
Performance specifications
Instance type | Burstable | Memory (GiB) | Processor | vCPUs | CPU cores | Threads per core | Accelerators | Accelerator memory |
---|---|---|---|---|---|---|---|---|
Hpc6a | ||||||||
hpc6a.48xlarge | ✗ | 384.00 | AMD EPYC 7R13 | 96 | 96 | 1 | ✗ | ✗ |
Hpc6id | ||||||||
hpc6id.32xlarge | ✗ | 1024.00 | Intel Xeon Ice Lake | 64 | 64 | 1 | ✗ | ✗ |
Hpc7a | ||||||||
hpc7a.12xlarge | ✗ | 768.00 | AMD EPYC 9R14 | 24 | 24 | 1 | ✗ | ✗ |
hpc7a.24xlarge | ✗ | 768.00 | AMD EPYC 9R14 | 48 | 48 | 1 | ✗ | ✗ |
hpc7a.48xlarge | ✗ | 768.00 | AMD EPYC 9R14 | 96 | 96 | 1 | ✗ | ✗ |
hpc7a.96xlarge | ✗ | 768.00 | AMD EPYC 9R14 | 192 | 192 | 1 | ✗ | ✗ |
Hpc7g | ||||||||
hpc7g.4xlarge | ✗ | 128.00 | Amazon Graviton3E Processor | 16 | 16 | 1 | ✗ | ✗ |
hpc7g.8xlarge | ✗ | 128.00 | Amazon Graviton3E Processor | 32 | 32 | 1 | ✗ | ✗ |
hpc7g.16xlarge | ✗ | 128.00 | Amazon Graviton3E Processor | 64 | 64 | 1 | ✗ | ✗ |
Network specifications
Instance type | Baseline / Burst bandwidth (Gbps) | EFA | ENA | ENA Express | Network cards | Max. network interfaces | IP addresses per interface | IPv6 |
---|---|---|---|---|---|---|---|---|
Hpc6a | ||||||||
hpc6a.48xlarge | 100 Gigabit | ✓ | ✓ | ✗ | 1 | 2 | 50 | ✓ |
Hpc6id | ||||||||
hpc6id.32xlarge | 200 Gigabit | ✓ | ✓ | ✗ | 2 | 2 | 50 | ✓ |
Hpc7a | ||||||||
hpc7a.12xlarge | 300 Gigabit | ✓ | ✓ | ✗ | 2 | 4 | 50 | ✓ |
hpc7a.24xlarge | 300 Gigabit | ✓ | ✓ | ✗ | 2 | 4 | 50 | ✓ |
hpc7a.48xlarge | 300 Gigabit | ✓ | ✓ | ✗ | 2 | 4 | 50 | ✓ |
hpc7a.96xlarge | 300 Gigabit | ✓ | ✓ | ✗ | 2 | 4 | 50 | ✓ |
Hpc7g | ||||||||
hpc7g.4xlarge | 200 Gigabit | ✓ | ✓ | ✗ | 1 | 4 | 50 | ✓ |
hpc7g.8xlarge | 200 Gigabit | ✓ | ✓ | ✗ | 1 | 4 | 50 | ✓ |
hpc7g.16xlarge | 200 Gigabit | ✓ | ✓ | ✗ | 1 | 4 | 50 | ✓ |
Amazon EBS specifications
The following table indicates which instance types are Amazon EBS optimized by default and which optionally support it. It also describes their EBS-optimized performance, including dedicated bandwidth to Amazon EBS, the typical maximum aggregate throughput that can be achieved on that dedicated connection with a streaming read workload and 128 KiB I/O size, and the maximum IOPS the instance type can support when using a 16 KiB I/O size. Instance types not listed do not support Amazon EBS optimization.
Important
An instance's EBS performance is bounded by the instance's performance limits, or the
aggregated performance of its attached volumes, whichever is smaller. To achieve maximum
EBS performance, an instance must have attached volumes that provide a combined performance
equal to or greater than the maximum instance performance. For example, to achieve
80,000
IOPS for r6i.16xlarge
, the instance must have at least
5
gp3
volumes provisioned with 16,000
IOPS each
(5
volumes x 16,000
IOPS = 80,000
IOPS).
We recommend that you choose an EBS–optimized instance type that provides more dedicated Amazon EBS throughput than your application needs; otherwise, the connection between Amazon EBS and Amazon EC2 can become a performance bottleneck.
Instance type | Baseline / Maximum bandwidth (Mbps) | Baseline / Maximum throughput (MB/s, 128 KiB I/O) | Baseline / Maximum IOPS (16 KiB I/O) | NVMe | EBS optimization 2 |
---|---|---|---|---|---|
Hpc6a | |||||
hpc6a.48xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
Hpc6id | |||||
hpc6id.32xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
Hpc7a | |||||
hpc7a.12xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
hpc7a.24xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
hpc7a.48xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
hpc7a.96xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
Hpc7g | |||||
hpc7g.4xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
hpc7g.8xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
hpc7g.16xlarge 1 | 87.00 / 2085.00 | 10.88 / 260.62 | 500.00 / 11000.00 | ✓ | default |
Note
1 These instances can support maximum performance for 30 minutes at least once every 24 hours, after which they revert to their baseline performance. Other instances can sustain the maximum performance indefinitely. If your workload requires sustained maximum performance for longer than 30 minutes, use one of these instances.
2 default
indicates that instances are enabled
for EBS optimization by default. supported
indicates that instances can optionally
be enabled for EBS optimization For more information, see Amazon EBS–optimized instances.
Instance store specifications
The following table shows the instance store volume configuration for supported instance types, along with the aggregated IOPS performance with 4,096 byte block size at queue depth saturation.
Instance type | Instance store volumes | Instance store type | 100% random read IOPS / Write IOPS | Needs initialization 1 | TRIM support 2 |
---|---|---|---|---|---|
Hpc6id | |||||
hpc6id.32xlarge | 4 x 3800 GB | NVMe SSD | 2,146,664 / 1,073,336 | ✓ |
1 Volumes attached to certain instances suffer a first-write penalty unless initialized. For more information, see Optimize disk performance for instance store volumes.
2 For more information, see Instance store volume TRIM support.
Security specifications
Instance type | EBS encryption | Instance store encryption | Encryption in transit | AMD SEV-SNP | NitroTPM | Nitro Enclaves |
---|---|---|---|---|---|---|
Hpc6a | ||||||
hpc6a.48xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✓ | ✗ |
Hpc6id | ||||||
hpc6id.32xlarge | ✓ | ✓ | ✓ | ✗ | ✓ | ✗ |
Hpc7a | ||||||
hpc7a.12xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |
hpc7a.24xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |
hpc7a.48xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |
hpc7a.96xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |
Hpc7g | ||||||
hpc7g.4xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |
hpc7g.8xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |
hpc7g.16xlarge | ✓ | Instance store not supported | ✓ | ✗ | ✗ | ✗ |