UltraServer - Amazon SageMaker
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

UltraServer

Represents a high-performance compute server used for distributed training in SageMaker AI. An UltraServer consists of multiple instances within a shared NVLink interconnect domain.

Contents

AvailabilityZone

The name of the Availability Zone where the UltraServer is provisioned.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 32.

Pattern: [a-z]+\-[0-9a-z\-]+

Required: Yes

InstanceType

The Amazon EC2 instance type used in the UltraServer.

Type: String

Valid Values: ml.p4d.24xlarge | ml.p5.48xlarge | ml.p5e.48xlarge | ml.p5en.48xlarge | ml.trn1.32xlarge | ml.trn2.48xlarge | ml.p6-b200.48xlarge | ml.p4de.24xlarge | ml.p6e-gb200.36xlarge

Required: Yes

TotalInstanceCount

The total number of instances in this UltraServer.

Type: Integer

Valid Range: Minimum value of 0.

Required: Yes

UltraServerId

The unique identifier for the UltraServer.

Type: String

Length Constraints: Minimum length of 0. Maximum length of 256.

Pattern: (?!\s*$).+

Required: Yes

UltraServerType

The type of UltraServer, such as ml.u-p6e-gb200x72.

Type: String

Length Constraints: Minimum length of 1. Maximum length of 64.

Pattern: ml.[a-z0-9\-.]+

Required: Yes

AvailableInstanceCount

The number of instances currently available for use in this UltraServer.

Type: Integer

Valid Range: Minimum value of 0.

Required: No

AvailableSpareInstanceCount

The number of available spare instances in the UltraServer.

Type: Integer

Valid Range: Minimum value of 0.

Required: No

ConfiguredSpareInstanceCount

The number of spare instances configured for this UltraServer to provide enhanced resiliency.

Type: Integer

Valid Range: Minimum value of 0.

Required: No

HealthStatus

The overall health status of the UltraServer.

Type: String

Valid Values: OK | Impaired | Insufficient-Data

Required: No

InUseInstanceCount

The number of instances currently in use in this UltraServer.

Type: Integer

Valid Range: Minimum value of 0.

Required: No

UnhealthyInstanceCount

The number of instances in this UltraServer that are currently in an unhealthy state.

Type: Integer

Valid Range: Minimum value of 0.

Required: No

See Also

For more information about using this API in one of the language-specific Amazon SDKs, see the following: