AWS::SageMaker::EndpointConfig ServerlessConfig - Amazon CloudFormation
SyntaxProperties
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

AWS::SageMaker::EndpointConfig ServerlessConfig

Specifies the serverless configuration for an endpoint variant.

Syntax

To declare this entity in your Amazon CloudFormation template, use the following syntax:

JSON

{
  "MaxConcurrency" : Integer,
  "MemorySizeInMB" : Integer,
  "ProvisionedConcurrency" : Integer
}

YAML

  MaxConcurrency: Integer
  MemorySizeInMB: Integer
  ProvisionedConcurrency: Integer

Properties

MaxConcurrency

The maximum number of concurrent invocations your serverless endpoint can process.

Required: Yes

Type: Integer

Minimum: 1

Maximum: 200

Update requires: Replacement

MemorySizeInMB

The memory size of your serverless endpoint. Valid values are in 1 GB increments: 1024 MB, 2048 MB, 3072 MB, 4096 MB, 5120 MB, or 6144 MB.

Required: Yes

Type: Integer

Minimum: 1024

Maximum: 6144

Update requires: Replacement

ProvisionedConcurrency

The amount of provisioned concurrency to allocate for the serverless endpoint. Should be less than or equal to MaxConcurrency.

Note

This field is not supported for serverless endpoint recommendations for Inference Recommender jobs. For more information about creating an Inference Recommender job, see CreateInferenceRecommendationsJobs.

Required: No

Type: Integer

Minimum: 1

Maximum: 200

Update requires: Replacement