CreateEndpointConfigRequest Class

Container for the parameters to the CreateEndpointConfig operation. Creates an endpoint configuration that SageMaker hosting services uses to deploy models. In the configuration, you identify one or more models, created using the CreateModel API, to deploy and the resources that you want SageMaker to provision. Then you call the CreateEndpoint API.

Use this API if you want to use SageMaker hosting services to deploy models into production.

In the request, you define a ProductionVariant, for each model that you want to deploy. Each ProductionVariant parameter also describes the resources that you want SageMaker to provision. This includes the number and type of ML compute instances to deploy.

If you are hosting multiple models, you also assign a VariantWeight to specify how much traffic you want to allocate to each model. For example, suppose that you want to host two models, A and B, and you assign traffic weight 2 for model A and 1 for model B. SageMaker distributes two-thirds of the traffic to Model A, and one-third to model B.

When you call CreateEndpoint, a load call is made to DynamoDB to verify that your endpoint configuration exists. When you read data from a DynamoDB table supporting Eventually Consistent Reads , the response might not reflect the results of a recently completed write operation. The response might include some stale data. If the dependent entities are not yet in DynamoDB, this causes a validation error. If you repeat your read request after a short time, the response should return the latest data. So retry logic is recommended to handle these possible issues. We also recommend that customers call DescribeEndpointConfig before calling CreateEndpoint to minimize the potential impact of a DynamoDB eventually consistent read.

Inheritance Hierarchy

System.Object
  Amazon.Runtime.AmazonWebServiceRequest
    Amazon.SageMaker.AmazonSageMakerRequest
      Amazon.SageMaker.Model.CreateEndpointConfigRequest

Namespace: Amazon.SageMaker.Model
Assembly: AWSSDK.SageMaker.dll
Version: 3.x.y.z

Syntax

public class CreateEndpointConfigRequest : AmazonSageMakerRequest
         IAmazonWebServiceRequest

The CreateEndpointConfigRequest type exposes the following members

Constructors

	Name	Description
	CreateEndpointConfigRequest()

Properties

Name	Type	Description
AsyncInferenceConfig	Amazon.SageMaker.Model.AsyncInferenceConfig	Gets and sets the property AsyncInferenceConfig. Specifies configuration for how an endpoint performs asynchronous inference. This is a required field in order for your Endpoint to be invoked using InvokeEndpointAsync.
DataCaptureConfig	Amazon.SageMaker.Model.DataCaptureConfig	Gets and sets the property DataCaptureConfig.
EnableNetworkIsolation	System.Boolean	Gets and sets the property EnableNetworkIsolation. Sets whether all model containers deployed to the endpoint are isolated. If they are, no inbound or outbound network calls can be made to or from the model containers.
EndpointConfigName	System.String	Gets and sets the property EndpointConfigName. The name of the endpoint configuration. You specify this name in a CreateEndpoint request.
ExecutionRoleArn	System.String	Gets and sets the property ExecutionRoleArn. The Amazon Resource Name (ARN) of an IAM role that Amazon SageMaker can assume to perform actions on your behalf. For more information, see SageMaker Roles. To be able to pass this role to Amazon SageMaker, the caller of this action must have the `iam:PassRole` permission.
ExplainerConfig	Amazon.SageMaker.Model.ExplainerConfig	Gets and sets the property ExplainerConfig. A member of `CreateEndpointConfig` that enables explainers.
KmsKeyId	System.String	Gets and sets the property KmsKeyId. The Amazon Resource Name (ARN) of a Amazon Web Services Key Management Service key that SageMaker uses to encrypt data on the storage volume attached to the ML compute instance that hosts the endpoint. The KmsKeyId can be any of the following formats: Key ID: `1234abcd-12ab-34cd-56ef-1234567890ab` Key ARN: `arn:aws:kms:us-west-2:111122223333:key/1234abcd-12ab-34cd-56ef-1234567890ab` Alias name: `alias/ExampleAlias` Alias name ARN: `arn:aws:kms:us-west-2:111122223333:alias/ExampleAlias` The KMS key policy must grant permission to the IAM role that you specify in your `CreateEndpoint`, `UpdateEndpoint` requests. For more information, refer to the Amazon Web Services Key Management Service section Using Key Policies in Amazon Web Services KMS Certain Nitro-based instances include local storage, dependent on the instance type. Local storage volumes are encrypted using a hardware module on the instance. You can't request a `KmsKeyId` when using an instance type with local storage. If any of the models that you specify in the `ProductionVariants` parameter use nitro-based instances with local storage, do not specify a value for the `KmsKeyId` parameter. If you specify a value for `KmsKeyId` when using any nitro-based instances with local storage, the call to `CreateEndpointConfig` fails. For a list of instance types that support local instance storage, see Instance Store Volumes. For more information about local instance storage encryption, see SSD Instance Store Volumes.
ProductionVariants	System.Collections.Generic.List<Amazon.SageMaker.Model.ProductionVariant>	Gets and sets the property ProductionVariants. An array of `ProductionVariant` objects, one for each model that you want to host at this endpoint.
ShadowProductionVariants	System.Collections.Generic.List<Amazon.SageMaker.Model.ProductionVariant>	Gets and sets the property ShadowProductionVariants. An array of `ProductionVariant` objects, one for each model that you want to host at this endpoint in shadow mode with production traffic replicated from the model specified on `ProductionVariants`. If you use this field, you can only specify one variant for `ProductionVariants` and one variant for `ShadowProductionVariants`.
Tags	System.Collections.Generic.List<Amazon.SageMaker.Model.Tag>	Gets and sets the property Tags. An array of key-value pairs. You can use tags to categorize your Amazon Web Services resources in different ways, for example, by purpose, owner, or environment. For more information, see Tagging Amazon Web Services Resources.
VpcConfig	Amazon.SageMaker.Model.VpcConfig	Gets and sets the property VpcConfig.

Version Information

.NET:
Supported in: 8.0 and newer, Core 3.1

.NET Standard:
Supported in: 2.0

.NET Framework:
Supported in: 4.5 and newer, 3.5