Update a serverless endpoint - Amazon SageMaker
Update the endpoint
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Update a serverless endpoint

Before updating your endpoint, create a new endpoint configuration or use an existing endpoint configuration. The endpoint configuration is where you specify the changes for your update. Then, you can update your endpoint with the SageMaker console, the UpdateEndpoint API, or the Amazon CLI. The process for updating a serverless endpoint is the same as the process for updating a real-time endpoint. Note that when updating your endpoint, you can experience cold starts when making requests to the endpoint because SageMaker must re-initialize your container and model.

You may want to update an on-demand serverless endpoint to a serverless endpoint with provisioned concurrency or adjust the Provisioned Concurrency value for an existing serverless endpoint with provisioned concurrency. For both cases, you will have to create a new serverless endpoint configuration with the desired value for Provisioned Concurrency, and apply UpdateEndpoint to the existing serverless endpoint. For more information on creating a new serverless endpoint configuration with Provisioned Concurrency, see Create an endpoint configuration.

If you want to remove Provisioned Concurrency from a serverless endpoint, you will have to create a new endpoint configuration without specifying any value for Provisioned Concurrency, and then apply UpdateEndpoint to the endpoint.

Note

Updating a real-time inference endpoint to either an on-demand serverless endpoint or a serverless endpoint with Provisioned Concurrency is currently not supported.

Update the endpoint

After creating a new serverless endpoint configuration you can use the Amazon SDK for Python (Boto3) or the SageMaker console to update an existing serverless endpoint. Examples of how to update your endpoint using the Amazon SDK for Python (Boto3) and the SageMaker console are outlined in the following sections.

To update the endpoint (using Boto3)

The following example uses the Amazon SDK for Python (Boto3) to call the update_endpoint method. Specify at least the following parameters when calling the method:

  • For EndpointName, use the name of the endpoint you’re updating.

  • For EndpointConfigName, use the name of the endpoint configuration that you want to use for the update.

response = client.update_endpoint(
    EndpointName="<your-endpoint-name>",
    EndpointConfigName="<new-endpoint-config>",
)

To update the endpoint (using the console)

  1. Sign in to the Amazon SageMaker console.

  2. In the navigation tab, choose Inference.

  3. Next, choose Endpoints.

  4. From the list of endpoints, select the endpoint you want to update.

  5. Choose Change in Endpoint configuration settings section.

  6. For Change the Endpoint configuration, choose Use an existing endpoint configuration.

  7. From the list of endpoint configurations, select the one you want to use for your update.

  8. Choose Select endpoint configuration.

  9. Choose Update endpoint.