Enabling GPU-acceleration

You can enable GPU-acceleration when creating or updating an OpenSearch domain or OpenSearch Serverless collection with the Amazon Web Services Management Console, Amazon CLI, or Amazon SDK.

Once you enable GPU-acceleration on your domain or collection, this feature is enabled by default on all indexes. If you need to disable this feature at the index level, see Creating GPU-accelerated vector indexes.

Console

The following procedures enable GPU-acceleration for OpenSearch domains and OpenSearch Serverless collections using the OpenSearch Serverless management console.

Create new domain

To create an OpenSearch domain with GPU-acceleration enabled, see Creating OpenSearch Service domains.

Edit existing domain

Open the OpenSearch Service management console.
In the navigation pane, choose Domains.
Choose your domain name to open the domain details page.
Choose Actions, then Edit domain.
In the Advanced features section, select Enable GPU acceleration. Once this feature is enabled, your vector indexing operations are accelerated.
Choose Save changes.

Create new collection

To create an OpenSearch Serverless collection with GPU-acceleration enabled, see Tutorial: Getting started with Amazon OpenSearch Serverless. During collection creation, ensure you select the Vector search collection type and enable GPU-acceleration in the vector search configuration.

Edit existing collection

Note

Updating the GPU-acceleration status on an OpenSearch Serverless collection is not currently supported through the console. However, you can specify the index setting to enable GPU-acceleration for a specific index even if the collection-level status cannot be updated. See Creating GPU-accelerated vector indexes for index-level configuration. If enabling GPU-acceleration for an index fails, contact Amazon Web Services Support.

Amazon CLI

Create new domain

The following Amazon CLI example creates an OpenSearch domain with GPU-acceleration enabled in US East (N. Virginia). Replace the text with that of your own configuration.


aws opensearch create-domain \
    --domain-name my-domain \
    --engine-version OpenSearch_3.1 \
    --cluster-config InstanceType=r6g.xlarge.search,\
        InstanceCount=1,\
        DedicatedMasterEnabled=true,\
        DedicatedMasterCount=3,\
        DedicatedMasterType=m6g.large.search \
    --ebs-options "EBSEnabled=true,\
        VolumeType=gp3,\
        VolumeSize=2000" \
    --encryption-at-rest-options '{"Enabled":true}' \
    --aiml-options '{"ServerlessVectorAcceleration": {"Enabled": true}}' \
    --node-to-node-encryption-options '{"Enabled":true}' \
    --domain-endpoint-options '{"EnforceHTTPS":true,\
        "TLSSecurityPolicy":"Policy-Min-TLS-1-0-2019-07"}' \
    --access-policies '{"Version": "2012-10-17",		 	 	 
        "Statement": [{
            "Effect": "Allow",
            "Principal": {"AWS": "*"},
            "Action": "es:*",
            "Resource": "arn:aws:es:us-east-1:123456789012:domain/my-domain/*"
        }]}' \
    --advanced-security-options '{
        "Enabled":true,
        "InternalUserDatabaseEnabled":true,
        "MasterUserOptions": {
            "MasterUserName":"USER_NAME",
            "MasterUserPassword":"PASSWORD"
        }}' \
    --region us-east-1

Edit existing domain

The following Amazon CLI example enables GPU-acceleration for an existing OpenSearch domain. Replace the text with that of your own configuration.


aws opensearch update-domain-config \
    --domain-name my-domain \
    --cluster-config InstanceType=r7g.16xlarge.search,InstanceCount=3 \
    --aiml-options '{"ServerlessVectorAcceleration": {"Enabled": true}}'

Edit existing collection

Note

The following Amazon CLI example enables GPU-acceleration for an existing OpenSearch Serverless collection. Replace the text with that of your own configuration.


aws opensearchserverless update-collection \
    --id collection-id \
    --type VECTORSEARCH \
    --description "Collection with GPU acceleration enabled"

Javascript is disabled or is unavailable in your browser.

To use the Amazon Web Services Documentation, Javascript must be enabled. Please refer to your browser's Help pages for instructions.

GPU-acceleration for vector indexing

Create GPU-accelerated vector indexes