Enabling GPU-acceleration - Amazon OpenSearch Service
Console
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China (PDF).

Enabling GPU-acceleration

You can enable GPU-acceleration when creating or updating an OpenSearch domain or OpenSearch Serverless collection with the Amazon Web Services Management Console, Amazon CLI, or Amazon SDK.

Once you enable GPU-acceleration on your domain or collection, this feature is enabled by default on all indexes. If you need to disable this feature at the index level, see Creating GPU-accelerated vector indexes.

Console

The following procedures enable GPU-acceleration for OpenSearch domains and OpenSearch Serverless collections using the OpenSearch Serverless management console.

Create new domain

To create an OpenSearch domain with GPU-acceleration enabled, see Creating OpenSearch Service domains.

Edit existing domain

  1. Open the OpenSearch Service management console.

  2. In the navigation pane, choose Domains.

  3. Choose your domain name to open the domain details page.

  4. Choose Actions, then Edit domain.

  5. In the Advanced features section, select Enable GPU acceleration. Once this feature is enabled, your vector indexing operations are accelerated.

  6. Choose Save changes.

Create new collection

To create an OpenSearch Serverless collection with GPU-acceleration enabled, see Tutorial: Getting started with Amazon OpenSearch Serverless. During collection creation, ensure you select the Vector search collection type and enable GPU-acceleration in the vector search configuration.

Edit existing collection

  1. Open the OpenSearch Service management console.

  2. In the navigation pane, choose Collections.

  3. Choose your collection name to open the collection details page.

  4. In the Deployment options section, Edit Vector GPU acceleration.

  5. Disable or enable GPU acceleration.

  6. Choose Save changes.

Amazon CLI

Create new domain

The following Amazon CLI example creates an OpenSearch domain with GPU-acceleration enabled in US East (N. Virginia). Replace the text with that of your own configuration.

aws opensearch create-domain \
    --domain-name my-domain \
    --engine-version OpenSearch_3.1 \
    --cluster-config InstanceType=r6g.xlarge.search,\
        InstanceCount=1,\
        DedicatedMasterEnabled=true,\
        DedicatedMasterCount=3,\
        DedicatedMasterType=m6g.large.search \
    --ebs-options "EBSEnabled=true,\
        VolumeType=gp3,\
        VolumeSize=2000" \
    --encryption-at-rest-options '{"Enabled":true}' \
    --aiml-options '{"ServerlessVectorAcceleration": {"Enabled": true}}' \
    --node-to-node-encryption-options '{"Enabled":true}' \
    --domain-endpoint-options '{"EnforceHTTPS":true,\
        "TLSSecurityPolicy":"Policy-Min-TLS-1-0-2019-07"}' \
    --access-policies '{"Version": "2012-10-17",		 	 	 
        "Statement": [{
            "Effect": "Allow",
            "Principal": {"AWS": "*"},
            "Action": "es:*",
            "Resource": "arn:aws:es:us-east-1:123456789012:domain/my-domain/*"
        }]}' \
    --advanced-security-options '{
        "Enabled":true,
        "InternalUserDatabaseEnabled":true,
        "MasterUserOptions": {
            "MasterUserName":"USER_NAME",
            "MasterUserPassword":"PASSWORD"
        }}' \
    --region us-east-1
Edit existing domain

The following Amazon CLI example enables GPU-acceleration for an existing OpenSearch domain. Replace the text with that of your own configuration.

aws opensearch update-domain-config \
    --domain-name my-domain \
    --cluster-config InstanceType=r7g.16xlarge.search,InstanceCount=3 \
    --aiml-options '{"ServerlessVectorAcceleration": {"Enabled": true}}'
Create new collection

The following Amazon CLI example creates an OpenSearch Serverless collection with GPU-acceleration enabled in US East (N. Virginia). Replace the text with that of your own configuration.

aws opensearchserverless create-collection \
    --name "my-collection" \
    --type "VECTORSEARCH" \
    --description "My vector collection with GPU acceleration" \
    --vector-options '{"ServerlessVectorAcceleration": "ENABLED"}' \
    --region us-east-1
Edit existing collection

The following Amazon CLI example enables GPU-acceleration for an existing OpenSearch Serverless collection. Replace the text with that of your own configuration.

aws opensearchserverless update-collection \
    --id 07tjusf2h91cunochc \
    --vector-options '{"ServerlessVectorAcceleration": "ENABLED"}' \
    --region us-east-1