Creating a Azure Cosmos DB connection
Prerequisites:
In Azure, you will need to identify or generate an Azure Cosmos DB Key for use by Amazon Glue,
cosmosKey
. For more information, see Secure access to data in Azure Cosmos DBin the Azure documentation.
To configure a connection to Azure Cosmos DB:
In Amazon Secrets Manager, create a secret using your Azure Cosmos DB Key. To create a secret in Secrets Manager, follow the tutorial available in Create an Amazon Secrets Manager secret in the Amazon Secrets Manager documentation. After creating the secret, keep the Secret name,
secretName
for the next step.-
When selecting Key/value pairs, create a pair for the key
spark.cosmos.accountKey
with the valuecosmosKey
.
-
In the Amazon Glue console, create a connection by following the steps in Adding an Amazon Glue connection. After creating the connection, keep the connection name,
connectionName
, for future use in Amazon Glue.When selecting a Connection type, select Azure Cosmos DB.
When selecting an Amazon Secret, provide
secretName
.