Creating a MongoDB source node
Prerequisites needed
A Amazon Glue MongoDB connection, as described in the previous section, Creating a MongoDB connection.
If you chose to create an Secrets Manager secret, appropriate permissions on your job to read the secret used by the connection.
-
A MongoDB collection you would like to read from. You will need identification information for the collection.
A MongoDB collection is identified by a database name and a collection name,
mongodbName
,mongodbCollection
.
Adding a MongoDB data source
To add a Data source – MongoDB node:
-
Choose the connection for your MongoDB data source. Since you have created it, it should be available in the dropdown. If you need to create a connection, choose Create MongoDB connection. For more information see the previous section, Creating a MongoDB connection.
Once you have chosen a connection, you can view the connection properties by clicking View properties.
Choose a Database. Enter
mongodbName
.Choose a Collection. Enter
mongodbCollection
.-
Choose your Partitioner, Partition size (MB) and Partition key. For more information about partition parameters, see "connectionType": "mongodb" as source.
-
In Custom MongoDB properties, enter parameters and values as needed.