Manage Amazon Glue Jobs with Step Functions
Step Functions can control certain Amazon services directly from Amazon States Language (ASL). To learn more, see Working with other services and Pass parameters to a service API.
How the Optimized Amazon Glue integration is different than the Amazon GlueAmazon SDK integration
The Run a Job (.sync) integration pattern is available.
The
JobName
field is extracted from the request and inserted into the response, which normally only containsJobRunID
.
Supported Amazon Glue API:
Parameters in Step Functions are expressed in PascalCase
Even if the native service API is in camelCase, for example the API action startSyncExecution
, you specify parameters in PascalCase, such as: StateMachineArn
.
The following includes a Task
state that starts an Amazon Glue job.
"Glue StartJobRun": { "Type": "Task", "Resource": "arn:aws:states:::glue:startJobRun.sync", "Parameters": { "JobName": "GlueJob-JTrRO5l98qMG" }, "Next": "ValidateOutput" },
For information about how to configure IAM permissions when using Step Functions with other Amazon services, see IAM Policies for integrated services.