Manage Amazon Glue DataBrew Jobs with Step Functions

Step Functions can control certain Amazon services directly from the Amazon States Language. For more information about working with Amazon Step Functions and its integrations, see the following:

You can use the DataBrew integration to add data cleaning and data normalization steps into your analytics and machine learning workflows.

Supported DataBrew API:

The following includes a Task state that starts a request-response DataBrew job.

"DataBrew StartJobRun": {
            "Type": "Task",
            "Resource": "arn:aws:states:::databrew:startJobRun",
            "Parameters": {
               "Name": "sample-proj-job-1"
            },
            "Next": "NEXT_STATE"
          },
        

The following includes a Task state that starts a sync DataBrew job.

"DataBrew StartJobRun": {
           "Type": "Task",
           "Resource": "arn:aws:states:::databrew:startJobRun.sync",
           "Parameters": {
              "Name": "sample-proj-job-1"
           },
           "Next": "NEXT_STATE"
          },
        

For information on how to configure IAM when using Step Functions with other Amazon services, see IAM Policies for integrated services.