Amazon Transfer Family managed workflows - Amazon Transfer Family
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China.

Amazon Transfer Family managed workflows

Amazon Transfer Family supports managed workflows for file processing. With managed workflows, you can create, automate, and monitor file transfers over Secure Shell (SSH) File Transfer Protocol (SFTP), File Transfer Protocol over SSL (FTPS), and File Transfer Protocol (FTP). Using this feature, you can securely and cost effectively meet your compliance requirements for business-to-business (B2B) file exchanges by coordinating all the necessary steps required for file processing. In addition, you benefit from end-to-end auditing and visibility.

            Flow diagram showing how managed workflows assist with file processing.

By orchestrating file-processing tasks, managed workflows help you preprocess data before it is consumed by your downstream applications. Such file-processing tasks might include:

  • Moving files to user-specific folders

  • Encrypting files in transit

  • Scanning for malware or viruses

  • Tagging

To quickly replicate and standardize common post-upload file processing tasks spanning multiple business units in your organization, you can deploy workflows by using infrastructure as code (IaC). Managed workflows are initiated only on fully uploaded files, ensuring that data quality is maintained. Built-in exception handling helps you quickly react to file-processing outcomes, while offering you control over how to handle failures. In addition, each workflow step produces detailed logs, which you can audit to trace the data lineage.

To get started, perform the following tasks:

  1. Set up your workflow to contain preprocessing actions, such as copying, tagging, and other steps based on your requirements. See Create a workflow for details.

  2. Configure an execution role, which Transfer Family uses to run the workflow. See IAM policies for workflows for details.

  3. Map the workflow to a server, so that on file arrival, the actions specified in this workflow are evaluated and initiated in real time. See Configure and execute a workflow for details.

To monitor your workflow executions, see Using CloudWatch metrics for Transfer Family. For detailed execution logs and troubleshooting information, see Troubleshoot workflow-related errors using Amazon CloudWatch.

For more help getting started with managed workflows, see the Building a Cloud-Native File Transfer Platform Using Amazon Transfer Family Workflows blog post.