Amazon DataSync quotas - Amazon DataSync
Storage system quotasTask quotasTask filter quotasTask execution quotasRequest a quota increase
Services or capabilities described in Amazon Web Services documentation might vary by Region. To see the differences applicable to the China Regions, see Getting Started with Amazon Web Services in China.

Amazon DataSync quotas

Find out about quotas when working with Amazon DataSync.

Storage system quotas

DataSync has quotas when working with storage system files and objects.

Description Limit

Maximum total file path length

4,096 bytes

Maximum file path component (file name, directory, or subdirectory) length

255 bytes

Maximum length of Windows domain

253 characters

Maximum length of server hostname

255 characters

Maximum Amazon S3 object name length

1,024 UTF-8 characters

Task quotas

These are the quotas on DataSync tasks for each Amazon Web Services account in an Amazon Web Services Region.

Resource Quota Can quota be increased?

Maximum number of tasks you can create

100

Yes

Maximum number of files or objects per task when transferring data between self-managed storage and Amazon services

50 million

Important

For tasks that transfer more than 20 million files or objects, make sure that you allocate a minimum of 64 GB of RAM to the virtual machine (VM). For minimum resource requirements for DataSync, see Virtual machine requirements.

Yes

Note

As an alternative to requesting an increase, you can create tasks on different subdirectories using include and exclude filters. For more information about using filters, see Filtering the data transferred by Amazon DataSync.

Maximum number of files or objects per task when transferring data between Amazon storage services

25 million

Yes

Note

As an alternative to requesting an increase, you can create tasks on different subdirectories using include/exclude filters. For more information about using filters, see Filtering the data transferred by Amazon DataSync.

Maximum number of files per task when running DataSync on an Amazon Snowcone device

200,000

No

Maximum throughput per task

10 Gbps (for transfers that use a DataSync agent)

No

5 Gbps (for transfers that don't use a DataSync agent)

No

Task filter quotas

DataSync has quotas on how you can filter data in a task.

Filter Limit

Maximum number of characters you can include in a task filter

102,400 characters

Note

If you're using the Amazon Web Services Management Console, this limit includes all the characters combined in your include and exclude patterns.

Task execution quotas

These are the quotas on DataSync task executions for each Amazon Web Services account in an Amazon Web Services Region.

Resource Quota

Number of days a task execution's history is retained

30

Request a quota increase

You can request an increase for some DataSync quotas. Increases aren't granted right away and might take a couple of days to take effect.

To request a quota increase

  1. Open the Amazon Support Center page, sign in if necessary, and then choose Create case.

  2. For Create case, choose Service limit increase.

  3. For Limit type, choose DataSync.

  4. For Region, select your Amazon Web Services Region, and for Limit, select the quota that you want to increase.

  5. Fill in the case description, and then choose your preferred method of contact.

    If you need to increase a different quota, fill out a separate request.