Amazon DataSync quotas
Find out about quotas when working with Amazon DataSync.
Storage system quotas
DataSync has quotas when working with storage system files and objects.
Description | Limit |
---|---|
Maximum total file path length |
4,096 bytes |
Maximum file path component (file name, directory, or subdirectory) length |
255 bytes |
Maximum length of Windows domain |
253 characters |
Maximum length of server hostname |
255 characters |
Maximum Amazon S3 object name length |
1,024 UTF-8 characters |
Task quotas
These are the quotas on DataSync tasks for each Amazon Web Services account in an Amazon Web Services Region.
Resource | Quota | Can quota be increased? |
---|---|---|
Maximum number of tasks you can create |
100 |
Yes |
Maximum number of files or objects per task when transferring data between self-managed storage and Amazon services |
50 million For tasks that transfer more than 20 million files or objects, make sure that you allocate a minimum of 64 GB of RAM to the virtual machine (VM). For minimum resource requirements for DataSync, see Virtual machine requirements. |
Yes As an alternative to requesting an increase, you can create tasks on different subdirectories using include and exclude filters. For more information about using filters, see Filtering the data transferred by Amazon DataSync. |
Maximum number of files or objects per task when transferring data between Amazon storage services |
25 million |
Yes As an alternative to requesting an increase, you can create tasks on different subdirectories using include/exclude filters. For more information about using filters, see Filtering the data transferred by Amazon DataSync. |
Maximum number of files per task when running DataSync on an Amazon Snowcone device |
200,000 |
No |
Maximum throughput per task |
10 Gbps (for transfers that use a DataSync agent) |
No |
5 Gbps (for transfers that don't use a DataSync agent) |
No |
Task filter quotas
DataSync has quotas on how you can filter data in a task.
Filter | Limit |
---|---|
Maximum number of characters you can include in a task filter |
102,400 characters If you're using the Amazon Web Services Management Console, this limit includes all the characters combined in your include and exclude patterns. |
Task execution quotas
These are the quotas on DataSync task executions for each Amazon Web Services account in an Amazon Web Services Region.
Resource | Quota |
---|---|
Number of days a task execution's history is retained |
30 |
Request a quota increase
You can request an increase for some DataSync quotas. Increases aren't granted right away and might take a couple of days to take effect.
To request a quota increase
-
Open the Amazon Support Center
page, sign in if necessary, and then choose Create case. -
For Create case, choose Service limit increase.
-
For Limit type, choose DataSync.
-
For Region, select your Amazon Web Services Region, and for Limit, select the quota that you want to increase.
-
Fill in the case description, and then choose your preferred method of contact.
If you need to increase a different quota, fill out a separate request.