AWS DataSync Error

Question

Hi Team,

we are facing some issues in the AWS Datasync while running datasync task  in a specific testing agent,  while the job is executing it is showing some error like "cannot allocate memory".
so Please suggest some articles or any source that would be resolved the issue which we are facing.

Thanks in Advance,

Answer

Hello,

First you should verify that your agent meets the minimum memory requirements for the number of files you are trying to transfer.  For on-premises agents this is a minimum of 4 vCPUs and 32 or 64Gb of RAM.
https://docs.aws.amazon.com/datasync/latest/userguide/agent-requirements.html

If the agent is provisioned correctly ensure you are not exceeding the 50 million files per task limit.  It is recommended to split tasks by using include/exclude filters and target each task to a specific directory or prefix.
https://docs.aws.amazon.com/datasync/latest/userguide/datasync-limits.html

AWS DataSync Error

Relevant content