Best / Most efficient and reliable way of copying Files in EFS to S3

Question

Hello,
Do we have a best practice for EFS to S3 data copy?
I was asked what is the best (in terms of cost, speed and risk) way to copy data from EFS to S3.
There is a suggestion of using multiple FIle Gateways for transfer acceleration
I wonder if DataSync would work as well.
Hence, should you have an answer/experience or shuold you have any data points to recommend one method (over others), please answer to this question.
Thank you.

Accepted Answer

Two thoughts that may help here:
1) Why are they copying data from EFS to S3?
If they are looking to save money on data that they aren't frequently accessing, they would likely be best served by [EFS Infrequent Access][1], which transitions data not accessed for a configurable period of time to storage that is 85% lower price than EFS Standard.

2) Is the data size large (several GiB+), or does it need to be synchronized periodically?
If so, and EFS IA isn't an appropriate solution, than [AWS DataSync][2] is likely your best choice. It is optimized for performance, so it will be the fastest way to move data between the two services. It can also be configured to run periodically, synchronizing deltas each time.

[1]: https://aws.amazon.com/blogs/aws/new-infrequent-access-storage-class-for-amazon-elastic-file-system-efs/
  [2]: https://aws.amazon.com/datasync/

Best / Most efficient and reliable way of copying Files in EFS to S3

相关内容