Best option to transfer 200TB of data?

0

What will be the best option amongst 'S3 Batch', 'Cross Account Replication' and 'Datasync' to transfer 200TB of data from one account to another? Also, how much time will it take to transfer 200TB of data in each of the above services? Suggestions except the above mentioned services are also welcomed.

已提問 1 年前檢視次數 579 次
2 個答案
5
已接受的答案

Greetings! For transferring 200TB of data between two AWS accounts, the best option would be AWS DataSync. The reason being:

AWS DataSync is designed specifically for transferring large amounts of data at high speed, typically up to 10 times faster than open-source tools. It provides robust error handling, encryption, and built-in task scheduling. The time it would take to transfer 200TB of data would depend on the network speed between your two AWS accounts, which can vary greatly. AWS DataSync can achieve speeds up to 10 Gbps, so assuming you can achieve the full 10 Gbps speed, it would take a bit over 18 days to transfer 200TB of data. But, this is highly dependent on your network conditions and could take longer. Alternative options could be:

AWS Snowball: If you don't need your data to be online immediately and can afford a longer transfer time, you could consider using AWS Snowball. This is a physical device that AWS will ship to you, which you can load with your data and then ship back to AWS. They'll then upload the data to your account. The process can take a week or two (or longer), depending on shipping times. https://aws.amazon.com/datasync/

https://aws.amazon.com/snowball/

I hope it is helpful. Let me know if you need any further questions.

Cheers,

ZJon

AWS
專家
ZJon
已回答 1 年前
  • Both the AWS Accounts are in the same Tokyo Region. How much time would it take to transfer the same amount of data,i.e., 200TB? Also, would the transfer require our own bandwidth?

  • Hi Dipesh, It would not require your on prem bandwidth since it is getting transferred from 1 AWS account to another one.

  • How much will it cost to transfer this amount of data, i.e., 200TB using datasync?

  • The onetime cost is about 2560 USD

0

Hi, this article analyzes all possibilities (yours above and others) and gives guidance to optimize: https://repost.aws/knowledge-center/s3-large-transfer-between-buckets

profile pictureAWS
專家
已回答 1 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南