Download bandwidth

0

Hi, I want to know if downloading from S3 bucket has some bandwidth restrictions. I mean, in my case, I try to download different files from S3 to a server in on-premises, and there is no problem when starts to download, with files size is around 10GB, but when I try to download a file that size is 60GB or more, the bandwidth decreases drastically. So I am try to look for if the problem is from S3 or from on-premises infrastructure.

Regards!

JMCR09
已提問 3 個月前檢視次數 147 次
2 個答案
0

When downloading large objects such as the following, it is recommended to split them into multiple requests and download them in parallel. Therefore, it is assumed that there is a certain speed limit (around 700 Mbps?).

As a general rule, when you download large objects within a Region from Amazon S3 to Amazon EC2, we suggest making concurrent requests for byte ranges of an object at the granularity of 8–16 MB. Make one concurrent request for each 85–90 MB/s of desired network throughput. To saturate a 10 Gb/s network interface card (NIC), you might use about 15 concurrent requests over separate connections. You can scale up the concurrent requests over more connections to saturate faster NICs, such as 25 Gb/s or 100 Gb/s NICs.

https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance-design-patterns.html#optimizing-performance-parallelization

profile picture
專家
shibata
已回答 3 個月前
profile pictureAWS
專家
已審閱 3 個月前
0

Hi,

You may want to consider S3 Transfer Acceleration: https://docs.aws.amazon.com/AmazonS3/latest/userguide/transfer-acceleration.html for such large files.

It is particularly helpful when you're geographically far away from the AWS region where your source S3 bucket is.

Best,

Didier

profile pictureAWS
專家
已回答 3 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南