AWS slow upload on tiny files

Question

Hi there,

I upload on a regular basis static websites on S3 buckets.
I have a new website where this upload is very very very slow: it can take up to 1 hour to upload a ~30MB bundle of 1500 to 2000 files, mainly .js (i.e. no large image or video).
The upload first indicates a correct speed and ~2min remaining, then it just slows and seems very lost in the estimated remaining time :)
It does not happen on other projects, the bucket in the same region (eu-west-3), I activated the Transfer acceleration without any substantial difference and I tried from 3 different networks.

Any idea ?!
Thanks

Answer

Hello,

This could be a Client config, see "max_concurrent_requests" in https://docs.aws.amazon.com/cli/latest/topic/s3-config.html. The SDK will have similar configuration options, like https://boto3.amazonaws.com/v1/documentation/api/latest/guide/s3.html.

Hope this helped!

//Carl

AWS slow upload on tiny files

相关内容