S3 File Gateway multipart upload

Greetings, S3 itself recommends using multipart uploads for files larger than 100 MB, and requires it for files larger than 5 GB. This information is from the general S3 documentation and not specifically about the S3 File Gateway, but it gives you an idea of when multipart uploads start to become useful or necessary.

It's important to remember that using multipart uploads does increase the number of requests, as each part is a separate request. The size of the parts can be anywhere from 5 MB to 5 GB, with the restriction that the last part can be smaller. So, for example, a 1 GB file could be uploaded as 200 parts of 5 MB each, which would result in 200 upload requests, plus one to initiate the multipart upload and one to complete it, for a total of 202 requests. But the same file could also be uploaded as 20 parts of 50 MB each, which would only require 22 requests.

If the primary concern is minimizing the number of requests, it would be better to use larger part sizes. However, using larger parts could potentially reduce upload performance if the network connection is not stable, as any issues would require reuploading a larger amount of data. It also reduces the ability to upload parts in parallel.

Please let me know if I answered your question.

Reference: Amazon S3 Multipart Upload Overview: https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html

For more detailed information about multipart upload in Amazon S3, you can refer to the official AWS documentation. The following link provides an overview of multipart upload, including its benefits, considerations, and best practices:

Amazon S3 Multipart Upload Overview: https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html

This documentation page will provide you with comprehensive insights into how multipart upload works, its use cases, and guidance on effectively utilizing this feature in Amazon S3.