TransferConfig for multipart upload

Question

Customer wants to tune their multipart upload configuration for more resiliency. They are using boto3, and have looked at TransferConfig, and notice it has a tunable retry number for downloads, but not uploads. They are looking for information on tuning retry behavior for multipart upload. Can you set a max? Is there a default max retry of multi part upload for a particularly object? In general, do we have any documentation on this?

Accepted Answer

You can potentially update in the [Botocore config][1]. That's where the default retry comes from. A sample retry configuration from https://boto3.amazonaws.com/v1/documentation/api/latest/guide/retries.html

by using

[myConfigProfile]
    region = us-east-1
    max_attempts = 10
    retry_mode = standard

or

config = Config(
       retries = {
          'max_attempts': 10,
          'mode': 'standard'
       }
    )

[1]: https://botocore.amazonaws.com/v1/documentation/api/latest/reference/config.html

TransferConfig for multipart upload

Relevant content