How to recognize 500 or 503 response as rate-limit

Question

Hi,
In this guide https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance.html you are mentioning that high rate of requests to S3 might end up in 500 or 503.
I want to know if there is a way to find out if a specific 500 or 503 response is happening as a rate-limit mechanism result or not, and eventually if a specific request is retry-able.

Thanks ahead

Answer

Hi, have a look at https://aws.amazon.com/premiumsupport/knowledge-center/http-5xx-errors-s3/ to troubleshoot HTTP 500 or 503 error from Amazon S3.

Also have a look at:

https://aws.amazon.com/premiumsupport/knowledge-center/s3-503-within-request-rate-prefix/

If there is a fast spike in the request rate for objects in a prefix, Amazon S3 might return 503 Slow Down errors while it scales in the background to handle the increased request rate. To avoid these errors, you can configure your application to gradually increase the request rate and retry failed requests using an exponential backoff algorithm [1].

[1] https://docs.aws.amazon.com/general/latest/gr/api-retries.html

How to recognize 500 or 503 response as rate-limit

Contenuto pertinente