What's the max rate limit of s3 bucket access?

0

5500 requests per sec seems not working any more. I'm writing a script for finding misconfigured s3 instance. Like this: r = requests.get(f"http://{bucketname}.s3.amazonaws.com") When my script reached 100k requests in 1 hour, all response code received turned into 404. What should I do with my code?

質問済み 9ヶ月前7345ビュー
2回答
0

I'd suggest you to go through this re:Post Knowledge Center Article

Same topic is discussed in this re:Post answer, where it's discussed that If there is a fast spike in the request rate for objects in a prefix, Amazon S3 might return 503 Slow Down errors while it scales in the background to handle the increased request rate. To avoid these errors, you can configure your application to gradually increase the request rate and retry failed requests using an exponential backoff algorithm.

Additionally take a look at Optimizing S3 Performance

Hope this helps.

Abhishek

profile pictureAWS
エキスパート
回答済み 9ヶ月前
  • I didn't encounter 503, it's just 404 instead of 403 (if bucket exists)

-1

Hello, Amazon S3 has a limit of 5500 requests per second per prefix. Besides, there is a service quota limit per account. When you exceed the service quota, S3 got throttled. You can request a service quota increase. For further information you may visit the AWS documentation [https://docs.aws.amazon.com/general/latest/gr/s3.html#limits_s3].

AWS
回答済み 9ヶ月前
  • I scan s3 as anonymous user, so there is no quota increase for me. And 5500 is not in my case.

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ