- Newest
- Most votes
- Most comments
Greetings,
Thank you for reaching out to AWS via this post.
From your post I understand that you are receiving the error below when running a query in Athena:
---------------------------
HIVE_CURSOR_ERROR: com.amazonaws.services.s3.model.AmazonS3Exception: Please reduce your request rate.
---------------------------
Please correct me if I have misunderstood anything.
This error indicates that you are hitting the maximum request rate limit for Amazon Simple Storage Service (Amazon S3). It typically occurs when an S3 bucket prefix has a large number of objects. An Amazon S3 bucket can handle 3,500 PUT/COPY/POST/DELETE or 5,500 GET/HEAD requests per second per prefix in a bucket as explained in resource [1].
Amazon S3 scales automatically to support very high request rates by default, however, if the request threshold is exceeded, you will then receive 5xx errors asking you to slow down or try again later. Please note that this is a combined limit across all users and services across the account.
For potential workarounds with regards to alleviating the error, please refer to resources [2] and [3]. Additionally, I have also attached resource [4] which provides information on partitioning data which is also a technique that assists with this error, as well as the Top 10 Performance Tuning Tips for Amazon Athena in resource [5].
I hope you found the information provided helpful.
Wishing you a great day further!
Resources:
[1] Best practices design patterns: optimizing Amazon S3 performance - https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimizing-performance.html
[2] How do I troubleshoot a HTTP 500 or 503 error from Amazon S3 - https://repost.aws/knowledge-center/http-5xx-errors-s3
[3] Organizing objects using prefixes - https://docs.aws.amazon.com/AmazonS3/latest/userguide/using-prefixes.html
[4] Partitioning data in Athena - https://docs.aws.amazon.com/athena/latest/ug/partitions.html
[5]Top 10 Performance Tuning Tips for Amazon Athena - https://aws.amazon.com/blogs/big-data/top-10-performance-tuning-tips-for-amazon-athena/
Relevant content
- asked 2 years ago
- asked 3 years ago
- AWS OFFICIALUpdated 6 months ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated a year ago