Athena S3 Query failing on SlowDown Error

0

Hi there,

I am attempting to follow this tutorial: https://commoncrawl.org/2018/03/index-to-warc-files-and-urls-in-columnar-format/

However when I run the Athena query against the S3 content, I receive the following SlowDown error:

Error opening Hive split s3://commoncrawl/cc-index/table/cc-main/warc/crawl=CC-MAIN-2018-05/subset=warc/part-00223-248eba37-08f7-4a53-a4b4-d990640e4be4.c000.gz.parquet (offset=0, length=67108864): com.amazonaws.services.s3.model.AmazonS3Exception: Please reduce your request rate. (Service: Amazon S3; Status Code: 503; Error Code: SlowDown; Request ID: QQ7HDYXF8HS44HRR; S3 Extended Request ID: yp+/JdDECD+pTbEIv3CrIcgVMgO8RZZgGN+u7Zf6v0gtACf/C3x7ANUDUq2I03gFcnhdBzlNnOs=; Proxy: null), S3 Extended Request ID: yp+/JdDECD+pTbEIv3CrIcgVMgO8RZZgGN+u7Zf6v0gtACf/C3x7ANUDUq2I03gFcnhdBzlNnOs=
This query ran against the "ccindex" database, unless qualified by the query. Please post the error message on our forum  or contact customer support  with Query Id: 3bd4d647-091b-42c0-b60e-f689e7aa0f49

Should the Athena Query Editor automatically handle such errors, and implement exponential backoffs so that I can successfully run the query?

mattyf
asked 2 years ago4405 views
1 Answer
0
AWS
Theo
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions