Athena S3 Query failing on SlowDown Error

0

Hi there,

I am attempting to follow this tutorial: https://commoncrawl.org/2018/03/index-to-warc-files-and-urls-in-columnar-format/

However when I run the Athena query against the S3 content, I receive the following SlowDown error:

Error opening Hive split s3://commoncrawl/cc-index/table/cc-main/warc/crawl=CC-MAIN-2018-05/subset=warc/part-00223-248eba37-08f7-4a53-a4b4-d990640e4be4.c000.gz.parquet (offset=0, length=67108864): com.amazonaws.services.s3.model.AmazonS3Exception: Please reduce your request rate. (Service: Amazon S3; Status Code: 503; Error Code: SlowDown; Request ID: QQ7HDYXF8HS44HRR; S3 Extended Request ID: yp+/JdDECD+pTbEIv3CrIcgVMgO8RZZgGN+u7Zf6v0gtACf/C3x7ANUDUq2I03gFcnhdBzlNnOs=; Proxy: null), S3 Extended Request ID: yp+/JdDECD+pTbEIv3CrIcgVMgO8RZZgGN+u7Zf6v0gtACf/C3x7ANUDUq2I03gFcnhdBzlNnOs=
This query ran against the "ccindex" database, unless qualified by the query. Please post the error message on our forum  or contact customer support  with Query Id: 3bd4d647-091b-42c0-b60e-f689e7aa0f49

Should the Athena Query Editor automatically handle such errors, and implement exponential backoffs so that I can successfully run the query?

1개 답변
0
AWS
Theo
답변함 2년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인