Athena S3 Query failing on SlowDown Error

0

Hi there,

I am attempting to follow this tutorial: https://commoncrawl.org/2018/03/index-to-warc-files-and-urls-in-columnar-format/

However when I run the Athena query against the S3 content, I receive the following SlowDown error:

Error opening Hive split s3://commoncrawl/cc-index/table/cc-main/warc/crawl=CC-MAIN-2018-05/subset=warc/part-00223-248eba37-08f7-4a53-a4b4-d990640e4be4.c000.gz.parquet (offset=0, length=67108864): com.amazonaws.services.s3.model.AmazonS3Exception: Please reduce your request rate. (Service: Amazon S3; Status Code: 503; Error Code: SlowDown; Request ID: QQ7HDYXF8HS44HRR; S3 Extended Request ID: yp+/JdDECD+pTbEIv3CrIcgVMgO8RZZgGN+u7Zf6v0gtACf/C3x7ANUDUq2I03gFcnhdBzlNnOs=; Proxy: null), S3 Extended Request ID: yp+/JdDECD+pTbEIv3CrIcgVMgO8RZZgGN+u7Zf6v0gtACf/C3x7ANUDUq2I03gFcnhdBzlNnOs=
This query ran against the "ccindex" database, unless qualified by the query. Please post the error message on our forum  or contact customer support  with Query Id: 3bd4d647-091b-42c0-b60e-f689e7aa0f49

Should the Athena Query Editor automatically handle such errors, and implement exponential backoffs so that I can successfully run the query?

  • which query are you running?

mattyf
gefragt vor 2 Jahren4453 Aufrufe
1 Antwort
0
AWS
Theo
beantwortet vor 2 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen