Error while running athena query : HIVE_CANNOT_OPEN_SPLIT

Question

HIVE_CANNOT_OPEN_SPLIT: Error opening Hive split s3://si-dag-uploads/si-demo/fact_pipeline_workflow_step_instances/dt=2023-08-24/fact_pipeline_workflow_step_instances_0011_part_13.parquet (offset=67108864, length=67108864): com.amazonaws.services.s3.model.AmazonS3Exception: Please reduce your request rate. (Service: Amazon S3; Status Code: 503; Error Code: SlowDown; Request ID: F2D3SC7FWFM0HYD1; S3 Extended Request ID: Vcct1yhjix41QIrLMfpfH34AqG79nOENWCzp9n9hwaZCeTkypr09txYHaPkhFSZ6WN7fkgux/dsAxBb7xrS0fxWE3sbxJPTt+SBnEUyYSnU=; Proxy: null), S3 Extended Request ID: Vcct1yhjix41QIrLMfpfH34AqG79nOENWCzp9n9hwaZCeTkypr09txYHaPkhFSZ6WN7fkgux/dsAxBb7xrS0fxWE3sbxJPTt+SBnEUyYSnU=
This query ran against the "si-demo" database, unless qualified by the query. Please post the error message on our forum  or contact customer support  with Query Id: 4ad35262-b091-418c-ad4b-8769d012a1ca

Answer

I think it is related to throttling issue.

If your queries exceed the limits of dependent services such as Amazon S3, AWS KMS, AWS Glue, or AWS Lambda, the following messages can be expected. To resolve these issues, reduce the number of concurrent calls that originate from the same account.

https://docs.aws.amazon.com/athena/latest/ug/performance-tuning-s3-throttling.html

Answer

AWS sort of had a meltdown (at least in my region) a few days ago, and these kinds of errors were common. Since then, the errors come less frequently, but I'm still seeing them. There are some other queries that used to run reliably that "exhaust resources" every time now. I wonder if Amazon implemented some emergency throttling when the meltdown occurred.

Error while running athena query : HIVE_CANNOT_OPEN_SPLIT

関連するコンテンツ