Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

AWS Athena Query is Failing Randomly

0

Hi,

My Athena Query to transform the data is failing randomly with the error:

Exception: Final state of Athena job is FAILED, query_execution_id is 97b49928-68f8-44e0-af7e-1fc7ec7cefcb. Error: [ErrorCode: INTERNAL_ERROR_QUERY_ENGINE] Amazon Athena experienced an internal error while executing this query. Please contact AWS support for further assistance. You will not be charged for this query. We apologize for the inconvenience. You may need to manually clean the data at location 's3://<bucket_name>/airflow_query_output/tables/97b49928-68f8-44e0-af7e-1fc7ec7cefcb' before retrying. Athena will not delete data in your account.

When I rerun this query, it gets succeeded in the second or third attempt. Since we have hourly pipelines scheduled in MWAA, this is breaking our production data platform.

We had the same issue last month also, but it got resolved automatically after 3 days and its happening again. Can any one provide any resolution for this.

Topics
AnalyticsApplication Integration
Tags
Amazon Managed Workflows for Apache Airflow (MWAA)AnalyticsAmazon Athena
Language
English

asked 2 years ago399 views

1 Answer
0

Hi,

Such intermittent issues as the one you experience may be caused by improperly escaped Athena-reserved words in your queries.

See https://docs.aws.amazon.com/athena/latest/ug/reserved-words.html for reserved words and how to escape them properly in case you use some.

Quite a few of those reserved words are frequent names for columns in user data

Best,

Didier

EXPERT

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content