Athena Query timeout

0

Can the timeout or resources used by Athena to run a query be configured? I have query which spans over a year of data but it times out after 30 mins after having ready about 54GB.

asked 2 years ago9712 views
2 Answers
1

The 30-minute DDL query limit is a soft limit, and an increase can be requested in the Service Quotas console.

Also in case it helps I know that people often end up with very long queries because they haven't partitioned their data and limited how many partitions their queries scan. See https://www.linkedin.com/pulse/using-athena-partition-projection-query-cloudtrail-other-kinsman for example.

EXPERT
answered 2 years ago
AWS
EXPERT
reviewed 2 years ago
0

Thanks. Appreciate the link on the use of partition projections in Athena. On further analysis, the user was trying to aggregate 37 Billion rows of data on a group of columns that made each rows unique. :-)

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions