Athena Query timeout

0

Can the timeout or resources used by Athena to run a query be configured? I have query which spans over a year of data but it times out after 30 mins after having ready about 54GB.

demandé il y a 2 ans9919 vues
2 réponses
1

The 30-minute DDL query limit is a soft limit, and an increase can be requested in the Service Quotas console.

Also in case it helps I know that people often end up with very long queries because they haven't partitioned their data and limited how many partitions their queries scan. See https://www.linkedin.com/pulse/using-athena-partition-projection-query-cloudtrail-other-kinsman for example.

EXPERT
répondu il y a 2 ans
AWS
EXPERT
vérifié il y a 2 ans
0

Thanks. Appreciate the link on the use of partition projections in Athena. On further analysis, the user was trying to aggregate 37 Billion rows of data on a group of columns that made each rows unique. :-)

répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions