Athena Query timeout

0

Can the timeout or resources used by Athena to run a query be configured? I have query which spans over a year of data but it times out after 30 mins after having ready about 54GB.

gefragt vor 2 Jahren9921 Aufrufe
2 Antworten
1

The 30-minute DDL query limit is a soft limit, and an increase can be requested in the Service Quotas console.

Also in case it helps I know that people often end up with very long queries because they haven't partitioned their data and limited how many partitions their queries scan. See https://www.linkedin.com/pulse/using-athena-partition-projection-query-cloudtrail-other-kinsman for example.

EXPERTE
beantwortet vor 2 Jahren
AWS
EXPERTE
überprüft vor 2 Jahren
0

Thanks. Appreciate the link on the use of partition projections in Athena. On further analysis, the user was trying to aggregate 37 Billion rows of data on a group of columns that made each rows unique. :-)

beantwortet vor 2 Jahren

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen