Athena Query timeout

0

Can the timeout or resources used by Athena to run a query be configured? I have query which spans over a year of data but it times out after 30 mins after having ready about 54GB.

preguntada hace 2 años9914 visualizaciones
2 Respuestas
1

The 30-minute DDL query limit is a soft limit, and an increase can be requested in the Service Quotas console.

Also in case it helps I know that people often end up with very long queries because they haven't partitioned their data and limited how many partitions their queries scan. See https://www.linkedin.com/pulse/using-athena-partition-projection-query-cloudtrail-other-kinsman for example.

EXPERTO
respondido hace 2 años
AWS
EXPERTO
revisado hace 2 años
0

Thanks. Appreciate the link on the use of partition projections in Athena. On further analysis, the user was trying to aggregate 37 Billion rows of data on a group of columns that made each rows unique. :-)

respondido hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas