Athena Query timeout

0

Can the timeout or resources used by Athena to run a query be configured? I have query which spans over a year of data but it times out after 30 mins after having ready about 54GB.

feita há 2 anos9914 visualizações
2 Respostas
1

The 30-minute DDL query limit is a soft limit, and an increase can be requested in the Service Quotas console.

Also in case it helps I know that people often end up with very long queries because they haven't partitioned their data and limited how many partitions their queries scan. See https://www.linkedin.com/pulse/using-athena-partition-projection-query-cloudtrail-other-kinsman for example.

ESPECIALISTA
respondido há 2 anos
AWS
ESPECIALISTA
avaliado há 2 anos
0

Thanks. Appreciate the link on the use of partition projections in Athena. On further analysis, the user was trying to aggregate 37 Billion rows of data on a group of columns that made each rows unique. :-)

respondido há 2 anos

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas