En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post

What is causing the excessive number of requests to s3?

0

I searched in athena and uploaded the searched content to s3.

I used the select statement about 10 times and uploaded a small query log to s3.

However, looking at the charges charged, there were hundreds of thousands of requests.

It is unknown what caused this number of requests.

Why is there such a large number of requests?

Sujets
StockageAnalytique
Balises
Simple service de stockage AmazonAmazon Athena
Langue
English
joker
demandé il y a 2 ans618 vues
2 réponses
1
Réponse acceptée

Without proper partitioning, Athena will scan large data sets and therefore it could end up costing a lot. It is very important to partition the data correctly - https://docs.aws.amazon.com/athena/latest/ug/partitions.html

profile pictureAWS
EXPERT
Indranil Banerjee AWS
répondu il y a 2 ans
0

Yep Indranil is right about the partitioning. For a tutorial and tips about this, also see https://www.linkedin.com/pulse/using-athena-partition-projection-query-cloudtrail-other-kinsman/. It uses AWS logs as examples but the information is generic.

EXPERT
skinsman
répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions

Contenus pertinents