Cost of MWAA part 2 - Storage cost

0

I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa. I understand the hourly cost is started once the Environment is established (not per DAG execution) My question is for monthly storage cost - since the local storage (10GB max) is only alive during the life cycle of the worker executing the solid, so I assume worker usage of these 10GB of storage does NOT count toward the monthly storage charge? My 2nd question on storage is - unless we remove previous Airflow DAG execution information in the MWAA environment otherwise this WILL count toward the monthly storage charges, is that correct? Thanks!

1 réponse
0

Hi!

The monthly storage charge is for the meta database, not the ephemeral storage on the workers. The meta database contains DAG run information, task information, Xcom data, among others. This data continues to grow unless you periodically remove the data. You can accomplish this by creating a DAG to remove older data from the tables. We offer a sample DAG[1] which you can use.

Hope this helps! -Mike

[1] https://docs.aws.amazon.com/mwaa/latest/userguide/samples-database-cleanup.html#samples-database-cleanup-code

AWS
Mike_E
répondu il y a 7 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions