Cost of MWAA part 2 - Storage cost

0

I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa. I understand the hourly cost is started once the Environment is established (not per DAG execution) My question is for monthly storage cost - since the local storage (10GB max) is only alive during the life cycle of the worker executing the solid, so I assume worker usage of these 10GB of storage does NOT count toward the monthly storage charge? My 2nd question on storage is - unless we remove previous Airflow DAG execution information in the MWAA environment otherwise this WILL count toward the monthly storage charges, is that correct? Thanks!

1 Antwort
0

Hi!

The monthly storage charge is for the meta database, not the ephemeral storage on the workers. The meta database contains DAG run information, task information, Xcom data, among others. This data continues to grow unless you periodically remove the data. You can accomplish this by creating a DAG to remove older data from the tables. We offer a sample DAG[1] which you can use.

Hope this helps! -Mike

[1] https://docs.aws.amazon.com/mwaa/latest/userguide/samples-database-cleanup.html#samples-database-cleanup-code

AWS
Mike_E
beantwortet vor 7 Monaten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen