Cost of MWAA part 2 - Storage cost

0

I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa. I understand the hourly cost is started once the Environment is established (not per DAG execution) My question is for monthly storage cost - since the local storage (10GB max) is only alive during the life cycle of the worker executing the solid, so I assume worker usage of these 10GB of storage does NOT count toward the monthly storage charge? My 2nd question on storage is - unless we remove previous Airflow DAG execution information in the MWAA environment otherwise this WILL count toward the monthly storage charges, is that correct? Thanks!

1 Answer
0

Hi!

The monthly storage charge is for the meta database, not the ephemeral storage on the workers. The meta database contains DAG run information, task information, Xcom data, among others. This data continues to grow unless you periodically remove the data. You can accomplish this by creating a DAG to remove older data from the tables. We offer a sample DAG[1] which you can use.

Hope this helps! -Mike

[1] https://docs.aws.amazon.com/mwaa/latest/userguide/samples-database-cleanup.html#samples-database-cleanup-code

AWS
Mike_E
answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions