Cost of MWAA part 2 - Storage cost

0

I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa. I understand the hourly cost is started once the Environment is established (not per DAG execution) My question is for monthly storage cost - since the local storage (10GB max) is only alive during the life cycle of the worker executing the solid, so I assume worker usage of these 10GB of storage does NOT count toward the monthly storage charge? My 2nd question on storage is - unless we remove previous Airflow DAG execution information in the MWAA environment otherwise this WILL count toward the monthly storage charges, is that correct? Thanks!

1개 답변
0

Hi!

The monthly storage charge is for the meta database, not the ephemeral storage on the workers. The meta database contains DAG run information, task information, Xcom data, among others. This data continues to grow unless you periodically remove the data. You can accomplish this by creating a DAG to remove older data from the tables. We offer a sample DAG[1] which you can use.

Hope this helps! -Mike

[1] https://docs.aws.amazon.com/mwaa/latest/userguide/samples-database-cleanup.html#samples-database-cleanup-code

AWS
Mike_E
답변함 7달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠