Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I get the following error when Airflow tries to import my DAG file on MWAA:
```
Broken DAG: [/usr/local/airflow/dags/file.py] Traceback (most recent call last):
File...
1
answers
0
votes
316
views
asked 6 months agolg...
Hello Community,
I am trying to move our airflow from single Node EC2 instance. But I can't find any documentation on how to
- Install a ODBC driver used by our application in MWAA or supply a...
1
answers
0
votes
305
views
asked 6 months agolg...
We are experimenting a significant increase in CloudWatch metrics costs since deploying Amazon MWAA. We noticed that AWS MWAA utilizes CloudWatch as the default metrics destination via Statsd.
We...
1
answers
0
votes
350
views
asked 6 months agolg...
I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa.
I understand the hourly cost is started once the Environment is established (not per DAG execution)
My...
1
answers
0
votes
234
views
asked 7 months agolg...
After switching the alternate secrets backend to the Parameter store I was able to retrieve connections/variables from the SSM Parameter store, but the only issue was the task logs page in the Airflow...
0
answers
0
votes
76
views
asked 7 months agolg...
We recently updated our Airflow environment to version 2.6.3. \
After few days we wanted to update the plugins without changing the requirements, but started getting an error \
`WARNING:...
1
answers
1
votes
225
views
asked 7 months agolg...
MWAA / Dag / Sizelg...
We are reaching the maximum number of jobs for our MWAA and we are using the Small instance - which is listed on this page (https://aws.amazon.com/managed-workflows-for-apache-airflow/pricing/) as...
1
answers
0
votes
426
views
asked 7 months agolg...
Hi, recently at my company, we started using MWAA and we noticed our CloudWatch bill is spiking a lot. I found that this might be due to metrics pushed from MWAA and I want to stop all the metrics...
3
answers
0
votes
611
views
asked 8 months agolg...
"I have multiple Python scripts stored within a Docker image, each with its set of input parameters. My goal is to execute these scripts on Amazon Elastic Container Service (ECS) as required. Inside...
1
answers
0
votes
380
views
asked 8 months agolg...
Hi,
After upgrading Airflow version in MWAA to 2.6.3, every call to Airflow CLI returns following sterror message:
"
/usr/local/airflow/.local/lib/python3.10/site-packages/airflow/stats.py:604...
0
answers
0
votes
70
views
asked 8 months agolg...
Is any other secrets backend besides AWS Secrets manager supported in MWAA? I would like to use Hashicorp Vault, and the Airflow provider loads fine, but when i try to set secrets.backend_kwargs it...
2
answers
2
votes
433
views
asked 9 months agolg...
Hi,
We are using MWAA with 2.6.3 version of Airflow, mw1.small, 2 schedulers, 1-12 workers.
Every now and then, maybe once a month, in a DAG with multiple tasks, there is something strange happening...
0
answers
0
votes
77
views
asked 9 months agolg...