Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I'm searching for a good way to automate migrating a DAG between multiple instances (staging/production) as part of a DevOps workflow. I would like to be able to run my DAGs in my staging environment...
1
answers
0
votes
760
views
asked a year agolg...
Hi,
from airflow.providers.amazon.aws.operators.s3_bucket import S3CreateBucketOperator, S3DeleteBucketOperator fails with
```
ModuleNotFoundError: No module named...
2
answers
0
votes
397
views
asked a year agolg...
MWAA gone missinglg...
All of our MWAA dags have gone missing. They were there a few hours ago and now there are no dags available. We are using Dagfactory for a few months now and it has been working fine. The web...
1
answers
0
votes
636
views
asked a year agolg...
Created a MWAA service in a VPC and our db is in a different VPC. The peering does not seem to worklg...
I have updated the default routes in both the VPC to include the intenet gaetway. I have also updated the security group to allpw traffic from the other VPC. Despite all this I cannot establish a...
1
answers
0
votes
470
views
asked a year agolg...
THe MWAA environment has not been updated and the CW metrics stop last week. Is there a way to debug this issue?
1
answers
0
votes
430
views
asked a year agolg...
We have a small environment (~30 DAGs) running Airflow 2.2.2 with Secrets Manager as our secrets backend. We noticed once we switched to Secrets Manager that MWAA was retrieving the aws_default...
2
answers
1
votes
932
views
asked a year agolg...
It seems like it is possible in Apache Airflow to override loggers to use specific json logging.
I've been noticing it is very difficult to trace logs in cloud watch for airflow since they are poorly...
1
answers
0
votes
718
views
asked a year agolg...
I'm trying to upgrade my Airflow MWAA Cluster to 2.4.3, but there's a crucial dependency for MySQL access that can't be installed due to missing OS dependencies.
Here is my...
1
answers
0
votes
925
views
asked a year agolg...
hello, i am trying to install the apache-airflow-providers-sftp==4.1.0 package on our MWAA 2.4.3 with private network access. I download the wheels for all the packages in my requirements.txt file and...
1
answers
0
votes
589
views
asked a year agolg...
I tried installing various versions of aiohttp module on airflow using the requirements.txt but nothing worked. The error I'm receiving while trying to import the DAG is " ModuleNotFoundError: No...
1
answers
0
votes
368
views
asked a year agolg...
**Description**
While trying to register a custom XCom backend in MWAA v2.2.2 I'm getting an `INCORRECT_CONFIGURATION` on the cluster console UI.
**Steps to reproduce**
* In my MWAA local...
2
answers
0
votes
520
views
asked a year agolg...
We have a 2.0.2 MWAA cluster running in us-east-1. We recently tried to implement dynamic DAG generation instead of Jinja templating our DAG files. In order to do we are reading from `os.environ` and...
1
answers
0
votes
312
views
asked a year agolg...