Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
My Dags are getting stuck and when I checked the worker logs, I see a connection timeout error with sqs. Is this the reason for Dags not starting? How to resolve this issue? Appreciate your immediate...
1
answers
0
votes
320
views
asked 2 years agolg...
we have created the MWAA env, ECR, SUBNETs, private SGs, VPC - we see NICs attached to the SG
access via UI is given - we can login and open UI via web browser.
on /home access we see an Ooops...
1
answers
0
votes
696
views
asked 2 years agolg...
I'm provisioning a private MWAA and setting a public access through ALB (with ACM and custom domain ), following [this...
2
answers
0
votes
782
views
asked 2 years agolg...
Apart from the Cloudwatch monitor we use tableau to report the ETLs processess stats.
So, is there a way to export the metrics (DAG start time, DAG End time, DAG task start time, endtime, status, last...
1
answers
0
votes
738
views
asked 2 years agolg...
As the title says we're looking to set up a custom url for a public network (not private) MWAA environment. I was able to find the VPC endpoint for the environment and the two private IPs associated...
1
answers
0
votes
2097
views
asked 2 years agolg...
I am attempting to setup an MWAA environment inside of a private subnet and using an internal ALB to allow users to access the VPC endpoint that is tied to the web server IP addresses in the subnets...
2
answers
0
votes
3325
views
asked 2 years agolg...
Hello All,
I am using Airflow 2.2 on MWAA
Attached is my requirements.txt. I am using slack to send a notification but I am getting an error as "ModuleNotFoundError: No module named...
1
answers
0
votes
2202
views
asked 2 years agolg...
I am running a MWAA 2.2.2 instance, and I have correctly put my requirements.txt file in the s3 bucket as instructed by the docs. When the instance spins up, the extra requirements are being installed...
1
answers
0
votes
370
views
asked 2 years agolg...
Dear All, How can we return value from PythonVirtualEnvOperator ?
I am unable to set it in XCOM as task instance context is not available inside PythonVirtualEnvOperator.
1
answers
0
votes
756
views
asked 2 years agolg...
Hello!
We have that error every day, sometimes more often, sometimes less.
The task gets stuck for 15 minutes in the status queue, then it starts to run and we get an error in the logs.
I know that...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
5
answers
2
votes
2341
views
asked 2 years agolg...
The Airflow 2.2.2 webserver on MWAA is not installing the packages in the `requirements.txt`. The packages install just fine on the workers and scheduler; but not the webserver. `pip` fails with a...
5
answers
2
votes
4633
views
asked 2 years agolg...
I am currently struggling to diagnose an issue with MWAA. The behavior we are seeing is that Dags run great after the MWAA is setup or updated, after a the system has been idle for ~10 minutes when a...
1
answers
2
votes
2283
views
asked 2 years agolg...