Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
What are the key points to choose one of the following:
* Data pipeline,
* Step function
* Amazon Managed Workflows for Apache Airflow
1
answers
0
votes
2576
views
Push logs to S3lg...
How can I push Airflow task logs to S3?
I tried adding the following configuration parameters to "Airflow configuration options",
logging.base_log_folder: /usr/local/airflow/logs ...
3
answers
0
votes
1006
views
asked 3 years agolg...
I've set up a PRIVATE_ONLY mwaa instance and created an ALB, which points to private addresses of the VPC endpoint based on this guide: ...
1
answers
1
votes
1359
views
asked 3 years agolg...
Hi,
We use custom packages as dependencies of some of our PythonOperators. Therefore, when we update these packages, we'd like to reflect this update when used by a PythonOperator in MWAA.
...
2
answers
0
votes
5839
views
asked 3 years agolg...
Hi!
I'm trying to install some forks through the requirements.txt file but it's not working. Looking at the logs I'm seeing "git not found", or something similar.
Tried to run "(IFS=:; for p...
1
answers
0
votes
548
views
asked 3 years agolg...
Hello everyone,
we've launched a private MWAA environment. We are able to access the UI, but we're having some trouble installing our python requirements. MWAA picks up the requirements file from...
1
answers
1
votes
1796
views
asked 3 years agolg...
When using the default setup for MWAA, it seems that the stack which is created has duplicate Logical ID's, and i suspect this duplication is why much of the stack hangs during creation. For...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
2
answers
1
votes
2897
views
asked 3 years agolg...
I'm facing an issue with the Airflow Web UI in the Managed Airflow environment. I uploaded a DAG file in the Airflow designated bucket in S3. It had few import errors. I fixed them and re-uploaded the...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
1
answers
0
votes
3510
views
asked 3 years agolg...
Hello,
we were testing the new Airflow 2.0 implementation but the new v2.0.2 version fails during the database initialisation (webserver logs see below). Do we need to update some other settings...
2
answers
0
votes
1907
views
asked 3 years agolg...
Hi,
when trying to install private python package as a dependency via requirements.txt, it looks like usual mwaa environment variables are not accessible in the requirements.txt.
My...
1
answers
0
votes
1002
views
asked 3 years agolg...
I need to run a Python script using BashOperator. I placed the script in dags folder of the S3 bucket and ran my DAG with BashOperator. It's throwing the error: **python3: can't open file...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
1
answers
0
votes
2298
views
asked 3 years agolg...
Hi
I am really trying hard to get this one.
I have my S3 bucket for dags and secrets manager secrets for variables in account A and my MWAA environment in account B. I have given all the...
2
answers
0
votes
1218
views
asked 3 years agolg...