Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hey, I have been trying to set up a connection between Airflow and redshift using redshift_default connection but I have been unable to do so. I am attempting to use the S3 to Redshift Operator to...
1
answers
0
votes
348
views
asked 6 months agolg...
In Airflow, we have a series of tasks. But to simplify let us consider there are 2 tasks. The first task lists files from an S3 bucket and the second task picks those files to...
1
answers
0
votes
92
views
asked 6 months agolg...
i'm trying to execute my dag file to upload S3 bucket
but, cant see the task on Airflow UI
when i checked the same issue in google search and referenced the...
1
answers
0
votes
142
views
asked 7 months agolg...
I get the following error when Airflow tries to import my DAG file on MWAA:
```
Broken DAG: [/usr/local/airflow/dags/file.py] Traceback (most recent call last):
File...
1
answers
0
votes
387
views
asked 7 months agolg...
Hello Community,
I am trying to move our airflow from single Node EC2 instance. But I can't find any documentation on how to
- Install a ODBC driver used by our application in MWAA or supply a...
1
answers
0
votes
365
views
asked 7 months agolg...
We are experimenting a significant increase in CloudWatch metrics costs since deploying Amazon MWAA. We noticed that AWS MWAA utilizes CloudWatch as the default metrics destination via Statsd.
We...
1
answers
0
votes
419
views
asked 7 months agolg...
I want to follow up on https://repost.aws/questions/QUmuAqDG_yT2KCtu7G1zsukQ/cost-of-aws-mwaa.
I understand the hourly cost is started once the Environment is established (not per DAG execution)
My...
1
answers
0
votes
259
views
asked 8 months agolg...
After switching the alternate secrets backend to the Parameter store I was able to retrieve connections/variables from the SSM Parameter store, but the only issue was the task logs page in the Airflow...
1
answers
0
votes
95
views
asked 8 months agolg...
We recently updated our Airflow environment to version 2.6.3. \
After few days we wanted to update the plugins without changing the requirements, but started getting an error \
`WARNING:...
1
answers
1
votes
282
views
asked 8 months agolg...
MWAA / Dag / Sizelg...
We are reaching the maximum number of jobs for our MWAA and we are using the Small instance - which is listed on this page (https://aws.amazon.com/managed-workflows-for-apache-airflow/pricing/) as...
1
answers
0
votes
543
views
asked 9 months agolg...
Hi, recently at my company, we started using MWAA and we noticed our CloudWatch bill is spiking a lot. I found that this might be due to metrics pushed from MWAA and I want to stop all the metrics...
3
answers
0
votes
704
views
asked 9 months agolg...
"I have multiple Python scripts stored within a Docker image, each with its set of input parameters. My goal is to execute these scripts on Amazon Elastic Container Service (ECS) as required. Inside...
1
answers
0
votes
417
views
asked 9 months agolg...