Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Good day,
I am trying to build a no/zero code architecture, i was planning to use MWAA for orchestration but i was tasked to look at alternatives keeping it simple
I was hoping Redshift query...
2
answers
0
votes
407
views
asked 3 months agolg...
Hey,
My company is moving away from Java Corretto and replacing it with OpenJDK. We are suspicious that one of the services, MWAA, uses Corretto because we found it being installed in this...
1
answers
0
votes
431
views
asked 3 months agolg...
Currently I am running my MWAA on small instance with:
`celery.worker_autoscale = 5,5`
And sometimes my tasks get SIGKILL, I assume it's because tasks are taking too many memory.
In this article :...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
1
answers
0
votes
517
views
asked 4 months agolg...
Hi, I'm trying to connect airflow to Redshift Serverless. I have RedshiftFullAccess, and I'm trying to copy files from S3 to Redshift using S3ToRedshiftOperator, I got Cluster not found error. I'm...
2
answers
0
votes
661
views
asked 4 months agolg...
MWAA web login tokenlg...
I have setup MWAA v2.7.2 in PRIVATE access mode in my already existing VPC and I allow access to the UI through VPN. I follow the MWAA documentation and I am able to produce a CLI token and then hit...
1
answers
0
votes
487
views
asked 4 months agolg...
Hi, we are in the process of moving from EMR to EMR serveless. Currently we are converting our Airflow DAGS from EMR to EMR serverless format.
We are having trouble getting one of our steps to work...
1
answers
0
votes
218
views
asked 4 months agolg...
1. I have created Private MWAA environment
2. Create EC2 bastion for port forwaring
3. Running ssh tunnel from my localhost and trying to open UI
4. I can see Airflow UI requesting SSO login.
5. I...
1
answers
0
votes
148
views
asked 4 months agolg...
When DAG executes the followin import`from simple_salesforce import Salesforce` an import error occurs:
```
Broken DAG: [/usr/local/airflow/dags/example_dag_with_taskflow_api.py] Traceback (most...
0
answers
0
votes
65
views
asked 4 months agolg...
Hi team,
I'm curious to know if anyone knows the approximate amount of time it takes for MWAA to request extra workers from Fargate and how long it takes for the fargate worker to be ready to start...
2
answers
0
votes
313
views
asked 5 months agolg...
Hey, I have been trying to set up a connection between Airflow and redshift using redshift_default connection but I have been unable to do so. I am attempting to use the S3 to Redshift Operator to...
1
answers
0
votes
301
views
asked 5 months agolg...
In Airflow, we have a series of tasks. But to simplify let us consider there are 2 tasks. The first task lists files from an S3 bucket and the second task picks those files to...
0
answers
0
votes
71
views
asked 5 months agolg...
i'm trying to execute my dag file to upload S3 bucket
but, cant see the task on Airflow UI
when i checked the same issue in google search and referenced the...
0
answers
0
votes
121
views
asked 6 months agolg...