Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
While deploying MWAA in AWS ASIA PACIFIC(SEOUL) REGION, the following error occurred.
The limit of 0 environments has been reached.
I never deployed MWAA in that region, so why am I getting this...
2
answers
0
votes
41
views
asked 5 days agolg...
I previously created an airflow environment in sa-east-1 and now I want to create an airflow environment in us-east-1
But when I try to create an airflow environment I see the message:
The limit of 0...
2
answers
0
votes
204
views
asked 12 days agolg...
**Background:**
I am trying to build a system with MWAA to pull data from various databases at different schedules.
Eg:
- workFlow1 pulls data from mysqldb1 every hour
- workFlow2 pulls data from...
2
answers
0
votes
65
views
asked a month agolg...
Hi, I'm creating the Pythonvirtualoperator like this:
```
virtualenv_task = PythonVirtualenvOperator(
task_id="virtualenv_python",
dag=dag,
op_args=redshift_con,
...
3
answers
0
votes
403
views
asked 2 months agolg...
![MWAA Issue](/media/postImages/original/IMhlVGa4RAQTCo4Ri1wNwtLA)
When trying to create an Amazon MWAA environment, it insists I haven't put in valid numbers for max and min worker counts. Can anyone...
1
answers
0
votes
339
views
asked 2 months agolg...
I'm running a DAG every minute that gets exchange rates from an API, puts them in a CSV and uploads them to an S3 bucket.
However, intermittently I get this error: FileNotFoundError: [Errno 2] No...
1
answers
0
votes
362
views
asked 2 months agolg...
Hi Team,
All examples that I am seeing are passing application configuration overrides as a dictionary. how to pass this value from a S3 path. This configuration will be pushed from airflow
1
answers
0
votes
405
views
asked 2 months agolg...
Hi Team,
We are invoking our EMR-S jobs using an airflow EMR job submit operator. The EMR application is configured with a set of spark default run time configurations. while invoking the job from...
2
answers
0
votes
436
views
asked 2 months agolg...
Hi all,
I'm currently working with MWAA service version 2.8.1(Latest) upgraded from 2.7.2, and encountered an issue while trying to utilize the KubernetesPodOperator class in a Python DAG. I'm facing...
1
answers
0
votes
773
views
asked 2 months agolg...
We are experiencing timeout issue when connecting to Google Sheets, specifically using `googleapiclient`. The code has been working, but after some new deployment, we start getting this error. Even...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
2
answers
0
votes
732
views
asked 3 months agolg...
Can anyone give some advice on writing and ou publishing a ebook on the KDP with Amazon? Thanks in advanced!!
1
answers
0
votes
695
views
asked 3 months agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
829
views
asked 3 months agolg...