Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I previously created an airflow environment in sa-east-1 and now I want to create an airflow environment in us-east-1
But when I try to create an airflow environment I see the message:
The limit of 0...
2
answers
0
votes
161
views
asked 7 days agolg...
**Background:**
I am trying to build a system with MWAA to pull data from various databases at different schedules.
Eg:
- workFlow1 pulls data from mysqldb1 every hour
- workFlow2 pulls data from...
1
answers
0
votes
61
views
asked a month agolg...
Hi, I'm creating the Pythonvirtualoperator like this:
```
virtualenv_task = PythonVirtualenvOperator(
task_id="virtualenv_python",
dag=dag,
op_args=redshift_con,
...
3
answers
0
votes
400
views
asked 2 months agolg...
![MWAA Issue](/media/postImages/original/IMhlVGa4RAQTCo4Ri1wNwtLA)
When trying to create an Amazon MWAA environment, it insists I haven't put in valid numbers for max and min worker counts. Can anyone...
1
answers
0
votes
336
views
asked 2 months agolg...
I'm running a DAG every minute that gets exchange rates from an API, puts them in a CSV and uploads them to an S3 bucket.
However, intermittently I get this error: FileNotFoundError: [Errno 2] No...
1
answers
0
votes
360
views
asked 2 months agolg...
Hi Team,
All examples that I am seeing are passing application configuration overrides as a dictionary. how to pass this value from a S3 path. This configuration will be pushed from airflow
1
answers
0
votes
402
views
asked 2 months agolg...
Hi Team,
We are invoking our EMR-S jobs using an airflow EMR job submit operator. The EMR application is configured with a set of spark default run time configurations. while invoking the job from...
2
answers
0
votes
430
views
asked 2 months agolg...
Hi all,
I'm currently working with MWAA service version 2.8.1(Latest) upgraded from 2.7.2, and encountered an issue while trying to utilize the KubernetesPodOperator class in a Python DAG. I'm facing...
1
answers
0
votes
755
views
asked 2 months agolg...
We are experiencing timeout issue when connecting to Google Sheets, specifically using `googleapiclient`. The code has been working, but after some new deployment, we start getting this error. Even...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
2
answers
0
votes
728
views
asked 2 months agolg...
Can anyone give some advice on writing and ou publishing a ebook on the KDP with Amazon? Thanks in advanced!!
1
answers
0
votes
693
views
asked 3 months agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
823
views
asked 3 months agolg...
I have one question about IP address to provisions depend on the type of (small, medium and large) and quantity of workers , i tried to find something relevant about it in some documentation but i...
2
answers
0
votes
740
views
asked 4 months agolg...