Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
**Background:**
I am trying to build a system with MWAA to pull data from various databases at different schedules.
Eg:
- workFlow1 pulls data from mysqldb1 every hour
- workFlow2 pulls data from...
1
answers
0
votes
45
views
asked 8 days agolg...
Hi, I'm creating the Pythonvirtualoperator like this:
```
virtualenv_task = PythonVirtualenvOperator(
task_id="virtualenv_python",
dag=dag,
op_args=redshift_con,
...
3
answers
0
votes
382
views
asked a month agolg...
![MWAA Issue](/media/postImages/original/IMhlVGa4RAQTCo4Ri1wNwtLA)
When trying to create an Amazon MWAA environment, it insists I haven't put in valid numbers for max and min worker counts. Can anyone...
1
answers
0
votes
314
views
asked a month agolg...
I'm running a DAG every minute that gets exchange rates from an API, puts them in a CSV and uploads them to an S3 bucket.
However, intermittently I get this error: FileNotFoundError: [Errno 2] No...
1
answers
0
votes
347
views
asked a month agolg...
Hi Team,
All examples that I am seeing are passing application configuration overrides as a dictionary. how to pass this value from a S3 path. This configuration will be pushed from airflow
1
answers
0
votes
384
views
asked a month agolg...
Hi Team,
We are invoking our EMR-S jobs using an airflow EMR job submit operator. The EMR application is configured with a set of spark default run time configurations. while invoking the job from...
2
answers
0
votes
409
views
asked a month agolg...
Hi all,
I'm currently working with MWAA service version 2.8.1(Latest) upgraded from 2.7.2, and encountered an issue while trying to utilize the KubernetesPodOperator class in a Python DAG. I'm facing...
1
answers
0
votes
717
views
asked 2 months agolg...
We are experiencing timeout issue when connecting to Google Sheets, specifically using `googleapiclient`. The code has been working, but after some new deployment, we start getting this error. Even...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
2
answers
0
votes
706
views
asked 2 months agolg...
Can anyone give some advice on writing and ou publishing a ebook on the KDP with Amazon? Thanks in advanced!!
1
answers
0
votes
679
views
asked 2 months agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
799
views
asked 3 months agolg...
I have one question about IP address to provisions depend on the type of (small, medium and large) and quantity of workers , i tried to find something relevant about it in some documentation but i...
2
answers
0
votes
723
views
asked 3 months agolg...
See title. I am wondering what the exact impact is, because the state lasts for a very long time, typically 20-30 minutes in my experience. For example, I'm wondering if dags scheduled to run in that...
2
answers
0
votes
696
views
asked 3 months agolg...