Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
**Background:**
I am trying to build a system with MWAA to pull data from various databases at different schedules.
Eg:
- workFlow1 pulls data from mysqldb1 every hour
- workFlow2 pulls data from...
1
answers
0
votes
39
views
asked 4 days agolg...
Hi, I'm creating the Pythonvirtualoperator like this:
```
virtualenv_task = PythonVirtualenvOperator(
task_id="virtualenv_python",
dag=dag,
op_args=redshift_con,
...
3
answers
0
votes
373
views
asked 23 days agolg...
![MWAA Issue](/media/postImages/original/IMhlVGa4RAQTCo4Ri1wNwtLA)
When trying to create an Amazon MWAA environment, it insists I haven't put in valid numbers for max and min worker counts. Can anyone...
1
answers
0
votes
308
views
asked 23 days agolg...
I'm running a DAG every minute that gets exchange rates from an API, puts them in a CSV and uploads them to an S3 bucket.
However, intermittently I get this error: FileNotFoundError: [Errno 2] No...
1
answers
0
votes
342
views
asked 25 days agolg...
Hi Team,
All examples that I am seeing are passing application configuration overrides as a dictionary. how to pass this value from a S3 path. This configuration will be pushed from airflow
1
answers
0
votes
378
views
asked a month agolg...
Hi Team,
We are invoking our EMR-S jobs using an airflow EMR job submit operator. The EMR application is configured with a set of spark default run time configurations. while invoking the job from...
2
answers
0
votes
401
views
asked a month agolg...
Hi all,
I'm currently working with MWAA service version 2.8.1(Latest) upgraded from 2.7.2, and encountered an issue while trying to utilize the KubernetesPodOperator class in a Python DAG. I'm facing...
1
answers
0
votes
712
views
asked 2 months agolg...
We are experiencing timeout issue when connecting to Google Sheets, specifically using `googleapiclient`. The code has been working, but after some new deployment, we start getting this error. Even...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
2
answers
0
votes
700
views
asked 2 months agolg...
Can anyone give some advice on writing and ou publishing a ebook on the KDP with Amazon? Thanks in advanced!!
1
answers
0
votes
672
views
asked 2 months agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
792
views
asked 2 months agolg...
I have one question about IP address to provisions depend on the type of (small, medium and large) and quantity of workers , i tried to find something relevant about it in some documentation but i...
2
answers
0
votes
717
views
asked 3 months agolg...
See title. I am wondering what the exact impact is, because the state lasts for a very long time, typically 20-30 minutes in my experience. For example, I'm wondering if dags scheduled to run in that...
2
answers
0
votes
690
views
asked 3 months agolg...