Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Team,
All examples that I am seeing are passing application configuration overrides as a dictionary. how to pass this value from a S3 path. This configuration will be pushed from airflow
1
answers
0
votes
43
views
asked 3 days agolg...
Hi Team,
We are invoking our EMR-S jobs using an airflow EMR job submit operator. The EMR application is configured with a set of spark default run time configurations. while invoking the job from...
2
answers
0
votes
64
views
asked 7 days agolg...
Hi all,
I'm currently working with MWAA service version 2.8.1(Latest) upgraded from 2.7.2, and encountered an issue while trying to utilize the KubernetesPodOperator class in a Python DAG. I'm facing...
1
answers
0
votes
379
views
asked 17 days agolg...
We are experiencing timeout issue when connecting to Google Sheets, specifically using `googleapiclient`. The code has been working, but after some new deployment, we start getting this error. Even...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
2
answers
0
votes
391
views
asked 21 days agolg...
Can anyone give some advice on writing and ou publishing a ebook on the KDP with Amazon? Thanks in advanced!!
1
answers
0
votes
369
views
asked a month agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
469
views
asked a month agolg...
I have one question about IP address to provisions depend on the type of (small, medium and large) and quantity of workers , i tried to find something relevant about it in some documentation but i...
2
answers
0
votes
404
views
asked 2 months agolg...
See title. I am wondering what the exact impact is, because the state lasts for a very long time, typically 20-30 minutes in my experience. For example, I'm wondering if dags scheduled to run in that...
2
answers
0
votes
386
views
asked 2 months agolg...
Hi,
Setting up a zero code ETL environment using Redshift mostly
I will be setting up Scheduler to ingest data from FDW RDS but for API I would like a SP/Function to execute Python scripts that do an...
2
answers
0
votes
429
views
asked 2 months agolg...
Good day,
I am trying to build a no/zero code architecture, i was planning to use MWAA for orchestration but i was tasked to look at alternatives keeping it simple
I was hoping Redshift query...
2
answers
0
votes
380
views
asked 2 months agolg...
Hey,
My company is moving away from Java Corretto and replacing it with OpenJDK. We are suspicious that one of the services, MWAA, uses Corretto because we found it being installed in this...
1
answers
0
votes
406
views
asked 3 months agolg...
Currently I am running my MWAA on small instance with:
`celery.worker_autoscale = 5,5`
And sometimes my tasks get SIGKILL, I assume it's because tasks are taking too many memory.
In this article :...
Accepted AnswerAmazon Managed Workflows for Apache Airflow (MWAA)
1
answers
0
votes
443
views
asked 3 months agolg...