Questions tagged with Amazon Managed Workflows for Apache Airflow (MWAA)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Can anyone give some advice on writing and ou publishing a ebook on the KDP with Amazon? Thanks in advanced!!
1
answers
0
votes
44
views
asked 6 days agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
117
views
asked 24 days agolg...
I have one question about IP address to provisions depend on the type of (small, medium and large) and quantity of workers , i tried to find something relevant about it in some documentation but i...
2
answers
0
votes
57
views
asked a month agolg...
See title. I am wondering what the exact impact is, because the state lasts for a very long time, typically 20-30 minutes in my experience. For example, I'm wondering if dags scheduled to run in that...
2
answers
0
votes
61
views
asked a month agolg...
Hi,
Setting up a zero code ETL environment using Redshift mostly
I will be setting up Scheduler to ingest data from FDW RDS but for API I would like a SP/Function to execute Python scripts that do an...
2
answers
0
votes
97
views
asked 2 months agolg...
Good day,
I am trying to build a no/zero code architecture, i was planning to use MWAA for orchestration but i was tasked to look at alternatives keeping it simple
I was hoping Redshift query...
2
answers
0
votes
55
views
asked 2 months agolg...
Hey,
My company is moving away from Java Corretto and replacing it with OpenJDK. We are suspicious that one of the services, MWAA, uses Corretto because we found it being installed in this...
1
answers
0
votes
74
views
asked 2 months agolg...
Currently I am running my MWAA on small instance with:
`celery.worker_autoscale = 5,5`
And sometimes my tasks get SIGKILL, I assume it's because tasks are taking too many memory.
In this article :...
1
answers
0
votes
91
views
asked 2 months agolg...
Hi, I'm trying to connect airflow to Redshift Serverless. I have RedshiftFullAccess, and I'm trying to copy files from S3 to Redshift using S3ToRedshiftOperator, I got Cluster not found error. I'm...
2
answers
0
votes
210
views
asked 2 months agolg...
MWAA web login tokenlg...
I have setup MWAA v2.7.2 in PRIVATE access mode in my already existing VPC and I allow access to the UI through VPN. I follow the MWAA documentation and I am able to produce a CLI token and then hit...
1
answers
0
votes
94
views
asked 2 months agolg...
Hi, we are in the process of moving from EMR to EMR serveless. Currently we are converting our Airflow DAGS from EMR to EMR serverless format.
We are having trouble getting one of our steps to work...
1
answers
0
votes
156
views
asked 2 months agolg...
1. I have created Private MWAA environment
2. Create EC2 bastion for port forwaring
3. Running ssh tunnel from my localhost and trying to open UI
4. I can see Airflow UI requesting SSO login.
5. I...
1
answers
0
votes
98
views
asked 3 months agolg...