All Content tagged with Amazon Managed Workflows for Apache Airflow (MWAA)

Amazon Managed Workflows for Apache Airflow (MWAA) is a managed orchestration service for Apache Airflow1 that makes it easier to set up and operate end-to-end data pipelines in the cloud at scale.

Content language: English

Select tags to filter
Sort by most recent
204 results
Hello, I need a lambda function in python to access the RestFul API of our MWAA on a private VPC. The lambda runs on the same VPC and subnet as the MWAA environment. We were able to connect the lam...
1
answers
0
votes
61
views
asked 7 days ago
Im following the tutorial to set up and local workflow in Sagemaker Unified Studio https://docs.aws.amazon.com/sagemaker-unified-studio/latest/userguide/create-workflow.html But i can not make it work...
1
answers
0
votes
32
views
asked 14 days ago
profile pictureAWS
EXPERT
published 22 days ago0 votes132 views
This post provides a step-by-step guide to enable missing Airflow connection types in Amazon MWAA by installing provider packages, including instructions for pre-packaging dependencies in private envi...
I'm trying to enable the test connection feature in connection tab in MWAA This is the config that I try to set in Airflow configuration UI but it's not working webserver.test_connection = Enable web...
2
answers
0
votes
80
views
asked a month ago
We migrated our Airflow DAGs from an environment running 2.5 to a new environment running 2.10.3. After this we noticed the rate of autoscaling of workers drastically increased. ![no. workers every ...
2
answers
0
votes
144
views
asked 2 months ago
Hi, How to use Apache Airflow to consume Neptune change stream data? thanks and Regards,
1
answers
0
votes
40
views
asked 3 months ago
Hi, I am exploring the bet way to capture data from Neptune change stream and pass it on downstream. The blog below suggests authoring your own handler function and then to have that executed on a pe...
1
answers
0
votes
119
views
asked 3 months ago
When trying to create an MWAA Environment, I'm having an error trying to create the default VPC: Template URL https://mwaa-downloads.s3-us-west-2.amazonaws.com/mwaa-vpc-cfn-template.yaml Yields: S3...
2
answers
0
votes
67
views
asked 4 months ago
I am using MWAA 2.10.1 version and this is the requirement file i am using and it was throwing a error while importing the dag by stating that the "No module named snowflake". Could you please suggest...
2
answers
0
votes
129
views
asked 4 months ago
**->The workers and schedulers from MWAA are able to download things from the target instance on port 443 (repository, internally hosted) but the MWAA web server cannot, get's time out when tries to ...
1
answers
0
votes
109
views
asked 5 months ago
We're running MWAA 2.10.1 on a private network, so I had to package my Python packages in a plugin.zip, as well as the constraints, but we are seeing this error when attempting to install: ```2024-12-...
1
answers
0
votes
192
views
asked 6 months ago