MWAA airflow Dags are not starting

Question

My Dags are getting stuck and when I checked the worker logs, I see a connection timeout error with sqs. Is this the reason for Dags not starting? How to resolve this issue? Appreciate your immediate help on this.

botocore.exceptions.ConnectTimeoutError: Connect timeout on endpoint URL: "https://sqs.us-east-1.amazonaws.com/"

Answer

A question about the setup of your Amazon MWAA Environment, did you setup Amazon MWAA without Internet access?  This could also be referenced as Private Routing.

Based around the connection time-out of the SQS service, it leads me to question if that VPC has access to the AWS services.

https://docs.aws.amazon.com/mwaa/latest/userguide/vpc-vpe-create-access.html

MWAA airflow Dags are not starting

Relevanter Inhalt