Private MWAA - Snowflake Connection Issue - Amazon Managed Workflows for Apache Airflow

Question

I set up a private Airflow environment in AWS -v2.2.2-. Environment and plugins are up and running, I want to connect to Snowflake but I am getting the error below . -whl files in plugins.zip using requirements.txt-

```
snowflake.connector.vendored.urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='......snowflakecomputing.com', port=443): Max retries exceeded with url: /session/v1/login-request?request_id=....... (Caused by ConnectTimeoutError(, 'Connection to ........snowflakecomputing.com timed out. (connect timeout=60)'))

```
Same connection works in public mwaa. I am adding connection informations into admin-connections tab from the UI. I know private env does not have connection to internet

If i want to connect to any api also i get a timeout since subnets not connected to internet

Also private mwaa environment is running on an existing vpc that has igw attachment, but the subnets that mwaa is running doesn't have any igw or nat attachment -as documentation suggests-

I checked all the documentations but there are no information for connectivity via private environment, how can i solve my issue ?

Answer

Private MWAA environment refers to the web server access.  Regardless of web server access configuration, the workers and scheduler reside on your VPC as provided when creating your MWAA environment.

Those workers on your VPC need access to the downstream services.  In the case of Snowflake, the private subnets that MWAA is using must have access to snowflakecomputing.com, typically via IGW.  See example VPC at https://docs.aws.amazon.com/mwaa/latest/userguide/vpc-create.html#vpc-create-template-private-or-public .

Private MWAA - Snowflake Connection Issue - Amazon Managed Workflows for Apache Airflow

相關內容