MWAA: how to install python requirements behind proxy

1

Hello everyone,

we've launched a private MWAA environment. We are able to access the UI, but we're having some trouble installing our python requirements. MWAA picks up the requirements file from S3, but runs into a timeout when trying to install the python packages.

This is expected, because we're behind a proxy, so here goes my question: how do we tell MWAA to use our proxy while installing our python dependencies?

This is what our CloudWatch log stream (requirements_install_ip*) tells us:

"WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None))
after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection
object at 0x7fda26b394d0>, 'Connection to pypi.org timed out. (connect timeout=15)')' "

已提問 3 年前檢視次數 1753 次
1 個回答
0
AWS
John_J
已回答 3 年前
  • Hi, we are trying to setup MWAA in private mode. We have included the requirements.txt as per option 1 in above link but we are still getting error. The pypi.org is accessible from other EC2 on the same subnet so there should not be any network/FW issues. Does anyone has any idea what might be wrong or what other configuration may be needed to make this work? Happy to provide additional details if required.

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南