MWAA: how to install python requirements behind proxy

1

Hello everyone,

we've launched a private MWAA environment. We are able to access the UI, but we're having some trouble installing our python requirements. MWAA picks up the requirements file from S3, but runs into a timeout when trying to install the python packages.

This is expected, because we're behind a proxy, so here goes my question: how do we tell MWAA to use our proxy while installing our python dependencies?

This is what our CloudWatch log stream (requirements_install_ip*) tells us:

"WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None))
after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection
object at 0x7fda26b394d0>, 'Connection to pypi.org timed out. (connect timeout=15)')' "

已提问 3 年前1752 查看次数
1 回答
0
AWS
John_J
已回答 3 年前
  • Hi, we are trying to setup MWAA in private mode. We have included the requirements.txt as per option 1 in above link but we are still getting error. The pypi.org is accessible from other EC2 on the same subnet so there should not be any network/FW issues. Does anyone has any idea what might be wrong or what other configuration may be needed to make this work? Happy to provide additional details if required.

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则