MWAA: how to install python requirements behind proxy

1

Hello everyone,

we've launched a private MWAA environment. We are able to access the UI, but we're having some trouble installing our python requirements. MWAA picks up the requirements file from S3, but runs into a timeout when trying to install the python packages.

This is expected, because we're behind a proxy, so here goes my question: how do we tell MWAA to use our proxy while installing our python dependencies?

This is what our CloudWatch log stream (requirements_install_ip*) tells us:

"WARNING: Retrying (Retry(total=4, connect=None, read=None, redirect=None, status=None))
after connection broken by 'ConnectTimeoutError(<pip._vendor.urllib3.connection.HTTPSConnection
object at 0x7fda26b394d0>, 'Connection to pypi.org timed out. (connect timeout=15)')' "

posta 3 anni fa1752 visualizzazioni
1 Risposta
0
AWS
John_J
con risposta 3 anni fa
  • Hi, we are trying to setup MWAA in private mode. We have included the requirements.txt as per option 1 in above link but we are still getting error. The pypi.org is accessible from other EC2 on the same subnet so there should not be any network/FW issues. Does anyone has any idea what might be wrong or what other configuration may be needed to make this work? Happy to provide additional details if required.

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande