SSH command timed out in MWAA v2.5.1

Question

After upgrading my airflow environment from v2.0.2 to v2.5.1,   I started running into the issue of 'SSH command timed out' which I never experienced while using v2.0.2. In my environment I have multiple dags with each dag having different tasks with different task durations.

I tried setting cmd_timeout to 8000 but it times out because one of my task runs for a long time. It's difficult to set a value for the parameter cmd_timeout.

My question- Is there a way to set cmd_timeout to None at the global level? I tried setting it at the dag level but it fails.

Answer

Hi, look at answer #2 of https://stackoverflow.com/questions/75690418/airflow-sshoperator-command-timed-out-when-executing-python-script
It seems to be what you need to solve your problem all at once.
Best,
Didier

Answer

I was able to fix this issue by setting cmd_timeout:null

SSH command timed out in MWAA v2.5.1

Contenuto pertinente