SSH command timed out in MWAA v2.5.1

0

After upgrading my airflow environment from v2.0.2 to v2.5.1, I started running into the issue of 'SSH command timed out' which I never experienced while using v2.0.2. In my environment I have multiple dags with each dag having different tasks with different task durations.

I tried setting cmd_timeout to 8000 but it times out because one of my task runs for a long time. It's difficult to set a value for the parameter cmd_timeout.

My question- Is there a way to set cmd_timeout to None at the global level? I tried setting it at the dag level but it fails.

Tope
已提问 9 个月前383 查看次数
2 回答
0

Hi, look at answer #2 of https://stackoverflow.com/questions/75690418/airflow-sshoperator-command-timed-out-when-executing-python-script It seems to be what you need to solve your problem all at once. Best, Didier

profile pictureAWS
专家
已回答 9 个月前
  • Thanks. With this method, I will need to completely redesign the dags in my environment. Are there other alternatives to setting this parameter at a global level?

0

I was able to fix this issue by setting cmd_timeout:null

Tope
已回答 9 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则