SSH command timed out in MWAA v2.5.1

0

After upgrading my airflow environment from v2.0.2 to v2.5.1, I started running into the issue of 'SSH command timed out' which I never experienced while using v2.0.2. In my environment I have multiple dags with each dag having different tasks with different task durations.

I tried setting cmd_timeout to 8000 but it times out because one of my task runs for a long time. It's difficult to set a value for the parameter cmd_timeout.

My question- Is there a way to set cmd_timeout to None at the global level? I tried setting it at the dag level but it fails.

Tope
asked 8 months ago360 views
2 Answers
0

Hi, look at answer #2 of https://stackoverflow.com/questions/75690418/airflow-sshoperator-command-timed-out-when-executing-python-script It seems to be what you need to solve your problem all at once. Best, Didier

profile pictureAWS
EXPERT
answered 8 months ago
  • Thanks. With this method, I will need to completely redesign the dags in my environment. Are there other alternatives to setting this parameter at a global level?

0

I was able to fix this issue by setting cmd_timeout:null

Tope
answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions