SSH command timed out in MWAA v2.5.1

0

After upgrading my airflow environment from v2.0.2 to v2.5.1, I started running into the issue of 'SSH command timed out' which I never experienced while using v2.0.2. In my environment I have multiple dags with each dag having different tasks with different task durations.

I tried setting cmd_timeout to 8000 but it times out because one of my task runs for a long time. It's difficult to set a value for the parameter cmd_timeout.

My question- Is there a way to set cmd_timeout to None at the global level? I tried setting it at the dag level but it fails.

Tope
preguntada hace 9 meses383 visualizaciones
2 Respuestas
0

Hi, look at answer #2 of https://stackoverflow.com/questions/75690418/airflow-sshoperator-command-timed-out-when-executing-python-script It seems to be what you need to solve your problem all at once. Best, Didier

profile pictureAWS
EXPERTO
respondido hace 9 meses
  • Thanks. With this method, I will need to completely redesign the dags in my environment. Are there other alternatives to setting this parameter at a global level?

0

I was able to fix this issue by setting cmd_timeout:null

Tope
respondido hace 9 meses

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas