En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post

SSH command timed out in MWAA v2.5.1

0

After upgrading my airflow environment from v2.0.2 to v2.5.1, I started running into the issue of 'SSH command timed out' which I never experienced while using v2.0.2. In my environment I have multiple dags with each dag having different tasks with different task durations.

I tried setting cmd_timeout to 8000 but it times out because one of my task runs for a long time. It's difficult to set a value for the parameter cmd_timeout.

My question- Is there a way to set cmd_timeout to None at the global level? I tried setting it at the dag level but it fails.

Sujets
Intégration d'applications
Balises
Amazon Managed Workflows pour Apache Airflow (MWAA)
Langue
English
Tope
demandé il y a 9 mois383 vues
2 réponses
0

Hi, look at answer #2 of https://stackoverflow.com/questions/75690418/airflow-sshoperator-command-timed-out-when-executing-python-script It seems to be what you need to solve your problem all at once. Best, Didier

profile pictureAWS
EXPERT
Didier_Durand
répondu il y a 9 mois
  • Tope
    il y a 9 mois

    Thanks. With this method, I will need to completely redesign the dags in my environment. Are there other alternatives to setting this parameter at a global level?

0

I was able to fix this issue by setting cmd_timeout:null

Tope
répondu il y a 9 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions

Contenus pertinents