SSH command timed out in MWAA v2.5.1

After upgrading my airflow environment from v2.0.2 to v2.5.1, I started running into the issue of 'SSH command timed out' which I never experienced while using v2.0.2. In my environment I have multiple dags with each dag having different tasks with different task durations.

I tried setting cmd_timeout to 8000 but it times out because one of my task runs for a long time. It's difficult to set a value for the parameter cmd_timeout.

My question- Is there a way to set cmd_timeout to None at the global level? I tried setting it at the dag level but it fails.

주제

애플리케이션 통합

태그

아파치 에어플로우용 아마존 관리형 워크플로(MWAA)

언어

English

Tope

질문됨 9달 전383회 조회

2개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

Hi, look at answer #2 of https://stackoverflow.com/questions/75690418/airflow-sshoperator-command-timed-out-when-executing-python-script It seems to be what you need to solve your problem all at once. Best, Didier

전문가

Didier_Durand

답변함 9달 전

Tope
9달 전
Thanks. With this method, I will need to completely redesign the dags in my environment. Are there other alternatives to setting this parameter at a global level?

I was able to fix this issue by setting cmd_timeout:null

Tope

답변함 9달 전

SSH command timed out in MWAA v2.5.1

관련 콘텐츠