not reload single Dag file on Airflow UI

0

i'm trying to execute my dag file to upload S3 bucket

but, cant see the task on Airflow UI when i checked the same issue in google search and referenced the documentation(https://repost.aws/questions/QUZQfSStQ_SuaPGBIAKUGY4w/the-scheduler-does-not-appear-to-be-running), it could not resolved my issue..

  1. all inbound traffic is allowd by default setting

  2. i cant see any log on cloudwatch

the heaerbeat of scheduler is keeping updating.

blues
質問済み 6ヶ月前122ビュー
1回答
0

When you say cant see the task on Airflow UI, possibly the DAG is getting parsed and there were no tasks defined in it. If this is the case, then there is an issue with the calling out the task in the DAG, so you need to revisit the code. Also, you need to verify from the dag processing logs about the DAG files are being parsed in it or not. For any parsing error, it should also appear in DAG processing logs.

if the scheduler is loosing heartbeat means that there is some issue with the scheduler, check CPU/memory utilization from CloudWatch metrics.

Note: this is a public forum, so please sensitize the code/logs before sharing.

AWS
回答済み 2日前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ