not reload single Dag file on Airflow UI

Question

i'm trying to execute my dag file to upload S3 bucket

but, cant see the task on Airflow UI
when i checked the same issue in google search and referenced the documentation(https://repost.aws/questions/QUZQfSStQ_SuaPGBIAKUGY4w/the-scheduler-does-not-appear-to-be-running),
it could not resolved my issue..

1. all inbound traffic is allowd by default setting

2. i cant see any log on cloudwatch

the heaerbeat of scheduler is keeping updating.

Answer

When you say `cant see the task on Airflow UI`, possibly the DAG is getting parsed and there were no tasks defined in it. If this is the case, then there is an issue with the calling out the task in the DAG, so you need to revisit the code. 
Also, you need to verify from the dag processing logs about the DAG files are being parsed in it or not. For any parsing error, it should also appear in DAG processing logs.

if the scheduler is loosing heartbeat means that there is some issue with the scheduler, check CPU/memory utilization from [CloudWatch metrics](https://docs.aws.amazon.com/mwaa/latest/userguide/access-metrics-cw-202.html).

Note: this is a public forum, so please sensitize the code/logs before sharing.

not reload single Dag file on Airflow UI

相关内容