Kill yarn jobs that not running automatically

Hello,

There is no option to kill the application automatically when initial job has not accepted any resources. Because this is not an error on yarn side but the job is waiting for resource allocation and it will run after getting resources to launch executors.

So you may consider to create a script that periodically polls application logs and kill the application if there are logs "Initial job has not accepted any resources. Check your cluster UI to ensure that workers are registered and have sufficient resources" and kill it if the progress keeps 0% for the duration you specified.

Found this external reference that might help to achieve this. You can set to run the script on the primary node configuring bootstrap action when creating the cluster. Hope this answered your query.