Kill yarn jobs that not running automatically

Question

I want to know if the option exist in EMR or automated way to kill the spark job that says initial job not accepted any resources. Some of my cluster is transient that run off batch hour without progressing stuck in accepted state.
 
Thanks in advance

Yokesh NK · Accepted Answer

Hello,

There is no option to kill the application automatically when initial job has not accepted any resources. Because this is not an error on yarn side but the job is waiting for resource allocation and it will run after getting resources to launch executors.

So you may consider to create a script that periodically polls application logs and kill the application if there are logs "Initial job has not accepted any resources. Check your cluster UI to ensure that workers are registered and have sufficient resources" and kill it if the progress keeps 0% for the duration you specified.

Found this [external reference](https://community.cloudera.com/t5/Community-Articles/script-to-kill-yarn-application-if-it-is-running-more-than-x/ta-p/244521) that might help to achieve this. You can set to run the script on the primary node configuring bootstrap action when creating the cluster. Hope this answered your query.

Kill yarn jobs that not running automatically

Relevant content