Monitoring EMR job status

Question

A customer wants to monitor EMR job status. They want to get a detailed picture of some jobs that runs longer time than normal, which impacts their daily work. Where can they view this information?

Accepted Answer

EMR supports enhanced debugging, with logs stored in S3. 
https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-enhanced-step-debugging.html
https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-manage-view-web-log-files.html

Furthermore, if you are also running YARN, you can view application history and metrics. 
https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-cluster-application-history.html

Monitoring EMR job status

Conteúdo relevante