application history shows empty

Question

Hi,  
  
I am using emr 5.29 and aws console application history shows empty even I can see my applications using yarn on the master node. Is this an known issue? I plan to use this UI to find the spark UI for debugging my jobs. Appreciate any help!  
  
Regards  
Leon

Answer

Hi Leon,   
  
Glad to hear that you addressed the issue.   
  
Furthermore, as you are using EMR 5.29.0 you can consider exploring the One-Click Access to Persistent Spark History Server UI which doesn't require SSH tunneling.   
  
https://aws.amazon.com/about-aws/whats-new/2019/11/amazon-emr-announces-one-click-access-to-persistent-spark-history-server/  
https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html  
  
However, if you have reconfigured the default Spark events directory, you won't be able to view the applications using one-click access and would have to use the SSH tunneling method for Spark UI.   
  
I hope this helps.   
Do post back on this thread, if you have any further questions or concerns.   
  
Regards,  
Almas

Answer

Problem resolved and I can use ssh port forwarding to see spark UI and jobs in yarn UI. Thanks.

application history shows empty

Relevant content