application history shows empty

0

Hi,

I am using emr 5.29 and aws console application history shows empty even I can see my applications using yarn on the master node. Is this an known issue? I plan to use this UI to find the spark UI for debugging my jobs. Appreciate any help!

Regards
Leon

asked 4 years ago623 views
2 Answers
0

Problem resolved and I can use ssh port forwarding to see spark UI and jobs in yarn UI. Thanks.

answered 4 years ago
0

Hi Leon,

Glad to hear that you addressed the issue.

Furthermore, as you are using EMR 5.29.0 you can consider exploring the One-Click Access to Persistent Spark History Server UI which doesn't require SSH tunneling.

https://aws.amazon.com/about-aws/whats-new/2019/11/amazon-emr-announces-one-click-access-to-persistent-spark-history-server/
https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html

However, if you have reconfigured the default Spark events directory, you won't be able to view the applications using one-click access and would have to use the SSH tunneling method for Spark UI.

I hope this helps.
Do post back on this thread, if you have any further questions or concerns.

Regards,
Almas

AWS
answered 4 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions