application history shows empty

0

Hi,

I am using emr 5.29 and aws console application history shows empty even I can see my applications using yarn on the master node. Is this an known issue? I plan to use this UI to find the spark UI for debugging my jobs. Appreciate any help!

Regards
Leon

질문됨 4년 전643회 조회
2개 답변
0

Problem resolved and I can use ssh port forwarding to see spark UI and jobs in yarn UI. Thanks.

답변함 4년 전
0

Hi Leon,

Glad to hear that you addressed the issue.

Furthermore, as you are using EMR 5.29.0 you can consider exploring the One-Click Access to Persistent Spark History Server UI which doesn't require SSH tunneling.

https://aws.amazon.com/about-aws/whats-new/2019/11/amazon-emr-announces-one-click-access-to-persistent-spark-history-server/
https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html

However, if you have reconfigured the default Spark events directory, you won't be able to view the applications using one-click access and would have to use the SSH tunneling method for Spark UI.

I hope this helps.
Do post back on this thread, if you have any further questions or concerns.

Regards,
Almas

AWS
답변함 4년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인