application history shows empty

0

Hi,

I am using emr 5.29 and aws console application history shows empty even I can see my applications using yarn on the master node. Is this an known issue? I plan to use this UI to find the spark UI for debugging my jobs. Appreciate any help!

Regards
Leon

質問済み 4年前642ビュー
2回答
0

Problem resolved and I can use ssh port forwarding to see spark UI and jobs in yarn UI. Thanks.

回答済み 4年前
0

Hi Leon,

Glad to hear that you addressed the issue.

Furthermore, as you are using EMR 5.29.0 you can consider exploring the One-Click Access to Persistent Spark History Server UI which doesn't require SSH tunneling.

https://aws.amazon.com/about-aws/whats-new/2019/11/amazon-emr-announces-one-click-access-to-persistent-spark-history-server/
https://docs.aws.amazon.com/emr/latest/ManagementGuide/app-history-spark-UI.html

However, if you have reconfigured the default Spark events directory, you won't be able to view the applications using one-click access and would have to use the SSH tunneling method for Spark UI.

I hope this helps.
Do post back on this thread, if you have any further questions or concerns.

Regards,
Almas

AWS
回答済み 4年前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ