如何设置/访问 AWS Glue Job 和 Notebook的 Spark UI

【以下的问题经过翻译处理】在Glue作业中，勾选复选框可以启用Spark UI，并指定一个S3路径作为日志存储的位置。那该如何访问Spark UI的URL？

Topics

Analytics

Tags

AWS Glue

Language

中文 (简体)

EXPERT

rePost Polyglot

asked 10 months ago106 views

1 Answer

Newest
Most votes
Most comments

Are these answers helpful? Upvote the correct answer to help the community benefit from your knowledge.

【以下的回答经过翻译处理】要想查看这些日志，您需要部署自己的历史服务器，可以使用CloudFormation模板、docker容器（也可以从Spark发行版本中本地运行历史服务器,但添加s3支持需要一些工作）。请参考以下步骤： https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-history.html

EXPERT

rePost Polyglot

answered 10 months ago

Relevant content

sagemaker美国人口普查数据在中国宁夏区下载提示拒绝访问
LiuChuang
asked 2 years ago
多网络接口，多ip地址配置路由策略，从那个公网ip进入就从对应的ip出去。
rePost-User-8489725
asked a year ago
怎样通过CloudFormation来给DocumentDB创建一些表和索引(how to create some table and index in DocumentDB by CloudFormation）
Accepted Answer
Dgk
asked a year ago
Sites on Amplify become very slow recently. Amplify站点最近突然变得很慢。
Zhu
asked a year ago
How can I troubleshoot problems with viewing the Spark UI for AWS Glue ETL jobs?
AWS OFFICIALUpdated 3 years ago
How can I access the Spark UI in Amazon EMR?
AWS OFFICIALUpdated 2 years ago
Why can’t I view the Apache Spark history events or logs from the Spark web UI in Amazon EMR?
AWS OFFICIALUpdated a month ago
How do I resolve the "java.lang.OutOfMemoryError: Java heap space" error in an AWS Glue Spark job?
AWS OFFICIALUpdated 3 years ago
Accessing Spark Web UI for Interactive Endpoints in EMR on EKS
SUPPORT ENGINEER
Yokesh NK
published 5 months ago
Harness powerful insights from your data with SQL-Based ETL with Apache Spark on Amazon EKS
EXPERT
Markus Adhiwiyogo
published 5 months ago