By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

How to set up / access the Spark UI for AWS Glue jobs and notebooks

0

The checkbox in a Glue job is select to enable the Spark UI, and an s3 path is specified as the location for those logs. How can I access the Spark UI URL?

Topics
Analytics
Tags
AWS Glue
Language
English
profile picture
Jaime
asked a year ago794 views
1 Answer
1
Accepted Answer

You need to deploy you own history server to visualize those longs, you can use a CloudFormation template, a docker container (you can also run locally a history server from a Spark distribution but adding s3 support requires a bit of work). See steps here: https://docs.aws.amazon.com/glue/latest/dg/monitor-spark-ui-history.html

profile pictureAWS
EXPERT
Gonzalo Herreros
answered a year ago
profile picture
EXPERT
Antonio_Lagrotteria
reviewed a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content