I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it redirects to the web page that has my spark history UI for my emr-serverless job run. that web page has links in it that I need to drill down into. I can't figure out how to get into these links.
the url that is returned by the get-dashboard-for-job-run is like:
https://j-jobid.dashboard.emr-serverless.us-east-1.amazonaws.com/?authToken=
This returns a 302 redirect that goes to:
The web page I get to is like https://yaddayadda/shs/history/job-id/job.
The link I want to get to is like https://yaddayadda/shs/history/job-id/executors
problems: The auth-token can only be used 1 time
How can I get to this executors link using an auth-token that is returned by get-dashboard-for-job-run, given the url that is associated with the auth-token is actually a redirect, not the actual page I want to go to?
Are you trying to programmatically build the link? Once you're redirected to the history server you can navigate to the executors page just by clicking on the "Executors" link at the top of the page.