Unanswered Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have an EMR workspace under which I have 4 Jupyter notebooks created on which PySpark code blocks are run.
I want to get the last execution code block time across all 4 notebooks to determine the...
0
answers
0
votes
24
views
asked 3 days agolg...
Issue: PySpark works in the first cells (likely SparkSession creation) but throws import errors when using my Python files in later cells.
Environment: AWS EMR ( Amazon EMR...
0
answers
0
votes
225
views
asked 24 days agolg...
Hi
I am getting error while launching EMR with Hbase as S3Storage and WAL backup enabled .
Caused by: java.lang.RuntimeException: createWal failed for wal WALMetadata(WALWorkspace=testworkspace2,...
0
answers
0
votes
474
views
asked a month agolg...
I have a Python package saved in CodeCommit and need to use it in the notebook attached to my EMR cluster workspace.
The package is already successfully installed via bootstrap.
To do this, in my .sh...
0
answers
0
votes
369
views
asked a month agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
120
views
asked 4 months agolg...
When I try to create a new workspace for an AWS EMR Studio in the AWS Console, I get a blank page and a Javascript error in the console
("Failed to execute 'mark' on 'Performance':...
0
answers
0
votes
101
views
asked 4 months agolg...
Hello,
I have upgraded the EMR from 6.14 to 6.15, and started seeing errors on the existing core node:
`org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: IAMInstanceCredentialsProvider:...
0
answers
0
votes
93
views
asked 5 months agolg...
I am facing issues using inline clustering and compaction in EMR, with the following error..
EMR : 6.13.0
Hudi: 0.13.1
com.esotericsoftware.kryo.KryoException: Unable to find class:...
0
answers
0
votes
93
views
asked 5 months agolg...
We are running an application based on EMR 5.36.0, and our security scans note several "high" impact Tomcat vulnerability (used internally by EMR). The last 5.x release was July 2022, and Tomcat was...
0
answers
0
votes
45
views
asked 10 months agolg...
This [documentation page][1] shows how to set the `JAVA_HOME` environment variable for EMR. I'm experimenting with running another version of Java, and I want to try passing some more command line...
0
answers
0
votes
114
views
asked a year agolg...
Hi team,
I see that deleting the EMR cluster sometimes does not necessarily delete the virtual clusters that they create and they remain running stale.
Everytime I see this issue, I can only use the...
0
answers
0
votes
47
views
asked a year agolg...
running emr cluster with r5.8xlarge containing 1 master and 4 core and 2 task nodes want to increase yarn memroy for this cluster to improve performance?
0
answers
0
votes
151
views
asked a year agolg...