Unanswered Questions tagged with Amazon EMR
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Issue: PySpark works in the first cells (likely SparkSession creation) but throws import errors when using my Python files in later cells.
Environment: AWS EMR ( Amazon EMR...
0
answers
0
votes
212
views
asked 14 days agolg...
Hi
I am getting error while launching EMR with Hbase as S3Storage and WAL backup enabled .
Caused by: java.lang.RuntimeException: createWal failed for wal WALMetadata(WALWorkspace=testworkspace2,...
0
answers
0
votes
429
views
asked a month agolg...
I have a Python package saved in CodeCommit and need to use it in the notebook attached to my EMR cluster workspace.
The package is already successfully installed via bootstrap.
To do this, in my .sh...
0
answers
0
votes
357
views
asked a month agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
114
views
asked 4 months agolg...
When I try to create a new workspace for an AWS EMR Studio in the AWS Console, I get a blank page and a Javascript error in the console
("Failed to execute 'mark' on 'Performance':...
0
answers
0
votes
96
views
asked 4 months agolg...
Hello,
I have upgraded the EMR from 6.14 to 6.15, and started seeing errors on the existing core node:
`org.apache.hadoop.fs.s3a.auth.NoAwsCredentialsException: IAMInstanceCredentialsProvider:...
0
answers
0
votes
91
views
asked 4 months agolg...
I am facing issues using inline clustering and compaction in EMR, with the following error..
EMR : 6.13.0
Hudi: 0.13.1
com.esotericsoftware.kryo.KryoException: Unable to find class:...
0
answers
0
votes
90
views
asked 5 months agolg...
We are running an application based on EMR 5.36.0, and our security scans note several "high" impact Tomcat vulnerability (used internally by EMR). The last 5.x release was July 2022, and Tomcat was...
0
answers
0
votes
45
views
asked 10 months agolg...
This [documentation page][1] shows how to set the `JAVA_HOME` environment variable for EMR. I'm experimenting with running another version of Java, and I want to try passing some more command line...
0
answers
0
votes
113
views
asked a year agolg...
Hi team,
I see that deleting the EMR cluster sometimes does not necessarily delete the virtual clusters that they create and they remain running stale.
Everytime I see this issue, I can only use the...
0
answers
0
votes
47
views
asked a year agolg...
running emr cluster with r5.8xlarge containing 1 master and 4 core and 2 task nodes want to increase yarn memroy for this cluster to improve performance?
0
answers
0
votes
149
views
asked a year agolg...
Hi there,
I need to create a custom kernel with my own libraries for use in EMR, so Im trying to follow this EMR...
0
answers
0
votes
75
views
asked a year agolg...