Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi,
we have a task to move Spark jobs from on-prem to AWS, using lift-and-shift of the code as much as possible. Our Spark is based on Scala 2.11 and Spark 2.4.0. I know EMR supports this version but...
1
answers
1
votes
486
views
asked a year agolg...
My job is still running even though I have received the results. why is that ??
I have successfully go the results.
Can I manually set the "Run status" as "Success" after I got result ? I mean are...
1
answers
0
votes
580
views
asked a year agolg...
I want to configure jar (deequ-2.0.1-spark-3.2.jar) on EMR serverless arm64.
This works for x86_64 but doesn't work for arm64 architecture.
Could you please consider this matter it gave this error...
2
answers
0
votes
546
views
asked a year agolg...
Hi Team,
I wanted to run spark application built using JDK 11 on EMR Serverless. Since the default image does not have support of JDK 11, I created the custom image based on following links:
Use...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
618
views
asked a year agolg...
Hello,
today my EMR Serverless application suddenly decided to not start. It's staying in "Starting" state and won't reach "Started" state. Usually it starts in less than a minute, today I have...
1
answers
1
votes
603
views
asked a year agolg...
I'm working on EMR Serverless for validating of data located in s3 using deequ library. But I am Unable to do that , I got this error...
Traceback (most recent call last):
File...
1
answers
0
votes
839
views
asked a year agolg...
Hi,
I ran an ETL job in EMR serverless but I incurred Natgateway charges even though my emr application and s3 bucket is in the same region. I have also configured gateway endpoint to s3 in my vpc but...
1
answers
0
votes
359
views
asked a year agolg...
Hi.
I have set up an EMR Serverless application to run a simple Hello World spark job. I've configured everything properly and the job execution is successful.
Next, I've created a custom image...
1
answers
0
votes
679
views
asked a year agolg...
Hi! I'm excited to see EMR Serverless. I went through the quick start and was able to run the word count, pretty cool.
Now I would like to submit a spark job using command-runner.jar like I do on a...
1
answers
0
votes
1188
views
asked a year agolg...
Need to create an emr cluster with custom ubuntu image. While I tried to use market place ubuntu image to create the cluster, I got an error stating that EMR cluster can not be created with multiple...
1
answers
0
votes
272
views
asked a year agolg...
**Question**
Is there a limitation in EMR Serverless that prevents the `spark-streaming-kinesis-asl_2.12` library from reading / writing to the DynamoDb lease table? When running a kinesis streaming...
0
answers
0
votes
147
views
asked a year agolg...
Hi, I want to run a job on EMR serverless which reads and writes data from postgresql. I downloaded the jar file and pushed it to s3 and set "spark.jars" in Spark properties in management console....
1
answers
0
votes
1142
views
asked a year agolg...