Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Team,
I wanted to run spark application built using JDK 11 on EMR Serverless. Since the default image does not have support of JDK 11, I created the custom image based on following links:
Use...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
565
views
asked a year agolg...
Hello,
today my EMR Serverless application suddenly decided to not start. It's staying in "Starting" state and won't reach "Started" state. Usually it starts in less than a minute, today I have...
1
answers
1
votes
547
views
asked a year agolg...
I'm working on EMR Serverless for validating of data located in s3 using deequ library. But I am Unable to do that , I got this error...
Traceback (most recent call last):
File...
1
answers
0
votes
764
views
asked a year agolg...
Hi,
I ran an ETL job in EMR serverless but I incurred Natgateway charges even though my emr application and s3 bucket is in the same region. I have also configured gateway endpoint to s3 in my vpc but...
1
answers
0
votes
335
views
asked a year agolg...
Hi.
I have set up an EMR Serverless application to run a simple Hello World spark job. I've configured everything properly and the job execution is successful.
Next, I've created a custom image...
1
answers
0
votes
612
views
asked a year agolg...
Hi! I'm excited to see EMR Serverless. I went through the quick start and was able to run the word count, pretty cool.
Now I would like to submit a spark job using command-runner.jar like I do on a...
1
answers
0
votes
1105
views
asked a year agolg...
Need to create an emr cluster with custom ubuntu image. While I tried to use market place ubuntu image to create the cluster, I got an error stating that EMR cluster can not be created with multiple...
1
answers
0
votes
250
views
asked a year agolg...
**Question**
Is there a limitation in EMR Serverless that prevents the `spark-streaming-kinesis-asl_2.12` library from reading / writing to the DynamoDb lease table? When running a kinesis streaming...
0
answers
0
votes
132
views
asked a year agolg...
Hi, I want to run a job on EMR serverless which reads and writes data from postgresql. I downloaded the jar file and pushed it to s3 and set "spark.jars" in Spark properties in management console....
1
answers
0
votes
1053
views
asked a year agolg...
Hi everyone.
I´m unable to add extra libraries to emr serverless. Here an example..I'm trying to simply add requests..I get error on job status failed:
ModuleNotFoundError: No module named...
4
answers
0
votes
1677
views
asked a year agolg...
I am very new to MLOps and seeking guidance on how to put a piece of ML python code into production on AWS.
Here are my requirements:
1. Model is run once a week
2. Pick up very large data files from...
1
answers
0
votes
341
views
asked a year agolg...
Hello.
Could you advice what instruments is more suitable for migrate a Spark app to AWS? :
The Spark applicaiton is for change data only, without any UI. We started it time-to-time, may be several...
1
answers
0
votes
263
views
asked a year agolg...