Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi everyone.
I´m unable to add extra libraries to emr serverless. Here an example..I'm trying to simply add requests..I get error on job status failed:
ModuleNotFoundError: No module named...
4
answers
0
votes
1838
views
asked a year agolg...
I am very new to MLOps and seeking guidance on how to put a piece of ML python code into production on AWS.
Here are my requirements:
1. Model is run once a week
2. Pick up very large data files from...
1
answers
0
votes
373
views
asked a year agolg...
Hello.
Could you advice what instruments is more suitable for migrate a Spark app to AWS? :
The Spark applicaiton is for change data only, without any UI. We started it time-to-time, may be several...
1
answers
0
votes
284
views
asked a year agolg...
* below CF stack is failing with this error "Resource handler returned message: Error occurred during operation 'CreateApplication'." (RequestToken: <some-token-id>, HandlerErrorCode:...
1
answers
0
votes
477
views
asked a year agolg...
Hi,
I finally got my pyspark code to mostly work using an EMR Serverless application, but according to the logs it seems like there is a particular problem with this line
```
if...
Accepted AnswerAmazon EMR Serverless
2
answers
0
votes
1152
views
asked a year agolg...
Hi,
are there any plans for EMR Serverless service to utilize Spot capacity? Similar e.g. to Fargate Spot for ECS.
Thank you,
Nikos
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
522
views
asked a year agolg...
I have an EMR Serverless PySpark job I am launching from a step function. I am trying to pass arguments to SparkSubmit from the entryPointArguments in the form of variables set in the beginning of the...
1
answers
0
votes
1395
views
asked a year agolg...
EMR serverless job Spark UI/history server is not accessible once application restart.
Application is configured with below options to reduce cost.
[Auto start application-
Automatically starts on...
1
answers
0
votes
1013
views
asked a year agolg...
Hi,
I run EMR serverless jobs at the top of every hour. All the jobs are submitted to the same Application with no pre-initialized capacity. Is there any benefit from terminating the application...
2
answers
0
votes
1486
views
asked a year agolg...
I understand there are application limits for EMR serverless. But when there are multiple jobs running at the same time on the same application, is it possible for them to share workers' available...
1
answers
0
votes
721
views
asked a year agolg...
With Redshift Serverless you need a certain amount of available private IPs in your VPC, so I was wondering if it's similar here, and, if so, how many IPs?
1
answers
0
votes
571
views
asked a year agolg...
Is there a way to utilize EMR Serverless to run S3DistCp? Looking at the base Docker images, I can see that the `s3-dist-cp` command is included in the Hive image. How can I submit a job run that runs...
1
answers
0
votes
495
views
asked a year agolg...