Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
* below CF stack is failing with this error "Resource handler returned message: Error occurred during operation 'CreateApplication'." (RequestToken: <some-token-id>, HandlerErrorCode:...
1
answers
0
votes
442
views
asked a year agolg...
Hi,
I finally got my pyspark code to mostly work using an EMR Serverless application, but according to the logs it seems like there is a particular problem with this line
```
if...
Accepted AnswerAmazon EMR Serverless
2
answers
0
votes
1036
views
asked a year agolg...
Hi,
are there any plans for EMR Serverless service to utilize Spot capacity? Similar e.g. to Fargate Spot for ECS.
Thank you,
Nikos
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
452
views
asked a year agolg...
I have an EMR Serverless PySpark job I am launching from a step function. I am trying to pass arguments to SparkSubmit from the entryPointArguments in the form of variables set in the beginning of the...
1
answers
0
votes
1272
views
asked a year agolg...
EMR serverless job Spark UI/history server is not accessible once application restart.
Application is configured with below options to reduce cost.
[Auto start application-
Automatically starts on...
1
answers
0
votes
839
views
asked a year agolg...
Hi,
I run EMR serverless jobs at the top of every hour. All the jobs are submitted to the same Application with no pre-initialized capacity. Is there any benefit from terminating the application...
2
answers
0
votes
1362
views
asked a year agolg...
I understand there are application limits for EMR serverless. But when there are multiple jobs running at the same time on the same application, is it possible for them to share workers' available...
1
answers
0
votes
679
views
asked a year agolg...
With Redshift Serverless you need a certain amount of available private IPs in your VPC, so I was wondering if it's similar here, and, if so, how many IPs?
1
answers
0
votes
526
views
asked a year agolg...
Is there a way to utilize EMR Serverless to run S3DistCp? Looking at the base Docker images, I can see that the `s3-dist-cp` command is included in the Hive image. How can I submit a job run that runs...
1
answers
0
votes
447
views
asked a year agolg...
Does EMR serverless use YARN for resource management? What is the default resource management tool used by EMR serverless?
1
answers
0
votes
543
views
asked a year agolg...
I am trying to access S3 buckets (DEV env) from EMR on EKS (INT env) cluster running on different accounts. I have created the IAM roles and configurations following the guide on [EMR on EKS...
1
answers
0
votes
547
views
asked a year agolg...
Hello, i tried run JNI code which uses the file as a dependency lib**MylibName**.so. Before(not in EMR Serverless) i can use it just specify
**--conf spark.driver.extraLibraryPath=/path_to_my_lib...
1
answers
0
votes
969
views
asked a year agolg...