Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
119
views
asked 4 months agolg...
Hi team,
Could you please advise how to set the timezone property for a job in EMR serverless. We have created an application in the Singapore timezone,however, the current_timestamp function is...
0
answers
0
votes
105
views
asked 4 months agolg...
The application is working in EMR cluster , but failing in EMR serverless though the base image is emr 6.15.0
Accepted AnswerAmazon EMR Serverless
4
answers
0
votes
474
views
asked 4 months agolg...
I am trying to see if I can use EMR Serverless to serve as a compute engine for customers querying data in S3. But even with pre-initialized capacity, the simplest of queries possible (select 1+2 as...
1
answers
0
votes
167
views
asked 4 months agolg...
I run one application without pre-initialized capability in Emr serverless and thr explicit limit set to 40vCPUs, 300gb memory, 2000gb disk. After the every job execution, resources utilization and...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
207
views
asked 4 months agolg...
We are using EMR serverless to process the data, but we find for the same data size, EMR serverless consume different amounts of resource, such as vCPU-hours, memoryGB-hours and storageGB-hours.
I...
1
answers
0
votes
163
views
asked 5 months agolg...
After setting up a Hadoop cluster on AWS, I've noticed that when I attempt to stop the instances once I'm done with my work for the day and plan to resume the next day, the instances are automatically...
1
answers
0
votes
266
views
asked 6 months agolg...
Hi 👋, I have a couple of questions in emr serverless networking configuration.
1. I know public subnet is not recommended in backend, but it is not allowed in emr serverless. Any reason why only...
Accepted AnswerAmazon EMR Serverless
1
answers
2
votes
485
views
asked 6 months agolg...
I'm running into an issue where I have certain properties, such as EMR secret resolution and package resolution that are not working when I define them as spark defaults in the job configuration file...
0
answers
0
votes
111
views
asked 7 months agolg...
We have a pyspark job which we are executing to connect with MongoDB using the mongo-spark-connector.
The job is executed successfully with no errors in the stdout log file and in the stderr log file...
1
answers
0
votes
413
views
asked 7 months agolg...
Please help me understand the difference between the three( EMR , ECS And EMR studio) , and when any of these should be used as all three are used for managing and creating clusters. Thanks
1
answers
0
votes
474
views
asked 7 months agolg...
Getting this error when trying to run a simple spark job which reads a json file from s3 and prints the...
2
answers
0
votes
449
views
asked 7 months agolg...