Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Made an emr application with custom resources - specifically changed executors have more cores and more memory (different amount of memeory from default change for that number of cores, but within the...
0
answers
0
votes
136
views
asked 2 months agolg...
Hello everyone,
I created a spark_ready.py module that hosts multiple classes that I want to use as a template. I've seen in multiple configurations online that using the "spark.submit.pyFiles" will...
2
answers
0
votes
488
views
asked 2 months agolg...
question deletedlg...
question deleted question deleted
0
answers
0
votes
152
views
asked 2 months agolg...
Is there an option to run parallel jobs in emr serverless application natively
Accepted AnswerAmazon EMR Serverless
2
answers
0
votes
568
views
asked 2 months agolg...
How do I connect EMR Serverless to read and write to a Microsoft SQL Server database hosted on EC2
1
answers
0
votes
231
views
asked 3 months agolg...
We are running into `No space left on device` errors in EMR Serverless for big jobs, even when setting driver / executor drive size to the maximum 200GB.
I tried to make the S3 shuffle storage...
1
answers
0
votes
211
views
asked 3 months agolg...
The job is submitted from MWAA airflow. However, the job failed in airflow and EMR Serverless. The status is mentioned as "The job is pending scheduling" in EMR serverless.
Below is the log captured...
2
answers
0
votes
805
views
asked 3 months agolg...
Hi Experts,
Is there any way we can cancel the job run from the job itself ?. instead of cancelling it from the cancel job api ?.
1
answers
0
votes
149
views
asked 3 months agolg...
hello i'am using EMR Notebook attached to EMR Serverless Application.
i'm wondering how can i get the pricing information? there's nowhere i can find about the price how much i used.
when i execute...
2
answers
0
votes
220
views
asked 3 months agolg...
AWS EMR: Unexpected error when trying to retrieve Serverless applications. Please try again later.lg...
I have created an EMR studio, a serverless application and a workspace. I followed the steps described in the documentation [Getting started with EMR...
0
answers
0
votes
169
views
asked 4 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
162
views
asked 4 months agolg...
Is it safe to say that , in terms of availability EMR serverless would be a better option than EMR ?lg...
I found this [https://repost.aws/questions/QUvOaZvA5BT56skWO0iu2kZA/emr-in-2-azs-and-high-availability]() where it says EMR launch nodes in a single AZ only .
Considering there haven't been much...
1
answers
0
votes
156
views
asked 4 months agolg...