Unanswered Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am running a Scala spark job on EMR serverless and am trying to pass a postgresql JDBC connector jar through Spark's --driver-class-path config. This is how my spark submit configs look
```
--class...
0
answers
0
votes
30
views
asked 10 hours agolg...
I'm running an EMR Serverless Spark job that uses Delta OSS to handle Delta tables. I previously resolved a configuration issue with EMR Serverless and AWS Glue Data Catalog...
0
answers
0
votes
90
views
asked 4 days agolg...
Made an emr application with custom resources - specifically changed executors have more cores and more memory (different amount of memeory from default change for that number of cores, but within the...
0
answers
0
votes
121
views
asked a month agolg...
question deletedlg...
question deleted question deleted
0
answers
0
votes
141
views
asked 2 months agolg...
AWS EMR: Unexpected error when trying to retrieve Serverless applications. Please try again later.lg...
I have created an EMR studio, a serverless application and a workspace. I followed the steps described in the documentation [Getting started with EMR...
0
answers
0
votes
151
views
asked 3 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
154
views
asked 3 months agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
116
views
asked 4 months agolg...
Hi team,
Could you please advise how to set the timezone property for a job in EMR serverless. We have created an application in the Singapore timezone,however, the current_timestamp function is...
0
answers
0
votes
104
views
asked 4 months agolg...
I'm running into an issue where I have certain properties, such as EMR secret resolution and package resolution that are not working when I define them as spark defaults in the job configuration file...
0
answers
0
votes
110
views
asked 7 months agolg...
**Question**
Is there a limitation in EMR Serverless that prevents the `spark-streaming-kinesis-asl_2.12` library from reading / writing to the DynamoDb lease table? When running a kinesis streaming...
0
answers
0
votes
132
views
asked a year agolg...
The following script does not create the table in the S3 location indicated by the query.
I tested it locally and the Delta Json file is created and contains the information about the created...
0
answers
0
votes
144
views
asked 2 years agolg...
## Main problem
I understand that is no need to add Auto Scaling to an EMR cluster launched by Data Pipeline. Instead, we can specify the **capacity up-front** and it will be used for the duration of...
0
answers
0
votes
140
views
asked 2 years agolg...
- 1
- 12 / page