Unanswered Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am executing pyspark script on EMR serverless and i am using AWS step function for creating EMR application and submitting job in it. I want to know how to add logging option in AWS step function...
0
answers
0
votes
140
views
asked 3 days agolg...
Made an emr application with custom resources - specifically changed executors have more cores and more memory (different amount of memeory from default change for that number of cores, but within the...
0
answers
0
votes
45
views
asked 10 days agolg...
question deletedlg...
question deleted question deleted
0
answers
0
votes
75
views
asked 17 days agolg...
AWS EMR: Unexpected error when trying to retrieve Serverless applications. Please try again later.lg...
I have created an EMR studio, a serverless application and a workspace. I followed the steps described in the documentation [Getting started with EMR...
0
answers
0
votes
132
views
asked 2 months agolg...
Trying to figure out if it's possible to use AWS Glue crawler to parse the spark stderr logs that are dumped from emr-serverless.
The logs are space delimited. I tried running a crawler against the...
0
answers
0
votes
139
views
asked 2 months agolg...
I am trying to use aws emr-serverless get-dashboard-for-job-run cli command to pull information from emr-serverless but am stumped. This command returns a url and auth token. If I go to the url, it...
0
answers
0
votes
80
views
asked 3 months agolg...
Hi team,
Could you please advise how to set the timezone property for a job in EMR serverless. We have created an application in the Singapore timezone,however, the current_timestamp function is...
0
answers
0
votes
93
views
asked 3 months agolg...
I'm running into an issue where I have certain properties, such as EMR secret resolution and package resolution that are not working when I define them as spark defaults in the job configuration file...
0
answers
0
votes
103
views
asked 6 months agolg...
**Question**
Is there a limitation in EMR Serverless that prevents the `spark-streaming-kinesis-asl_2.12` library from reading / writing to the DynamoDb lease table? When running a kinesis streaming...
0
answers
0
votes
122
views
asked a year agolg...
The following script does not create the table in the S3 location indicated by the query.
I tested it locally and the Delta Json file is created and contains the information about the created...
0
answers
0
votes
142
views
asked a year agolg...
## Main problem
I understand that is no need to add Auto Scaling to an EMR cluster launched by Data Pipeline. Instead, we can specify the **capacity up-front** and it will be used for the duration of...
0
answers
0
votes
85
views
asked 2 years agolg...
- 1
- 12 / page