Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Is there a way to utilize EMR Serverless to run S3DistCp? Looking at the base Docker images, I can see that the `s3-dist-cp` command is included in the Hive image. How can I submit a job run that runs...
1
answers
0
votes
506
views
asked a year agolg...
Does EMR serverless use YARN for resource management? What is the default resource management tool used by EMR serverless?
1
answers
0
votes
614
views
asked a year agolg...
I am trying to access S3 buckets (DEV env) from EMR on EKS (INT env) cluster running on different accounts. I have created the IAM roles and configurations following the guide on [EMR on EKS...
1
answers
0
votes
609
views
asked a year agolg...
Hello, i tried run JNI code which uses the file as a dependency lib**MylibName**.so. Before(not in EMR Serverless) i can use it just specify
**--conf spark.driver.extraLibraryPath=/path_to_my_lib...
1
answers
0
votes
1037
views
asked a year agolg...
Hello,
I am evaluating EMR Serverless and I have read in the documentation how you can package your Python dependencies into a virtual environment tarball and upload that to S3, then declare it in...
Accepted AnswerAmazon EMR Serverless
1
answers
0
votes
461
views
asked 2 years agolg...
How can a root CA certificate required by an EMR Serverless application be added to Java's TrustStore, or, alternatively, how can the location of a custom TrustStore be specified? In my case the...
7
answers
0
votes
2437
views
asked 2 years agolg...
I suggest ths.
emr err.log tail=100 lines.
because we want to see last end of log file.
please make this feature.
thx a lot
1
answers
0
votes
298
views
asked 2 years agolg...
Hi, I need to install Go packages that interact with my Spark script. Is it possible to do such things ?
2
answers
0
votes
1221
views
asked 2 years agolg...
Trying to share data between two spark jobs in an EMR serverless application using temp or global temp views without having to write to s3 and then do read. It doesn't seem to work.
What is the...
1
answers
0
votes
293
views
asked 2 years agolg...
The following script does not create the table in the S3 location indicated by the query.
I tested it locally and the Delta Json file is created and contains the information about the created...
0
answers
0
votes
161
views
asked 2 years agolg...
I developed a data processing application using Hive on EMR EC2. I'm trying to run the same code on EMR Serverless and am getting the following exception:
`Job failed with Execution Error, return...
1
answers
0
votes
356
views
asked 2 years agolg...
When configuring an EMR Serverless application, you can choose the disk size for your preinitialized capacity and a maximum disk limit for the application:
![Disk...
1
answers
0
votes
1227
views
asked 2 years agolg...