Questions tagged with Amazon EMR Serverless

Run big data applications using open-source frameworks without managing clusters and servers

Content language: English

Select tags to filter
Sort by most recent

Browse through the questions and answers listed below or filter and sort to narrow down your results.

120 results
Hello, I'm trying to use custom certificates to be used by Spark to make a connection to a database. I'm using lambda function to start an EMR cluster. The certificates are stored in ACM. I haven'...
1
answers
0
votes
88
views
asked 14 days ago
Currently using EMR Jupyter notebooks created using EMR workspaces and I could see by default Jupyter notebook jobs option is not available there. I had tried steps posted in [this blog](https://blog....
1
answers
0
votes
53
views
asked 14 days ago
Hello Team, Followed https://github.com/aws-samples/aws-emr-utilities/blob/main/utilities/emr-ec2-custom-python3/README.md#2-container-images-on-yarn Getting issues when we followed to deploy with d...
2
answers
0
votes
49
views
asked 23 days ago
I'm working with AWS EMR Serverless, and I need to construct a job URL for an EMR Serverless job to be sent in a message notification in case of state change. The desired URL includes the associated E...
1
answers
0
votes
70
views
asked a month ago
I noticed that SageMaker Unified now includes features like the Glue ETL Editor and Jupyter Notebook integration. This seems to provide a unified environment for data integration and machine learning ...
1
answers
0
votes
195
views
asked 2 months ago
I have added the tags at job level in EMR Serverless to analyse costs for each job but cannot see the tags in cost explorer after 24 hours. And I see the tags in the Tag editor with resource type bei...
3
answers
0
votes
259
views
asked 4 months ago
Hi. I have set up an EMR Serverless application and i am using my custom image. I've configured everything properly. Next, I've created a custom image according to the official docs: https://docs.a...
2
answers
0
votes
205
views
asked 5 months ago
I have been experiencing quite a few problems with Spark and Kinesis, and wanted to clarify my understanding of it. Say I have the following logic: Subscribe to stream Event arrives and RDD...
1
answers
0
votes
104
views
asked 5 months ago
Hi, creating workspaces in EMR Studio and I get this error, Open failed Workspace(notebook) is stopped. Service Role does not have the required permissions. I dont see anywhere under workspace or app...
1
answers
0
votes
104
views
asked 5 months ago
Hi Team, We are using emr serverless image v7.0.0.0 for data ingestion activities. However, this image has hudi-related jars that have a few vulnerabilities. is it possible to remove these jars from ...
1
answers
0
votes
112
views
asked 6 months ago
Hi Team, we are using the EMR serverless v7.0.0 base image for the ETL tasks. A critical vulnerability failure occurs on the below file during container scanning using the inspector. How to get this...
2
answers
0
votes
107
views
asked 6 months ago
I have been testing out using Livy endpoint from a EMR serverless application according to this documentation: https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/interactive-workloads-liv...
1
answers
0
votes
253
views
asked 6 months ago