All Content tagged with Amazon EMR Serverless

Run big data applications using open-source frameworks without managing clusters and servers

Content language: English

Select up to 5 tags to filter
Sort by most recent
I have been experiencing quite a few problems with Spark and Kinesis, and wanted to clarify my understanding of it. Say I have the following logic: Subscribe to stream Event arrives and RDD...
1
answers
0
votes
26
views
asked 9 days ago
Hi, creating workspaces in EMR Studio and I get this error, Open failed Workspace(notebook) is stopped. Service Role does not have the required permissions. I dont see anywhere under workspace or...
1
answers
0
votes
20
views
DMM
asked 11 days ago
Hi Team, We are using emr serverless image v7.0.0.0 for data ingestion activities. However, this image has hudi-related jars that have a few vulnerabilities. is it possible to remove these jars from...
1
answers
0
votes
34
views
asked 21 days ago
Hi Team, we are using the EMR serverless v7.0.0 base image for the ETL tasks. A critical vulnerability failure occurs on the below file during container scanning using the inspector. How to get this...
2
answers
0
votes
30
views
asked 23 days ago
I have been testing out using Livy endpoint from a EMR serverless application according to this documentation:...
1
answers
0
votes
61
views
cysung
asked a month ago
I'm using the following: * EMR Serverless 7.1.0 * XGBoost 2.1.1 * PySpark 3.5.0 I'm trying to train an XGBoost model on EMR Serverless using data in a Delta Lake that's stored on s3. I've previously...
0
answers
0
votes
77
views
asked a month ago
EMR Serverless requires the use of a NAT Gateway for outbound Internet access. The link is [here](https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/vpc-access.html). Will AWS consider...
1
answers
0
votes
500
views
asked a month ago
I'm running into this issue when running a spark job on EMR Serverless. ``` ERROR SparkContext: Error initializing SparkContext. java.io.IOException: Mkdirs failed to create...
1
answers
0
votes
84
views
asked 2 months ago
My ultimate goal is to have my EMR Serverless application Internet egress access to invoke a specific third party API/REST call. Unfortunately, the EMR Serverless application must then be put into a...
1
answers
0
votes
533
views
asked 3 months ago