All Content tagged with Amazon EMR Serverless

**Goal : minimize the compute costs** Amazon EMR cluster that is using the EMR File System (EMRFS) Customer is asking if shutting down primary nodes can help reducing their compute cost. They also h...

I am launching a EMR Serverless using my root account in AWS Console. But when I select a kernel it gives me the following error: Error Starting Kernel HTTP 403: Forbidden (Authorization Error: User ...

Python 3.9 will reach end of life on October 30, 2025. The latest version of EMR Serverless - 7.9.0 - still uses Python 3.9.22 in its reference image: https://gallery.ecr.aws/emr-serverless/spark/emr...

Hi, i have a use case where, i want to access/read my prod glue table data from emr serverless application job so i am running one job on non prod emr serverless application studio, which needs to a...

Hello, I am a new AWS user, I failed to create a EMR serverless studio with the message "Failed to create Studio. Failed to create Serverless application. [object Object]" for interactive workloads un...

Hello, For the experiment I took the image public.ecr.aws/emr-serverless/spark/emr-7.8.0:20250425-x86_64, since I am building on a Mac, which is an 8-core 2.3GHz Intel Core i9. link default images h...

Amazon EMR on EKS allows Spark workloads to run on EKS-managed infrastructure, giving users the flexibility to optimize cost by leveraging EC2 Spot Instances. Spot Instances are a great way to reduce ...

The documentation explains how to add a Git Repository but doesn't go into any details on whether or not this is supported with EMR Serverless. I've tried, unsuccessfully, to add in a Git Repository ...

I use EMR Serverless applications and use custom image based on EMR 7.6.0. That works fine with my pipelines. I am currently using a single tag for my images that I store in ECR. I am quite confident ...

I have created sagemaker unified studio using manual setup method, I have created project within the domain having project profile of "All Capabilities" also I have created and added new compute of em...

I was trying to connect to an on-prem Elasticsearch cluster from a PySpark notebook hosted on EMR serverless. While I can connect to the ES cluster successfully with with socket.create_connecti...

Hello, I'm trying to use custom certificates to be used by Spark to make a connection to a database. I'm using lambda function to start an EMR cluster. The certificates are stored in ACM. I haven'...