All Content tagged with Amazon EMR Serverless

Amazon EMR on EKS allows Spark workloads to run on EKS-managed infrastructure, giving users the flexibility to optimize cost by leveraging EC2 Spot Instances. Spot Instances are a great way to reduce ...

The documentation explains how to add a Git Repository but doesn't go into any details on whether or not this is supported with EMR Serverless. I've tried, unsuccessfully, to add in a Git Repository ...

I use EMR Serverless applications and use custom image based on EMR 7.6.0. That works fine with my pipelines. I am currently using a single tag for my images that I store in ECR. I am quite confident ...

I have created sagemaker unified studio using manual setup method, I have created project within the domain having project profile of "All Capabilities" also I have created and added new compute of em...

I was trying to connect to an on-prem Elasticsearch cluster from a PySpark notebook hosted on EMR serverless. While I can connect to the ES cluster successfully with with socket.create_connecti...

Hello, I'm trying to use custom certificates to be used by Spark to make a connection to a database. I'm using lambda function to start an EMR cluster. The certificates are stored in ACM. I haven'...

Currently using EMR Jupyter notebooks created using EMR workspaces and I could see by default Jupyter notebook jobs option is not available there. I had tried steps posted in [this blog](https://blog....

Hello Team, Followed https://github.com/aws-samples/aws-emr-utilities/blob/main/utilities/emr-ec2-custom-python3/README.md#2-container-images-on-yarn Getting issues when we followed to deploy with d...

I'm working with AWS EMR Serverless, and I need to construct a job URL for an EMR Serverless job to be sent in a message notification in case of state change. The desired URL includes the associated E...

I noticed that SageMaker Unified now includes features like the Glue ETL Editor and Jupyter Notebook integration. This seems to provide a unified environment for data integration and machine learning ...