EMR on EKS Anywhere

0

I want to run EMR On-Premises, no Spark.

The question, is possible to run EMR (https://aws.amazon.com/emr/) on EKS Anywhere (https://aws.amazon.com/es/eks/eks-anywhere/)

Also, we don't have support to run AWS Outposts.

profile picture
preguntada hace 3 meses322 visualizaciones
1 Respuesta
2
Respuesta aceptada

No, it is not possible to run Amazon EMR on Amazon EKS Anywhere. Amazon EKS Anywhere is a managed Kubernetes service that allows you to run Kubernetes in any environment, whether connected or disconnected from AWS.

However, Amazon EMR is a managed cluster service that is optimized to run on AWS infrastructure like EC2 instances or EKS clusters. Please bear in mind the following:

  • EKS Anywhere does not integrate with the Kubernetes Cluster API Provider for AWS, which is required for EMR to provision and manage clusters.
  • EMR relies on various AWS services under the hood for features like automated scaling, monitoring, logging etc. These would not be available on EKS Anywhere clusters outside of AWS.
  • Managing EMR clusters involves using AWS APIs and CLI commands. This level of integration with AWS control plane would not translate to other environments.

If your requirement is to run EMR workloads on-premises without an internet connection to AWS, then EKS Anywhere is not suitable. The best option would be to install and manage the open-source Hadoop/Spark components directly on an on-prem Kubernetes cluster.

profile picture
EXPERTO
respondido hace 2 meses
profile picture
EXPERTO
revisado hace 2 meses
profile picture
EXPERTO
revisado hace 2 meses
  • Thank you so much for your support.

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas