EMR on EKS Anywhere

0

I want to run EMR On-Premises, no Spark.

The question, is possible to run EMR (https://aws.amazon.com/emr/) on EKS Anywhere (https://aws.amazon.com/es/eks/eks-anywhere/)

Also, we don't have support to run AWS Outposts.

profile picture
demandé il y a 3 mois323 vues
1 réponse
2
Réponse acceptée

No, it is not possible to run Amazon EMR on Amazon EKS Anywhere. Amazon EKS Anywhere is a managed Kubernetes service that allows you to run Kubernetes in any environment, whether connected or disconnected from AWS.

However, Amazon EMR is a managed cluster service that is optimized to run on AWS infrastructure like EC2 instances or EKS clusters. Please bear in mind the following:

  • EKS Anywhere does not integrate with the Kubernetes Cluster API Provider for AWS, which is required for EMR to provision and manage clusters.
  • EMR relies on various AWS services under the hood for features like automated scaling, monitoring, logging etc. These would not be available on EKS Anywhere clusters outside of AWS.
  • Managing EMR clusters involves using AWS APIs and CLI commands. This level of integration with AWS control plane would not translate to other environments.

If your requirement is to run EMR workloads on-premises without an internet connection to AWS, then EKS Anywhere is not suitable. The best option would be to install and manage the open-source Hadoop/Spark components directly on an on-prem Kubernetes cluster.

profile picture
EXPERT
répondu il y a 3 mois
profile picture
EXPERT
vérifié il y a 2 mois
profile picture
EXPERT
vérifié il y a 2 mois
  • Thank you so much for your support.

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions