EMR in 2 AZs and High Availability
Can you deploy multiple EMR master nodes in different AZs and failover between them? Or - how do I make my EMR cluster HA?
Can you schedule core nodes in 2 AZs?
- Le plus récent
- Le plus de votes
- La plupart des commentaires
No, currently Amazon EMR always launch all the nodes (master, core task) in a single AZ. With Instance fleet option you can specify multiple subnet while launching the cluster, however EMR will automatically pick one subnet (AZ) (based on best availability of nodes ).
With EMR multi master feature, EMR does launch 3 master nodes however they will be in same AZs only. Multi master feature is to reduce the probability of cluster termination due to master node termination. (which is a single point of failure in case of single master node cluster). In addition to that it does implement HA functionality for HDFS Namenode, Yarn Resource manager, Hbase master etc...
I have founded a reference what it can help you.
Is it safe to say that , in terms of availability EMR serverless would be a better option than EMR ?
Contenus pertinents
- demandé il y a 10 mois
- demandé il y a un an
- demandé il y a un an
- demandé il y a un an
AWS OFFICIELA mis à jour il y a un an- AWS OFFICIELA mis à jour il y a 2 ans
- AWS OFFICIELA mis à jour il y a 10 mois
- AWS OFFICIELA mis à jour il y a un an
