EMR - UNHEALHTY nodes & HDFS utilization

0

Hi,

some doubts about why my EMR clusters are failing. As you can see on the image below, I have a cluster which utilizes HDFS (but only with peaks of 5% of utilization), and while its running a job suddenly the nodes start to be marked as UNHEALTHY.

Enter image description here

Knowing that the cluster has a 95% of HDFS free space. The reason of having UNHEALTHY nodes is that they are running out of space on their Instance Storage volumes (local EBS)? (due to some temporary files, for example). Should I add/increase the EBSs volumes on the cluster's nodes?

posta 2 anni fa781 visualizzazioni
1 Risposta
0

Hi,

Yes, increasing the EBS volume for nodes might help.

Thanks

con risposta 2 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande