1 Resposta
- Mais recentes
- Mais votos
- Mais comentários
1
This has been an outstanding issue until YARN-9554 which is fixed in Hadoop 3.3.0. However, EMR as of now packages only 3.2.1 in the latest EMR-6.7.0. I can confirm there is work underway to backport this to 3.2.1 for EMR which should be included in the upcoming release of EMR.
As a workaround you can do the following:
Login to the Master node of the EMR cluster to run the below commands or bake them as a bash script to submit it as a scriptrunner - EMR Step using console / CLI / SDK
- Add logging properties to JRE
echo 'com.sun.jersey.server.wadl.generators.level = OFF' | sudo tee -a /etc/alternatives/jre/lib/logging.properties > /dev/null
- Restart the Timeline Server to apply the changes
sudo systemctl restart hadoop-yarn-timelineserver
Please test the same in your lower environments and reply back if you have additional questions regarding the same.
Conteúdo relevante
- AWS OFICIALAtualizada há um ano
- AWS OFICIALAtualizada há 2 anos
- AWS OFICIALAtualizada há um ano
- AWS OFICIALAtualizada há um ano
Thanks. It works well. I will add it as EMR step.