EMR upgrade with AL2

1

I have a emr 5.29 cluster running spark and hive application and received notification that AL1 will be unsupported after Dec 23. I am working on applications migration to emr 5.36. Questions,

  1. What happened incase the upgrade not complete and can I access my cluster after the EOL?
  2. Any suggestions to migrate hdfs data to higher version? Thanks in advance.
Mark
demandé il y a 6 mois218 vues
1 réponse
3
Réponse acceptée

Hello, Please refer the answers below,

1. What happened in case the upgrade not complete and can I access my cluster after the EOL?

Answer: Once the maintenance phase ends, the AMI 1 will no longer be supported and you will not receive any critical or important security updates. Older versions of the AMI and updated packages will continue to be available for launch in Amazon EC2 and for installation from the Amazon Linux AMI yum repository even after new Amazon Linux AMI versions are released. However, we encourage customers to move to, and to use, the latest version of the Amazon Linux AMI in order to ensure the best customer experience that we can provide.

2. Any suggestions to migrate hdfs data to higher version? 

Answer: Use Distcp or S3DistCp tool to achieve this. S3DistCp is similar to DistCp, but optimized to work with AWS, particularly Amazon S3. You can copy data across EMR clusters through EMRFS(which is strongly consistent). Here is the document for reference,

https://repost.aws/knowledge-center/copy-s3-hdfs-emr

https://aws.amazon.com/blogs/big-data/seven-tips-for-using-s3distcp-on-amazon-emr-to-move-data-efficiently-between-hdfs-and-amazon-s3/

AWS
INGÉNIEUR EN ASSISTANCE TECHNIQUE
répondu il y a 6 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions