EMR upgrade with AL2

1

I have a emr 5.29 cluster running spark and hive application and received notification that AL1 will be unsupported after Dec 23. I am working on applications migration to emr 5.36. Questions,

  1. What happened incase the upgrade not complete and can I access my cluster after the EOL?
  2. Any suggestions to migrate hdfs data to higher version? Thanks in advance.
Mark
已提问 6 个月前218 查看次数
1 回答
3
已接受的回答

Hello, Please refer the answers below,

1. What happened in case the upgrade not complete and can I access my cluster after the EOL?

Answer: Once the maintenance phase ends, the AMI 1 will no longer be supported and you will not receive any critical or important security updates. Older versions of the AMI and updated packages will continue to be available for launch in Amazon EC2 and for installation from the Amazon Linux AMI yum repository even after new Amazon Linux AMI versions are released. However, we encourage customers to move to, and to use, the latest version of the Amazon Linux AMI in order to ensure the best customer experience that we can provide.

2. Any suggestions to migrate hdfs data to higher version? 

Answer: Use Distcp or S3DistCp tool to achieve this. S3DistCp is similar to DistCp, but optimized to work with AWS, particularly Amazon S3. You can copy data across EMR clusters through EMRFS(which is strongly consistent). Here is the document for reference,

https://repost.aws/knowledge-center/copy-s3-hdfs-emr

https://aws.amazon.com/blogs/big-data/seven-tips-for-using-s3distcp-on-amazon-emr-to-move-data-efficiently-between-hdfs-and-amazon-s3/

AWS
支持工程师
已回答 6 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则