EMR upgrade with AL2

1

I have a emr 5.29 cluster running spark and hive application and received notification that AL1 will be unsupported after Dec 23. I am working on applications migration to emr 5.36. Questions,

  1. What happened incase the upgrade not complete and can I access my cluster after the EOL?
  2. Any suggestions to migrate hdfs data to higher version? Thanks in advance.
Mark
질문됨 6달 전218회 조회
1개 답변
3
수락된 답변

Hello, Please refer the answers below,

1. What happened in case the upgrade not complete and can I access my cluster after the EOL?

Answer: Once the maintenance phase ends, the AMI 1 will no longer be supported and you will not receive any critical or important security updates. Older versions of the AMI and updated packages will continue to be available for launch in Amazon EC2 and for installation from the Amazon Linux AMI yum repository even after new Amazon Linux AMI versions are released. However, we encourage customers to move to, and to use, the latest version of the Amazon Linux AMI in order to ensure the best customer experience that we can provide.

2. Any suggestions to migrate hdfs data to higher version? 

Answer: Use Distcp or S3DistCp tool to achieve this. S3DistCp is similar to DistCp, but optimized to work with AWS, particularly Amazon S3. You can copy data across EMR clusters through EMRFS(which is strongly consistent). Here is the document for reference,

https://repost.aws/knowledge-center/copy-s3-hdfs-emr

https://aws.amazon.com/blogs/big-data/seven-tips-for-using-s3distcp-on-amazon-emr-to-move-data-efficiently-between-hdfs-and-amazon-s3/

AWS
지원 엔지니어
답변함 6달 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인