- Newest
- Most votes
- Most comments
Thank you for your question about upgrading Kinesis Studio Notebooks and the compatibility with newer Flink versions. I understand your concern about the current limitations you're experiencing with the Zeppelin version and Flink runtime compatibility.
As of now, Amazon Managed Service for Apache Flink (formerly known as Amazon Kinesis Data Analytics for Apache Flink) is aware of the need to upgrade the Zeppelin Flink Interpreter to support newer versions of Apache Flink. The current recommended and fully supported runtime for Studio notebooks is Apache Flink 1.15 with Apache Zeppelin 0.10.
For Flink versions 1.18, 1.19, and 1.20, an upgrade to Zeppelin's Flink Interpreter is required to enable support. This work is scheduled and is being coordinated with the Zeppelin community. However, as of now, there isn't a specific timeline provided for when this upgrade will be completed.
In the meantime, you can continue using Flink 1.15 with Amazon Managed Service for Apache Flink Studio. This version is fully supported and will not be deprecated in the near future.
For users who need to use newer Flink versions (1.18, 1.19, or 1.20) for their applications, it's possible to create and run these applications using the service, but the Studio notebook experience with these versions is not yet available due to the pending Zeppelin upgrade.
Amazon Web Services is aware of the importance of this upgrade and is working on it, but they have not published a specific timeline for its completion. They recommend checking their documentation and release notes regularly for updates on this matter.
If you need to use features from newer Flink versions, you might need to consider alternative development approaches outside of Studio notebooks until the Zeppelin upgrade is completed. However, for most use cases, Flink 1.15 should still be capable of handling a wide range of stream processing tasks effectively.
Sources
Use the correct Studio notebook Runtime version - Managed Service for Apache Flink
Amazon Managed Service for Apache Flink 1.18 - Managed Service for Apache Flink
Amazon Managed Service for Apache Flink 1.19 - Managed Service for Apache Flink
Amazon Managed Service for Apache Flink 1.20 - Managed Service for Apache Flink
Relevant content
- asked 2 years ago
- asked 3 years ago
- asked 2 years ago
