How to Integrate a Kinesis Data Analytics Flink Application with a Self-Managed Kafka Cluster Running on Amazon EC2 (not Amazon MSK)?

0

I am interested to build a real time application with data residing on their Kafka cluster. The Kafka is running on AWS, using K8S not using MSK. What are the step required to integrate Kinesis Data Analytics Flink application with their Kafka cluster?

AWS
Manos_S
已提问 3 年前1201 查看次数
1 回答
0
已接受的回答

It's fairly similar to reading from Amazon MSK. Consuming data from Kafka (or Amazon MSK) with Kinesis Data Analytics (KDA) basically means establishing network connectivity between brokers and task managers. With KDA you can enable VPC support so that the ENIs of the task managers are exposed in the subnets you have specified. If you then configure security groups of the ENIs correctly, your Flink app should be able to connect to the Kafka brokers. See the following references:

已回答 3 年前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则