Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

Connecting to Kafka MSK serverless from another VPC

1

I'm trying to set up a connection between my EKS cluster running in its own VPC and a serverless Kafka cluster (MSK) which is running in a default VPC. I have established VPC peering, with DNS resolving options enabled both ways. DNS hostnames and DNS resolution is enabled in the corresponding VPCs as well. But DNS resolution for the Kafka endpoint (boot-xxxxx.c1.kafka-serverless.us-east-1.amazonaws.com) is not working from the EKS VPC. I checked and re-checked all possible configurations including security groups and everything but cannot find a solution. I also made sure that peering works but connecting to the actual IP address of kafka is not viable because kafka redirects to other endpoints which again are not resolvable.

Topics
AnalyticsContainersNetworking & Content Delivery
Tags
Amazon VPCAmazon Managed Streaming for Apache Kafka (Amazon MSK)Amazon Elastic Kubernetes Service
Language
English
asked 3 years ago1.8K views
2 Answers
0

Routing works and internal name resolving (instance names) also works between VPCs, however the endpoint name (which seems to be a public entry: ".amazonaws.com") is not

answered 3 years ago
  • Riku_Kobayashi EXPERT
    3 years ago

    By the way, what error do you get when you try to access MSK from EKS? Can you please share the original text of the error?

0

Can I use nslookup to resolve the DNS name of the Kafka cluster from EC2, etc. in an EKS VPC?
Have you configured the route table after VPC peering?

EXPERT
answered 3 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content