By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

Connecting to Kafka MSK serverless from another VPC

1

I'm trying to set up a connection between my EKS cluster running in its own VPC and a serverless Kafka cluster (MSK) which is running in a default VPC. I have established VPC peering, with DNS resolving options enabled both ways. DNS hostnames and DNS resolution is enabled in the corresponding VPCs as well. But DNS resolution for the Kafka endpoint (boot-xxxxx.c1.kafka-serverless.us-east-1.amazonaws.com) is not working from the EKS VPC. I checked and re-checked all possible configurations including security groups and everything but cannot find a solution. I also made sure that peering works but connecting to the actual IP address of kafka is not viable because kafka redirects to other endpoints which again are not resolvable.

Topics
Networking & Content DeliveryContainersAnalytics
Tags
Amazon VPCAmazon Elastic Kubernetes ServiceAmazon Managed Streaming for Apache Kafka (Amazon MSK)
Language
English
rePost-User-3708223
asked a year ago1000 views
2 Answers
0

Routing works and internal name resolving (instance names) also works between VPCs, however the endpoint name (which seems to be a public entry: ".amazonaws.com") is not

rePost-User-3708223
answered a year ago
  • Riku_Kobayashi EXPERT
    a year ago

    By the way, what error do you get when you try to access MSK from EKS? Can you please share the original text of the error?

0

Can I use nslookup to resolve the DNS name of the Kafka cluster from EC2, etc. in an EKS VPC?
Have you configured the route table after VPC peering?

profile picture
EXPERT
Riku_Kobayashi
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content