Connecting to Kafka MSK serverless from another VPC

1

I'm trying to set up a connection between my EKS cluster running in its own VPC and a serverless Kafka cluster (MSK) which is running in a default VPC. I have established VPC peering, with DNS resolving options enabled both ways. DNS hostnames and DNS resolution is enabled in the corresponding VPCs as well. But DNS resolution for the Kafka endpoint (boot-xxxxx.c1.kafka-serverless.us-east-1.amazonaws.com) is not working from the EKS VPC. I checked and re-checked all possible configurations including security groups and everything but cannot find a solution. I also made sure that peering works but connecting to the actual IP address of kafka is not viable because kafka redirects to other endpoints which again are not resolvable.

2 Risposte
0

Routing works and internal name resolving (instance names) also works between VPCs, however the endpoint name (which seems to be a public entry: ".amazonaws.com") is not

con risposta un anno fa
  • By the way, what error do you get when you try to access MSK from EKS? Can you please share the original text of the error?

0

Can I use nslookup to resolve the DNS name of the Kafka cluster from EC2, etc. in an EKS VPC?
Have you configured the route table after VPC peering?

profile picture
ESPERTO
con risposta un anno fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande