Access Secrets using VPC EndPoint in Kafka Event-source in EventBridge Pipes

1

**Scenario: **

  • MSK Cluster is in private subnet of VPC-1 and I am trying to create an EventBridge Pipe in VPC2 that gets data from the MSK cluster
  • VPC-1 and VPC-2 are connected using VPC peering
  • Kafka authentication details are stored in Secrets Manager
  • I am using "Self managed Apache Kafka" for Event source as both VPCs are in differet AWS accounts.

It works if I configure NAT gateway in VPC2. Is it possible to achieve the same functionality using VPC Endpoints?

Problem

  • I have deleted NAT gateway and I have created VPC endpoint for Secrets Manager as Event Source will need to access Kafka authentication information.
  • Also, added STS VPC endpoint
  • This setup fails to start the EventBridge Pipe with error message "PROBLEM: Pipe VPC event source require outbound internet access to send events to Pipes"

EventSource Setup

1 回答
1
已接受的回答

Adding the answer for community:

EvenBridge supports VPC interface endpoints but not for MSK/Self-Managed Kafka /Amazon MQ. So this is not a network issue but rather service support.

We need route out to internet to be able to use "Self Managed Kafka Event Source" in EventBridge Pipe.

已回答 9 个月前
profile picture
专家
已审核 2 个月前

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则