Connect Amazon MSK cluster to on-premises web server?
I am trying out AWS MSK and created a cluster following the tutorial. What I want to know is, how can I connect my on-premises web sever to the created cluster as a producer. The tutorial only mention how to use AWS MSK with ec2 instance. Is there any other tutorial or blog post that I can refer to?
There are several methods to connect to your AWS MSK clusters outside of your VPC.
VPC Peering: https://docs.aws.amazon.com/vpc/latest/peering/what-is-vpc-peering.html
VPC Transit Gateway: https://docs.aws.amazon.com/vpc/latest/tgw/what-is-transit-gateway.html
AWS Direct Connect: https://aws.amazon.com/directconnect/
REST Proxy: A REST proxy can be installed on an instance running within your VPC. REST proxies allow your producers and consumers to communicate to the cluster through HTTP API requests.
This stackoverflow article describes a way for on-premise machines to access the MSK cluster through a kafka Rest Proxy framework.
Hope this helps,
Thanks I will check the confluent rest proxy.
How to delete Custom Msk Connect Pluginasked 7 months ago
MSK ebs snapshotasked 2 years ago
Unable to delete MSK Clusterasked a year ago
Unable to connect to redis cluster with node client, what am I doing wrong?asked 6 months ago
How can I change pw and access my web server instance?asked 9 months ago
Connect Amazon MSK cluster to on-premises web server?Accepted Answerasked 3 years ago
MSK connect connector deploymentasked 12 days ago
How to Integrate a Kinesis Data Analytics Flink Application with a Self-Managed Kafka Cluster Running on Amazon EC2 (not Amazon MSK)?Accepted Answerasked 2 years ago
How to reset offset of a consumer group created through MSK connectasked 2 months ago
Amazon Connect - Web Chat Client Reference ImplementationAccepted Answerasked 3 years ago