AWS MSK - Creating a client Machine
- Have created an AWS MSK Cluster and created an AWS Client Machine Windows 2019 t2.xlarge instance type.
- Both the MSK Cluster and the AWS Client Machine reside on the same VPC and the appropriate security groups have being assigned.
I am unable to connect from the client machine, its giving client socket connection issues ( though the security groups looks proper) The Tutorial @https://docs.aws.amazon.com/msk/latest/developerguide/create-topic.html is mostly for Linux. So instead of it I am using the equivalent windows batch files in \kafka\bin\windows/ E.g. kafka-topics.bat file.
For the Windows Version, do we have to start the Kafka Server and Zookeeper ? Can you please let me know if in Windows Client Machine the commands are different ?
Since you started MSK cluster are you sure that the cluster is at the correct VPC and subnet? Make sure the Subnet has proper NACL and Security Group set with corresponding Routing table in VPC. If all are good then finally you can move to your client.properties .
client.properties has many flavours you can go with PLAINTEXT or SASL_SSL . If your MSK has public endpoint then you probably cannot do PLAINTEXT but if its private then you can use PLAINTEXT make sure to keep "security.protocol" to either one of those value.
Client properties settings Reference: Tutorial for PlainText : https://docs.aws.amazon.com/msk/latest/developerguide/create-topic.html Tutorial For SASL : https://docs.aws.amazon.com/msk/latest/developerguide/create-serverless-cluster-client.html
AWS MSK serverlessasked a month ago
Cloudformation support for creating configurationsasked 3 years ago
AWS MSK - Creating a client Machineasked a month ago
Aws MSK security behaviour when both IAM and SCRAM enabledAccepted Answerasked 6 months ago
Unable to delete MSK Clusterasked a year ago
How to connect Glue to MSK with IAM authentication?asked 7 months ago
Lambda MSK trigger not workingasked 2 years ago
MSK Custom Configuration using Cloudformationasked 4 months ago
MSK instance size using CDKAccepted Answerasked 2 months ago
Using a subordinate certificate authority from ACM Private CA for mTLS client certificate authentication with MSKasked 5 months ago