How to connect Glue to MSK with IAM authentication?
When setting up a Glue Connection for our MSK cluster configured woth IAM authentication, the broker disconnects the connection from Glue jobs using the connection with a message that says SASL failed. We have given ghe role used on the Glue job full permission. Is it currently possible to connect using IAM authentication?
Currently, AWS Glue does not integrate with Amazon MSK clusters configured to use AWS IAM access control.
You can connect to MSK clusters using IAM Access Control from other AWS services, such as Amazon EMR and Amazon Kinesis Data Analytics. In these cases, you configure the Kafka client to use MSK IAM authentication.
Also, AWS Lambda has its own integration with MSK clusters using IAM Access Control, through an Event Source Mapping. By taking this approach, the Kafka client is configured for you.
Relevant questions
AWS MSK IAM Authentication with MSK Connect
asked 5 months agoHow do you setup cross-account IAM authentication in AWS MSK?
Accepted Answerasked 4 months agoUsing MSK as trigger to a Lambda with SASL/SCRAM Authentication
asked a month agoAmazon MSK Authentication and Authorization
asked 6 months agoAWS Glue - setting data target for RDS mysql
asked 2 months agoHow to configure Glue Connection to successfuly connect to Oracle RDS Using NNE (Not SSL)
asked 3 months agoHow to connect Glue to MSK with IAM authentication?
asked 7 months agoMSK Connect Debezium Connector using AWS Glue Schema Registry for AVRO serialization
asked 5 months agoAWS Glue Schema Registry and MSK Connect Integration for AVRO Schema
asked 2 months agoLambda MSK trigger not working
asked 2 years ago