Questions tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello, i am having some trouble for a bit to setup event patterns for EKS and MSK. I want a more detailed monitoring but have been trying to at least get the cluster state change as an event but...
1
answers
0
votes
683
views
asked 8 months agolg...
I created an msk cluster with Unauthenticated and IAM authentication but when I try to contact the brokers from my spring boot app it fails. I entered the bootstrap-server endpoints in the...
0
answers
0
votes
80
views
asked 8 months agolg...
I've upgraded AWS MSK service from 3.4.0 to 3.5.1, without changing any other configurations. After upgrade I see a lot of DEBUG message in CloudWatch Logs for AWS MSK Partition:
```
[2023-10-10...
1
answers
0
votes
143
views
asked 8 months agolg...
Hi there!
I have a lambda function triggered by a kafka topic from an MSK serverless cluster. I am adding thousands of messages at a time in very short bursts (~7000 messages in each batch) and am...
2
answers
0
votes
520
views
asked 8 months agolg...
MSK provides multiple security option like IAM Access control, Mutual TLS authentication and SASL/SCRAM and AWS recommends to use IAM Access control. But i am not clear in which usecase i need to use...
1
answers
0
votes
631
views
asked 8 months agolg...
As I am new to using AWS streaming technologies (such as: Kafka, Kinesis, Flink, etc.) it has been challenging to wrap my mind around all that is available and to establish a proper approach despite...
3
answers
0
votes
355
views
asked 8 months agolg...
Is there an option to collect the Kafka headers when consuming a Kafka topic in kinesis firehose? If not I think it would be a great improvement.
2
answers
0
votes
321
views
asked 8 months agolg...
I am working on POC to migrate from Debezium to AWS DMS for PostgreSQL. PostgreSQL as Source and Kafka as Destination (AWS MSK). In Debezium i used to see before and after image for updates, but in...
2
answers
0
votes
456
views
asked 9 months agolg...
We're using MSK for asynchronous messaging. Somoetimes some issues happen in consuming some messages and I need to know what messages are currently inside msk. Is there a GUI tool (from aws or 3rd...
Accepted AnswerAmazon Managed Streaming for Apache Kafka (Amazon MSK)
2
answers
0
votes
1065
views
asked 9 months agolg...
Lets say I have a kafka cluster having three brokers running in a different subnets.
out of them only one is public and other two are private. public is attached to a NAT gateway, and private subnets...
1
answers
0
votes
387
views
asked 9 months agolg...
I am able to send the data by using below code in python and not receiving the message at consumer end. I have enabled all the authentications. I am able to send and received with kafka commands. i...
0
answers
0
votes
92
views
asked 9 months agolg...
When I try to update MSK cluster config to the latest version I get an error
```
The number of partitions per broker is above the recommended limit. Add more brokers and rearrange the partitions per...
3
answers
0
votes
1980
views
asked 9 months agolg...