Help us improve AWS re:Post! We're interested in understanding how you use re:Post and its impact on your AWS journey. Please take a moment to complete our brief 3-question survey
All Content tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Amazon MSK makes it easy to ingest and process streaming data in real time with fully managed Apache Kafka.
Content language: English
Select tags to filter
Sort by most recent
347 results
I'm trying to replicate a topic in MSK using MirrorMaker 2, it's good to say as it is Serverless I don't have access to any instances to make sure that the jar is really present on the machine (classp...
I'm using lambda with a trigger of kafka, to consume info from a MSK of other account.
We have connection between the two aws accounts.
The other team, share with us the .jks file, and with this, we g...
I already noticed Best practices for Standard brokers(https://docs.aws.amazon.com/msk/latest/developerguide/bestpractices.html).
But I think the post related to Zookeeper not KRaft cluster.
I know th...
Hi,
I am encountering the below error when i an trying to interact with AWS MSK Cluster from my local machine. Has anyone encountered that before?
Error:
**This may happen due to any of the followin...
My customer is having trouble to configure the MSK Connect worker to pass the SSL certificates. Looking at the MSK worker documentation it doesn't seem to configure the SSL certificates at the worker ...
asked 16 days ago
Could anyone help me out? I have stuck on load balances the kafka records to my consumers
This is my MSK set up
Each zone has 1 broker
EXPERT
published a month ago0 votes245 views
By default, Apache Kafka has a maximum message size limit of 1MB. While large messages are generally considered an anti-pattern in Kafka, there are scenarios where you might need to handle messages la...
EXPERT
published a month ago0 votes232 views
When using AWS Lambda as a Kafka producer, you need to include a Kafka client library. This guide demonstrates how to integrate Kafka client libraries for Python and Node.js in your Lambda functions t...
Data Flow Path: Multiple *SQS Queues -> Lambda Instances -> MSK Topic*
Lambda and MSK are in same VPC/subnets.
We need to finalise the best option for establishing/configuring the authentication betwe...
When will MSK support Kafka 3.8.1 and 3.9.0?
I have MSK cluster with both IAM and SASL SCRAM enabled and I want using IAM authentication put ACL on topic, I get this error message
The client is not authorized to send this request
NB : I am able ...
Hi,
I have a provisioned cluster with 2 brokers (kafka.m5.large). I have set up an cloudwatch alarm to monitor HeapMemoryAfterGC if it goes over 60% as mentioned in best practices.
Every alternate d...