Questions tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
What secure options to connect from off the cloud to a VPC, or specifically a MSK Kafka cluster, as a producer?
I'm aware there's PrivateLink, VPC peering, and Transit Gateway between VPCs, but I'm...
2
answers
0
votes
115
views
asked 2 months agolg...
I'm looking to connect a service that will send messages to a Kafka, MSK serverless cluster. The service itself is in another account and in a different region from the MSK cluster.
I followed this...
1
answers
0
votes
146
views
asked 2 months agolg...
I have followed the implementation guide for the AWS clickstream solution, currently using Kinesis on demand, sinking to an S3 bucket (just following the steps in the setup). I'm not bothered with...
1
answers
0
votes
234
views
asked 2 months agolg...
Hi,
We're currently building an MSK cluster. We use 2 types of authentication for 2 different clients.
The IAM authentication works fine.
But for the SASL/SCRAM authentication that it's not the...
1
answers
0
votes
160
views
asked 2 months agolg...
I want to horizontally autoscale the AWS MSK cluster but only found documentation related to storage autoscaling. Is there any way to autoscale the AWS MSK cluster ? Any reference to docs or any...
1
answers
0
votes
427
views
asked 2 months agolg...
I am using kafka, kafka connect and debezium to cdc data between 2 postgres databases.
I want to switch to AWS MSK, what combination of services can I use to achieve the above goal
I have to create a...
1
answers
0
votes
89
views
asked 2 months agolg...
See https://docs.aws.amazon.com/msk/latest/developerguide/limits.html. Could you please explain what "connection rate bursts" is? If I google for it, I get just this page and the link mentioned here....
0
answers
0
votes
32
views
asked 2 months agolg...
I have a public reachable Self-Managed Kafka server, sitting on a public subnet. I have created an EventBridge pipe that connects to a topic, reads messages and sends them to an SQS queue. After 24...
2
answers
0
votes
171
views
asked 2 months agolg...
Hi AWS,
I noticed msk replicator **source msk ** prerequisite changed to be with auth enable and version above 2.7.0.
I want to replicate from msk 2.2.1 to msk 3.5.1 is it something which will be...
1
answers
0
votes
96
views
asked 2 months agolg...
We have an MSK cluster , let's call it test-cluster.
While using IAM authentication with confluent-kafka producer client in python, producer tries to write data using transactions to a kafka topic...
4
answers
0
votes
196
views
asked 2 months agolg...
I'm testing the use of MSK Connect with IcebergSinkConnector, but I'm having some difficulty making it work. If anyone has experience with MSK and can help me, that would be great.
I have a topic in...
2
answers
0
votes
249
views
asked 2 months agolg...
In the FAQ it could see the below content
**Q: How does data transfer pricing work?**
With provisioned clusters, you will pay standard AWS data transfer charges for data transferred in and out of an...
1
answers
0
votes
326
views
asked 2 months agolg...