Unanswered Questions tagged with Amazon Managed Streaming for Apache Kafka (Amazon MSK)
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
MSK connectors are trying to create s3 sink connectors. At this time, schema uses the schema in the Glue schema registry, and the goal is to store avro schema in s3 in parquet format.
Below is the...
0
answers
0
votes
319
views
asked 3 months agolg...
**What I'm trying to do:**
I want to run the Python file in EC2 to send data to MSK, and I want to save the data in MSK in Parquet format in S3 through the Sink connector.
**Problem:**
An error...
0
answers
0
votes
321
views
asked 3 months agolg...
![Enter image description here](/media/postImages/original/IMsCdSahucQjqNNIkdr0VPDw)
![Enter image description here](/media/postImages/original/IM8yhsUwYIQi6-xqogiklOuw)
Hi
AWS Kafka not working...
0
answers
0
votes
313
views
asked 4 months agolg...
I'm using an IoT rule to publish IoT data with Managed Service Kafka (MSK). However, I frequently encounter the following error, causing messages to be missing.
It generally works well, but what...
0
answers
0
votes
331
views
asked 4 months agolg...
In our architecture we have data from AWS MSK being ingested into AWS Redshift using the Amazon Redshift Streaming Ingestion feature. In this approach, we define an external schema where we have the...
0
answers
0
votes
110
views
asked 4 months agolg...
Is it possible to use MSK connect in AWS and connect to a Confluent Managed Broker for the connect cluster?
Essentially set the CONNECT_BOOTSTRAP_SERVERS to broker from a VPC peered Confluent Kafka...
0
answers
0
votes
84
views
asked 5 months agolg...
I created an msk cluster with Unauthenticated and IAM authentication but when I try to contact the brokers from my spring boot app it fails. I entered the bootstrap-server endpoints in the...
0
answers
0
votes
61
views
asked 6 months agolg...
I am able to send the data by using below code in python and not receiving the message at consumer end. I have enabled all the authentications. I am able to send and received with kafka commands. i...
0
answers
0
votes
69
views
asked 6 months agolg...
I try to use aws msk connector to connect my kafka with elastic.io elasticsearch I use https://github.com/confluentinc/kafka-connect-elasticsearch plugin.
I'm getting all the time error ERROR Failed...
0
answers
0
votes
102
views
asked 8 months agolg...
If i want to run a terraform script to create a MSK cluster with terraform CLI installed on EC2 situated in a private subnet (without any path to internet). Will a service role assigned to EC2 to...
0
answers
0
votes
51
views
asked 8 months agolg...
So considering this post https://aws.amazon.com/blogs/industries/building-a-core-banking-system-with-amazon-quantum-ledger-database/
- We are processing a realtime transaction (means that user swiped...
0
answers
0
votes
49
views
asked 9 months agolg...
If we have a batch or some program to call 300k records one by one and to send it to REST endpoint one at a time to pull the json response in 500 lines so in that flow what could be the best...
0
answers
0
votes
158
views
asked a year agolg...