- Newest
- Most votes
- Most comments
Answering my own question: TinyBird connects to MSK directly, without the need for MSK Connect.
What kind of events are you sending to Tinybird? How often do you need to send them? Do you have any specific requirements for latency or reliability? These questions might help you decide if MSK Connect is a good choice for your use case.
MSK Connect is a feature of Amazon MSK that makes it easy for developers to stream data to and from their Apache Kafka clusters. MSK Connect uses Kafka Connect 2.7.1, an open-source framework for connecting Apache Kafka clusters with external systems such as databases, search indexes, and file systems (Reference). However, Amazon MSK does not provide managed connectors, so you have to use 3rd party connectors or run them yourself. I could not find any official integration between Tinybird and MSK Connect.
But Tinybird does provide an example in their blog where they connected directly to Kafka https://www.tinybird.co/blog-posts/comparing-tinybird-to-aws-kinesis-s3-glue-and-athena
Relevant content
- asked a year ago
- asked 3 months ago
- asked 8 months ago
AWS OFFICIALUpdated a year ago- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 5 months ago
Exactly - I found out that Tinybird connects directly to Kafka, so MSK Connect is not required. Thank you!