EventBridge + Kinesis

Question

We're trying to send an event to EventBridge after a producer publishes to a Kinesis Data Stream. We then want to configure EventBridge api destination to send event to Salesforce and create a platform event.
 
Kinesis -> EventBridge-> Rule+ Bus + Api Destination-> Salesforce

1) We first thought that we can setup a rule on EventBridge so that certain kinesis events based on filtering criteria can be routed to an event bus. We were unsuccessful to find any kinesis events routed to EventBridge. **Do we need an additional layer between Kinesis and EventBridge? **

2) We then tried lambda based approach. Wrote a lambda with Kinesis as trigger and EventBridge as destination. While we saw lambda function getting executed but destination never gets invoked. On further research it seems that on success destination isn't supported on a lambda where Kinesis is configured as trigger. Can someone confirm this?

Looking for some guidance on if pattern 1 and pattern 2 are at all feasible and any pointers on implementation.

Accepted Answer

1. Yes, you will need some compute such as a Lambda function. The function will get the records from Kinesis and write them to EventBridge.
2. You are correct, Lambda destinations are only available for asynchronous invocation and Kinesis is not asynchronous (it is called Event source mapping). You should write code in the function that iterates over the records in the payload and sends them to the bus using the EventBridge API.

Your architecture should look like: Kinesis -> Lambda -> EventBridge -> API Destination -> Salesforce.

Answer

Thank you Uri. That did it. Added code in lambda to push event to EventBridge. Thanks for the help.

EventBridge + Kinesis

Relevant questions

How to convince EventBridge to pass S3 event information to an ecs target?

What are the pros/cons and use cases of using EventBridge, Lambda with queues, and SNS for event-driven architectures?

EventBridge input transformation between salesforce event to target API?

EventBridge max EventBuses on event path

EventBridge API Destination Connection Without Authentication

Unable to send event via EventBridge

Lambda Events not triggering EventBridge destination

EventBridge API Destination Connection AWS Secretes Manager Pricing