All Content tagged with Amazon Kinesis Data Streams

Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale.

Content language: English

Select tags to filter
Sort by most recent
126 results
Hello! **I'm trying to develop a telephone AI agent by using the following resources:** - Amazon Connect - Amazon Contact Lens - Amazon Kinesis Data Streams - Amazon Lambda **After having created a...
1
answers
0
votes
50
views
asked 2 days ago
Hello, I am using API Gateway REST to track custom events from different e-commerce stores. The endpoint then posts the data to Kinesis firehose, which will batch the records to S3. Flow: API gateway...
2
answers
0
votes
45
views
asked 8 days ago
I'm migrating data from one DynamoDB table in one account to DynamoDB table in another account. I'm following the strategy as in the blog below: https://aws.amazon.com/blogs/database/cross-account-rep...
2
answers
0
votes
79
views
asked 2 months ago
Hello! I have a system design / architecture problem. Context: The ultimate goal is to ingest battery data from an MQTT broker -> process this data to keep track of each data points state (charging,...
1
answers
0
votes
122
views
asked 3 months ago
A company has one million users that use its mobile app. The company must analyze the data usage in near-real time. The company also must encrypt the data in near-real time and must store the data in ...
2
answers
0
votes
79
views
asked 3 months ago
I am using AWS Database Migration Service (DMS) to replicate Change Data Capture (CDC) data from Aurora PostgreSQL Serverless to Amazon Kinesis Data Streams. My Aurora PostgreSQL source endpoint works...
1
answers
0
votes
132
views
asked 3 months ago
My previous post: [https://repost.aws/questions/QUj4XJYpDOSIKftobhiOsNpQ#ANzFBcnc_-SHCxxAuNMWPvIw ]() We're building a custom Node.js consumer for Kinesis Data Streams and intentionally avoiding KCL d...
1
answers
0
votes
63
views
asked 4 months ago
I'm working on a Node.js application that polls from AWS Kinesis and pushes to Event Hubs. We have multiple poller instances where each poller needs to handle certain shards. Currently, we distribute ...
2
answers
0
votes
173
views
asked 4 months ago
For our Kinesis Data Streams setup, we're observing automatic retries on throttling errors, specifically `ProvisionedThroughputExceededException`. We have our own exponential backoff mechanism in plac...
1
answers
0
votes
447
views
asked 4 months ago
What are the main differences between a Data Lake and a Data Warehouse in AWS? I am working on a project and would like guidance on how to decide which one is better suited for specific use cases and ...
2
answers
1
votes
103
views
profile picture
asked 5 months ago
I am currently using AWS Lambda as a consumer for my Kinesis Data Streams. Here are the details of my setup: - **Kinesis Stream Configuration:** - **Number of Shards:** 8 - **Event Source Setting...
3
answers
0
votes
196
views
asked 5 months ago
We have some IoT devices using AWS IoT Core that send data every 15 min to a lambda that deserializes and uploads to a Timestream database. I recently came across Kinesis Data Streams and it sounds l...
2
answers
0
votes
289
views
asked 6 months ago