New user sign up using AWS Builder ID is currently unavailable on re:Post. To sign up, please use the AWS Management Console instead.
Questions tagged with Amazon Kinesis Data Streams
Amazon Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at any scale.
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
119 results
My previous post: [https://repost.aws/questions/QUj4XJYpDOSIKftobhiOsNpQ#ANzFBcnc_-SHCxxAuNMWPvIw
]()
We're building a custom Node.js consumer for Kinesis Data Streams and intentionally avoiding KCL d...
I'm working on a Node.js application that polls from AWS Kinesis and pushes to Event Hubs. We have multiple poller instances where each poller needs to handle certain shards. Currently, we distribute ...
For our Kinesis Data Streams setup, we're observing automatic retries on throttling errors, specifically `ProvisionedThroughputExceededException`. We have our own exponential backoff mechanism in plac...
What are the main differences between a Data Lake and a Data Warehouse in AWS? I am working on a project and would like guidance on how to decide which one is better suited for specific use cases and ...
asked 15 days ago
I am currently using AWS Lambda as a consumer for my Kinesis Data Streams. Here are the details of my setup:
- **Kinesis Stream Configuration:**
- **Number of Shards:** 8
- **Event Source Setting...
We have some IoT devices using AWS IoT Core that send data every 15 min to a lambda that deserializes and uploads to a Timestream database. I recently came across Kinesis Data Streams and it sounds l...
Description:
We're seeking clarification on the behavior of GetIteratorAge metric in Kinesis Data Streams (KDS), as we're observing what appears to be unexpected behavior with iterator aging.
Current...
Description:
We are experiencing consistent throttling with our Kinesis Data Stream (KDS) and seeking guidance on the root cause and resolution. Our key observations suggest the throttling behavior mi...
I have a simple python code of Flink. I am consuming the data from the kafka and then sinking it to opensearch. I have used state and timers for this which is working fine in my local machine.
I am ...
We have requirement to transfer data from Snowflake to Redshift in Real time. The details are as follows,
- Snowflake will be sending the data in real time for the required views.
- These need to be p...
Hi,
My product is multi-tenant and each tenant is having isolated AWS RDS PostgreSQL DB. I have over 2000 tenants i.e. 2000 RDS dbs and over a period it will grow continuously.
My product is kind o...
Situation
- There are 2 Lambda functions subscribing an active DDB stream from a DDB table.
- I found that I can subscribe at most 2 lambda functions for a DDB stream.
- So I want to migrate event str...