Questions tagged with Amazon Kinesis Data Streams
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello
Im trying to find which boto3 call should return the SCN/LSN number being processed by a given DMS. This is important to measure the delay / keep up of DMS with the origin server
Reference:...
1
answers
0
votes
638
views
asked 2 years agolg...
I transferred data from RDS to Kinesis using DMS but I am not able to transfer data from Kinesis Data Stream to Redshift using Glue ETL Process. So can anyone help me with it?
1
answers
0
votes
1314
views
asked 2 years agolg...
Given a producer sending records to a stream by calling the `PutRecord` action, is there any way to enforce that the producer is calling `PutRecord` with a specific partition key?
I've checked this...
1
answers
0
votes
967
views
asked 2 years agolg...
Hello,
I'm having a problem with linking the Kinesis Firehose aws greengrass component to the AWS Kinesis Service, so i would like to know why it's not working even with following the documentation...
1
answers
1
votes
488
views
asked 2 years agolg...
Hi, Im trying to update my current KCL 2.4 application to work with multiple streams using the MultiStreamTracker setup. The intial app was created using the tutorial as a base...
0
answers
1
votes
142
views
asked 2 years agolg...
Hi, I was wanting to "securely" stream data from a rack i have in an ISP to my AWS Lambda instance. I was wondering what the best solution might be? I thought of something sort of vpn and perhaps...
2
answers
0
votes
290
views
asked 2 years agolg...
I was looking at ways in which we can ingest data using Kinesis data streams without creating an IAM user & generating access & security tokens.
Possible alternatives I have found include:
1. Let...
2
answers
0
votes
710
views
asked 2 years agolg...
Hi, the current pipeline I am implementing involves a Kinesis Data Stream -> Kinesis Delivery Stream -> S3 route, however when setting the buffer intervals (Both s3 and transformation) to near 5...
2
answers
0
votes
506
views
asked 2 years agolg...
From [AWS docs](https://docs.aws.amazon.com/streams/latest/dev/troubleshooting-consumers.html):
"The most common cause of skipped records is an unhandled exception thrown from processRecords. The...
0
answers
0
votes
116
views
asked 2 years agolg...
I use a Kinesis Data Stream connected to a Kinesis Firehose (Delivery stream). Some data failed to write a below message.
```
Throttling error encountered when calling Kinesis. This can be due to...
3
answers
0
votes
4775
views
asked 2 years agolg...
i am trying to consume data using python script from kinesis data stream which is created successfully and data is produced or streamed to it successfully , but when running consumer script in python...
2
answers
0
votes
992
views
asked 2 years agolg...
Hi, looking for some load testing tool to send data to kinesis data stream. Came across kinesis data generator ( https://awslabs.github.io/amazon-kinesis-data-generator/web/producer.html) but running...
1
answers
0
votes
731
views
asked 2 years agolg...