Questions tagged with Amazon Kinesis Data Streams
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello
Im trying to find which boto3 call should return the SCN/LSN number being processed by a given DMS. This is important to measure the delay / keep up of DMS with the origin server
Reference:...
1
answers
0
votes
623
views
asked 2 years agolg...
I transferred data from RDS to Kinesis using DMS but I am not able to transfer data from Kinesis Data Stream to Redshift using Glue ETL Process. So can anyone help me with it?
1
answers
0
votes
1295
views
asked 2 years agolg...
Given a producer sending records to a stream by calling the `PutRecord` action, is there any way to enforce that the producer is calling `PutRecord` with a specific partition key?
I've checked this...
1
answers
0
votes
957
views
asked 2 years agolg...
Hello,
I'm having a problem with linking the Kinesis Firehose aws greengrass component to the AWS Kinesis Service, so i would like to know why it's not working even with following the documentation...
1
answers
1
votes
474
views
asked 2 years agolg...
Hi, Im trying to update my current KCL 2.4 application to work with multiple streams using the MultiStreamTracker setup. The intial app was created using the tutorial as a base...
0
answers
1
votes
138
views
asked 2 years agolg...
Hi, I was wanting to "securely" stream data from a rack i have in an ISP to my AWS Lambda instance. I was wondering what the best solution might be? I thought of something sort of vpn and perhaps...
2
answers
0
votes
283
views
asked 2 years agolg...
I was looking at ways in which we can ingest data using Kinesis data streams without creating an IAM user & generating access & security tokens.
Possible alternatives I have found include:
1. Let...
2
answers
0
votes
693
views
asked 2 years agolg...
Hi, the current pipeline I am implementing involves a Kinesis Data Stream -> Kinesis Delivery Stream -> S3 route, however when setting the buffer intervals (Both s3 and transformation) to near 5...
2
answers
0
votes
482
views
asked 2 years agolg...
From [AWS docs](https://docs.aws.amazon.com/streams/latest/dev/troubleshooting-consumers.html):
"The most common cause of skipped records is an unhandled exception thrown from processRecords. The...
0
answers
0
votes
113
views
asked 2 years agolg...
I use a Kinesis Data Stream connected to a Kinesis Firehose (Delivery stream). Some data failed to write a below message.
```
Throttling error encountered when calling Kinesis. This can be due to...
3
answers
0
votes
4707
views
asked 2 years agolg...
i am trying to consume data using python script from kinesis data stream which is created successfully and data is produced or streamed to it successfully , but when running consumer script in python...
2
answers
0
votes
976
views
asked 2 years agolg...
Hi, looking for some load testing tool to send data to kinesis data stream. Came across kinesis data generator ( https://awslabs.github.io/amazon-kinesis-data-generator/web/producer.html) but running...
1
answers
0
votes
717
views
asked 2 years agolg...