Questions tagged with Amazon Kinesis Data Streams
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
When using Kinesis firehose to opensearch / elasticsearch, while the delivery stream is super convenient, one major limitation I find is that one cannot override the timestamp field that is use to...
0
answers
0
votes
126
views
asked 2 years agolg...
I am trying to connect Neptune and OpenSearch, i have 1 main problem to address.
1)we have 2 clusters of neptune, each rebuild themselves with newdata everyday so everyday we get a new graph, how do i...
1
answers
0
votes
914
views
asked 2 years agolg...
Hello
Im trying to find which boto3 call should return the SCN/LSN number being processed by a given DMS. This is important to measure the delay / keep up of DMS with the origin server
Reference:...
1
answers
0
votes
671
views
asked 2 years agolg...
I transferred data from RDS to Kinesis using DMS but I am not able to transfer data from Kinesis Data Stream to Redshift using Glue ETL Process. So can anyone help me with it?
1
answers
0
votes
1351
views
asked 2 years agolg...
Given a producer sending records to a stream by calling the `PutRecord` action, is there any way to enforce that the producer is calling `PutRecord` with a specific partition key?
I've checked this...
1
answers
0
votes
992
views
asked 2 years agolg...
Hello,
I'm having a problem with linking the Kinesis Firehose aws greengrass component to the AWS Kinesis Service, so i would like to know why it's not working even with following the documentation...
1
answers
1
votes
519
views
asked 2 years agolg...
Hi, Im trying to update my current KCL 2.4 application to work with multiple streams using the MultiStreamTracker setup. The intial app was created using the tutorial as a base...
0
answers
1
votes
151
views
asked 2 years agolg...
Hi, I was wanting to "securely" stream data from a rack i have in an ISP to my AWS Lambda instance. I was wondering what the best solution might be? I thought of something sort of vpn and perhaps...
2
answers
0
votes
309
views
asked 2 years agolg...
I was looking at ways in which we can ingest data using Kinesis data streams without creating an IAM user & generating access & security tokens.
Possible alternatives I have found include:
1. Let...
2
answers
0
votes
753
views
asked 2 years agolg...
Hi, the current pipeline I am implementing involves a Kinesis Data Stream -> Kinesis Delivery Stream -> S3 route, however when setting the buffer intervals (Both s3 and transformation) to near 5...
2
answers
0
votes
550
views
asked 2 years agolg...
From [AWS docs](https://docs.aws.amazon.com/streams/latest/dev/troubleshooting-consumers.html):
"The most common cause of skipped records is an unhandled exception thrown from processRecords. The...
0
answers
0
votes
122
views
asked 2 years agolg...
I use a Kinesis Data Stream connected to a Kinesis Firehose (Delivery stream). Some data failed to write a below message.
```
Throttling error encountered when calling Kinesis. This can be due to...
3
answers
0
votes
4912
views
asked 2 years agolg...