Questions tagged with Amazon Kinesis Data Streams
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello,
I'm trying to figure out the best way to output messages to SNS from a Flink Kinesis Analytics application. My understanding is firehose has ~60s of latency, which is not acceptable for this...
1
answers
0
votes
991
views
asked 2 years agolg...
Hi,
I am working on a system that uses kinesis to ingest data, this data is then processed by a lambda function and kinesis delivery stream. We have CloudWatch alarms set up that trigger if the...
1
answers
0
votes
2493
views
asked 2 years agolg...
When using Kinesis firehose to opensearch / elasticsearch, while the delivery stream is super convenient, one major limitation I find is that one cannot override the timestamp field that is use to...
0
answers
0
votes
128
views
asked 2 years agolg...
I am trying to connect Neptune and OpenSearch, i have 1 main problem to address.
1)we have 2 clusters of neptune, each rebuild themselves with newdata everyday so everyday we get a new graph, how do i...
1
answers
0
votes
923
views
asked 2 years agolg...
Hello
Im trying to find which boto3 call should return the SCN/LSN number being processed by a given DMS. This is important to measure the delay / keep up of DMS with the origin server
Reference:...
1
answers
0
votes
682
views
asked 2 years agolg...
I transferred data from RDS to Kinesis using DMS but I am not able to transfer data from Kinesis Data Stream to Redshift using Glue ETL Process. So can anyone help me with it?
1
answers
0
votes
1357
views
asked 2 years agolg...
Given a producer sending records to a stream by calling the `PutRecord` action, is there any way to enforce that the producer is calling `PutRecord` with a specific partition key?
I've checked this...
1
answers
0
votes
1000
views
asked 2 years agolg...
Hello,
I'm having a problem with linking the Kinesis Firehose aws greengrass component to the AWS Kinesis Service, so i would like to know why it's not working even with following the documentation...
1
answers
1
votes
523
views
asked 2 years agolg...
Hi, Im trying to update my current KCL 2.4 application to work with multiple streams using the MultiStreamTracker setup. The intial app was created using the tutorial as a base...
0
answers
1
votes
156
views
asked 2 years agolg...
Hi, I was wanting to "securely" stream data from a rack i have in an ISP to my AWS Lambda instance. I was wondering what the best solution might be? I thought of something sort of vpn and perhaps...
2
answers
0
votes
314
views
asked 2 years agolg...
I was looking at ways in which we can ingest data using Kinesis data streams without creating an IAM user & generating access & security tokens.
Possible alternatives I have found include:
1. Let...
2
answers
0
votes
760
views
asked 2 years agolg...
Hi, the current pipeline I am implementing involves a Kinesis Data Stream -> Kinesis Delivery Stream -> S3 route, however when setting the buffer intervals (Both s3 and transformation) to near 5...
2
answers
0
votes
556
views
asked 2 years agolg...