Questions tagged with Amazon Kinesis Data Streams
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hello,
I'm trying to figure out the best way to output messages to SNS from a Flink Kinesis Analytics application. My understanding is firehose has ~60s of latency, which is not acceptable for this...
1
answers
0
votes
992
views
asked 2 years agolg...
Hi,
I am working on a system that uses kinesis to ingest data, this data is then processed by a lambda function and kinesis delivery stream. We have CloudWatch alarms set up that trigger if the...
1
answers
0
votes
2500
views
asked 2 years agolg...
When using Kinesis firehose to opensearch / elasticsearch, while the delivery stream is super convenient, one major limitation I find is that one cannot override the timestamp field that is use to...
0
answers
0
votes
129
views
asked 2 years agolg...
I am trying to connect Neptune and OpenSearch, i have 1 main problem to address.
1)we have 2 clusters of neptune, each rebuild themselves with newdata everyday so everyday we get a new graph, how do i...
1
answers
0
votes
926
views
asked 2 years agolg...
Hello
Im trying to find which boto3 call should return the SCN/LSN number being processed by a given DMS. This is important to measure the delay / keep up of DMS with the origin server
Reference:...
1
answers
0
votes
685
views
asked 2 years agolg...
I transferred data from RDS to Kinesis using DMS but I am not able to transfer data from Kinesis Data Stream to Redshift using Glue ETL Process. So can anyone help me with it?
1
answers
0
votes
1358
views
asked 2 years agolg...
Given a producer sending records to a stream by calling the `PutRecord` action, is there any way to enforce that the producer is calling `PutRecord` with a specific partition key?
I've checked this...
1
answers
0
votes
1002
views
asked 2 years agolg...
Hello,
I'm having a problem with linking the Kinesis Firehose aws greengrass component to the AWS Kinesis Service, so i would like to know why it's not working even with following the documentation...
1
answers
1
votes
524
views
asked 2 years agolg...
Hi, Im trying to update my current KCL 2.4 application to work with multiple streams using the MultiStreamTracker setup. The intial app was created using the tutorial as a base...
0
answers
1
votes
156
views
asked 2 years agolg...
Hi, I was wanting to "securely" stream data from a rack i have in an ISP to my AWS Lambda instance. I was wondering what the best solution might be? I thought of something sort of vpn and perhaps...
2
answers
0
votes
316
views
asked 2 years agolg...
I was looking at ways in which we can ingest data using Kinesis data streams without creating an IAM user & generating access & security tokens.
Possible alternatives I have found include:
1. Let...
2
answers
0
votes
762
views
asked 2 years agolg...
Hi, the current pipeline I am implementing involves a Kinesis Data Stream -> Kinesis Delivery Stream -> S3 route, however when setting the buffer intervals (Both s3 and transformation) to near 5...
2
answers
0
votes
558
views
asked 2 years agolg...