Questions tagged with Amazon Kinesis
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
What is the AWS recommended way for using Kinesis as a Source with Apache Spark Structured Streaming if running Spark jobs on EMR (not AWS Glue).
There is a [third party open source connector...
0
answers
0
votes
131
views
asked 2 years agolg...
I'm trying to stream a CCTV camera with RTSP URL using Amazon Kinesis Video Streams. I've tested the URL in VLC Player and it works fine there. Have also tested the same using ffplay.
The command...
1
answers
0
votes
321
views
asked 2 years agolg...
how to you mange application state when using KCL.
I create a simple application which will save my application state on efs when creating checkpoint, but the state is per shard. it willnot work when...
0
answers
0
votes
105
views
asked 2 years agolg...
How does data flow as you scale up Kinesis Data Steams and add KPU's to Kinesis Data Analytics.lg...
I have an event processing architecture that's basically KPL Producer -> Kinesis Data Streams(Raw) -> KDA(Flink Aggregation) -> Kinesis Data Streams(Agg) -> Lambda -> Timestream . With a basic setup...
1
answers
0
votes
293
views
asked 2 years agolg...
Error:
HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced. The column 'isfallbackkey' in table...
0
answers
0
votes
205
views
asked 2 years agolg...
My one AWS hosted application need to send PDF or DOC or JPG any format files to http, SQS , https type subscriptions through SNS. Is it possible? Can you please provide any AWS reference tutorial...
2
answers
0
votes
5294
views
asked 2 years agolg...
In the documentation (https://docs.aws.amazon.com/firehose/latest/dev/controlling-access.html ), there are 2 set of IPs for us to whitelist when using Splunk or RedShift as Kinesis Data Firehose...
0
answers
0
votes
118
views
asked 2 years agolg...
I am using KCL 1.14.8 for Java. My Kinesis only have one shard, and I put a record into Kinesis every 30 seconds. For each record, the RecordProcessor will process it, processing each record may take...
0
answers
0
votes
132
views
asked 2 years agolg...
I am hoping to create a stream of messages, and the stream will be defined by providing an S3 bucket + prefix, and will stream:
1. a list of all existing objects at the given prefix
2. new objects...
0
answers
0
votes
148
views
asked 2 years agolg...
I am consuming Amazon Connect CTRs through Amazon Kinesis and inserting my data into Postgres. I am facing very unexpected behavior from Kinesis and Lambda function. Whenever a CTR record comes...
2
answers
0
votes
318
views
asked 2 years agolg...
Hi,
I am working on a system that uses kinesis to ingest data, this data is then processed by a lambda function and kinesis delivery stream. We have CloudWatch alarms set up that trigger if the...
1
answers
0
votes
2418
views
asked 2 years agolg...
When hooking up a lambda to a kinesis stream, the event source can choose a starting position. Settings like TRIM_HORIZON and timestamps allow to replay data that is already in the stream. When using...
1
answers
0
votes
1682
views
asked 2 years agolg...