Questions tagged with Amazon Kinesis
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have an on-prem data pipeline with MQTT + Kafka, each containerized locally. Now, I want to enable the upstream connection to the Cloud/Internet with AWS Kinesis, but I need a Kafka/Kinesis...
1
answers
0
votes
221
views
asked 2 years agolg...
We are required to send WAF logs to an external server running rSysLog with several tools already set and configured for traffic analysis.
I perceived that externalization of log data streams are...
1
answers
0
votes
422
views
asked 2 years agolg...
I am only seeing labels in Kinesis frontend. You can see from below screenshot.
![Enter image description here](/media/postImages/original/IMRiKg2J7NRVSk94qJYhDY8Q)
1
answers
0
votes
187
views
asked 2 years agolg...
What is the AWS recommended way for using Kinesis as a Source with Apache Spark Structured Streaming if running Spark jobs on EMR (not AWS Glue).
There is a [third party open source connector...
0
answers
0
votes
132
views
asked 2 years agolg...
I'm trying to stream a CCTV camera with RTSP URL using Amazon Kinesis Video Streams. I've tested the URL in VLC Player and it works fine there. Have also tested the same using ffplay.
The command...
1
answers
0
votes
327
views
asked 2 years agolg...
how to you mange application state when using KCL.
I create a simple application which will save my application state on efs when creating checkpoint, but the state is per shard. it willnot work when...
0
answers
0
votes
109
views
asked 2 years agolg...
How does data flow as you scale up Kinesis Data Steams and add KPU's to Kinesis Data Analytics.lg...
I have an event processing architecture that's basically KPL Producer -> Kinesis Data Streams(Raw) -> KDA(Flink Aggregation) -> Kinesis Data Streams(Agg) -> Lambda -> Timestream . With a basic setup...
1
answers
0
votes
298
views
asked 2 years agolg...
Error:
HIVE_PARTITION_SCHEMA_MISMATCH: There is a mismatch between the table and partition schemas. The types are incompatible and cannot be coerced. The column 'isfallbackkey' in table...
0
answers
0
votes
209
views
asked 2 years agolg...
My one AWS hosted application need to send PDF or DOC or JPG any format files to http, SQS , https type subscriptions through SNS. Is it possible? Can you please provide any AWS reference tutorial...
2
answers
0
votes
5341
views
asked 2 years agolg...
In the documentation (https://docs.aws.amazon.com/firehose/latest/dev/controlling-access.html ), there are 2 set of IPs for us to whitelist when using Splunk or RedShift as Kinesis Data Firehose...
0
answers
0
votes
120
views
asked 2 years agolg...
I am using KCL 1.14.8 for Java. My Kinesis only have one shard, and I put a record into Kinesis every 30 seconds. For each record, the RecordProcessor will process it, processing each record may take...
0
answers
0
votes
132
views
asked 2 years agolg...
I am hoping to create a stream of messages, and the stream will be defined by providing an S3 bucket + prefix, and will stream:
1. a list of all existing objects at the given prefix
2. new objects...
0
answers
0
votes
151
views
asked 2 years agolg...