Questions tagged with Amazon Kinesis
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hey everyone,
I'm currently working with a lot of data consumption via kinesis stream and firehose, previously i used only firehose with direct puts but it seems that if you have a lot of throughput...
1
answers
0
votes
15
views
asked 2 days agolg...
Hi,
I have seen a lot of examples where data records are sent from KDS to KDF even there is NO real-time processing is required. Why can't we ingest data directly to KDF and store the records in data...
1
answers
0
votes
122
views
asked 6 days agolg...
Hi Minds,
I have an use-case to stream data from Kafka to Redshift. My Kafkas are hosted in Kubernetes in a AWS account(Account B) and not using MSK, how do I stream that to my Redshift Managed...
1
answers
0
votes
97
views
asked 13 days agolg...
I'm using debezium to generate CDC events that I want to get into S3. There are two easy paths forward:
1. Use Debezium Server and push events into Kinesis -> Firehose -> S3.
2. Use MSK and MSK...
0
answers
0
votes
44
views
asked 21 days agolg...
According to AWS docs:
*You are charged an hourly rate based on the number of Kinesis Processing Units (KPUs) used to run your applications. A single KPU comprises 1 vCPU compute and 4 GB of memory....
0
answers
0
votes
509
views
asked 21 days agolg...
I have a step function for doing a migration task on a dynamo table. I need to turn of the kinesis stream associated with the table using aws SDK first step and then run the migration task then turn...
1
answers
0
votes
100
views
asked a month agolg...
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
1
answers
0
votes
93
views
asked a month agolg...
Hey, It been said from [AWS document](https://docs.aws.amazon.com/firehose/latest/dev/troubleshooting.html) that:
> If Firehose encounters errors while delivering or processing data, it retries until...
2
answers
0
votes
72
views
asked a month agolg...
Kinesis Firehose has a feature to append a new line at the end of records before saving them to S3: https://docs.aws.amazon.com/firehose/latest/dev/create-destination.html
Will enabling a new line...
1
answers
0
votes
85
views
asked a month agolg...
Trying to ingest data from kinesis stream to redshift using firehose delivery stream. VPC is made publicly accessible and added IP address of firehose to inbound rules in security groups (modifield...
1
answers
0
votes
164
views
asked a month agolg...
Trying to ingest streaming data from kinesis using external schema and materialized views. Getting below error while creating materialized view
ERROR: -----------------------------------------------...
1
answers
0
votes
104
views
asked a month agolg...
Getting error while connecting streaming data from kinesis to redshift with few transformations using visual ETL. (using amazon kinesis - glue data catalog table as source ). Schema is already...
1
answers
0
votes
201
views
asked a month agolg...