Questions tagged with Amazon Kinesis
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am using EKS Fargate and trying to use AWS built-in Fluent Bit to send logs to Elastic Cloud, but I am encountering the following error:
```
{ "log": "[2024/05/16 14:35:17] [error]...
2
answers
0
votes
93
views
asked a day agolg...
Hello!
I'm new to Flink, and have managed to set up a kinesis -> managed-flink pipeline very quickly! It's definitely a very cool system.
In my last paragraph in Flink, I'm using SSQL to generate a...
0
answers
0
votes
14
views
asked 4 days agolg...
Hey everyone,
I'm currently working with a lot of data consumption via kinesis stream and firehose, previously i used only firehose with direct puts but it seems that if you have a lot of throughput...
1
answers
0
votes
225
views
asked 7 days agolg...
Hi,
I have seen a lot of examples where data records are sent from KDS to KDF even there is NO real-time processing is required. Why can't we ingest data directly to KDF and store the records in data...
1
answers
0
votes
168
views
asked 11 days agolg...
Hi Minds,
I have an use-case to stream data from Kafka to Redshift. My Kafkas are hosted in Kubernetes in a AWS account(Account B) and not using MSK, how do I stream that to my Redshift Managed...
1
answers
0
votes
109
views
asked 18 days agolg...
I'm using debezium to generate CDC events that I want to get into S3. There are two easy paths forward:
1. Use Debezium Server and push events into Kinesis -> Firehose -> S3.
2. Use MSK and MSK...
0
answers
0
votes
53
views
asked a month agolg...
According to AWS docs:
*You are charged an hourly rate based on the number of Kinesis Processing Units (KPUs) used to run your applications. A single KPU comprises 1 vCPU compute and 4 GB of memory....
0
answers
0
votes
513
views
asked a month agolg...
I have a step function for doing a migration task on a dynamo table. I need to turn of the kinesis stream associated with the table using aws SDK first step and then run the migration task then turn...
1
answers
0
votes
107
views
asked a month agolg...
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
1
answers
0
votes
99
views
asked a month agolg...
Hey, It been said from [AWS document](https://docs.aws.amazon.com/firehose/latest/dev/troubleshooting.html) that:
> If Firehose encounters errors while delivering or processing data, it retries until...
2
answers
0
votes
83
views
asked a month agolg...
Kinesis Firehose has a feature to append a new line at the end of records before saving them to S3: https://docs.aws.amazon.com/firehose/latest/dev/create-destination.html
Will enabling a new line...
1
answers
0
votes
89
views
asked a month agolg...
Trying to ingest data from kinesis stream to redshift using firehose delivery stream. VPC is made publicly accessible and added IP address of firehose to inbound rules in security groups (modifield...
1
answers
0
votes
177
views
asked a month agolg...