Questions tagged with Amazon Kinesis
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Team,
#### Our Question:
Is there a feature that offered by Kinesis that allows us to enrich records in the same Kinesis stream? (get the plain record -> enrich it -> put it back into the same...
0
answers
0
votes
27
views
asked 12 hours agolg...
I have a Lambda Function written in Golangg, that sends data to Kinesis using the PutRecord function. The Lambda was able to process millions of data daily, but occasionally it was timing out a few...
1
answers
0
votes
32
views
asked 18 hours agolg...
Hi all,
I'm using Data Firehose to store events into an S3 bucket. Basically, an Event Rule gets triggered and sends the events to a Data Firehose, and then S3 is used as a target.
Events -->...
0
answers
0
votes
25
views
asked 19 hours agolg...
I am using EKS Fargate and trying to use AWS built-in Fluent Bit to send logs to Elastic Cloud, but I am encountering the following error:
```
{ "log": "[2024/05/16 14:35:17] [error]...
2
answers
0
votes
191
views
asked 3 days agolg...
Hello!
I'm new to Flink, and have managed to set up a kinesis -> managed-flink pipeline very quickly! It's definitely a very cool system.
In my last paragraph in Flink, I'm using SSQL to generate a...
0
answers
0
votes
21
views
asked 6 days agolg...
Hey everyone,
I'm currently working with a lot of data consumption via kinesis stream and firehose, previously i used only firehose with direct puts but it seems that if you have a lot of throughput...
1
answers
0
votes
287
views
asked 9 days agolg...
Hi,
I have seen a lot of examples where data records are sent from KDS to KDF even there is NO real-time processing is required. Why can't we ingest data directly to KDF and store the records in data...
1
answers
0
votes
196
views
asked 12 days agolg...
Hi Minds,
I have an use-case to stream data from Kafka to Redshift. My Kafkas are hosted in Kubernetes in a AWS account(Account B) and not using MSK, how do I stream that to my Redshift Managed...
1
answers
0
votes
118
views
asked 20 days agolg...
I'm using debezium to generate CDC events that I want to get into S3. There are two easy paths forward:
1. Use Debezium Server and push events into Kinesis -> Firehose -> S3.
2. Use MSK and MSK...
0
answers
0
votes
59
views
asked a month agolg...
According to AWS docs:
*You are charged an hourly rate based on the number of Kinesis Processing Units (KPUs) used to run your applications. A single KPU comprises 1 vCPU compute and 4 GB of memory....
0
answers
0
votes
523
views
asked a month agolg...
I have a step function for doing a migration task on a dynamo table. I need to turn of the kinesis stream associated with the table using aws SDK first step and then run the migration task then turn...
1
answers
0
votes
115
views
asked a month agolg...
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
1
answers
0
votes
107
views
asked a month agolg...