Questions tagged with Amazon Kinesis
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
Hi Team,
#### Our Question:
Is there a feature that offered by Kinesis that allows us to enrich records in the same Kinesis stream? (get the plain record -> enrich it -> put it back into the same...
0
answers
0
votes
11
views
asked 2 hours agolg...
I have a Lambda Function written in Golangg, that sends data to Kinesis using the PutRecord function. The Lambda was able to process millions of data daily, but occasionally it was timing out a few...
0
answers
0
votes
26
views
asked 9 hours agolg...
Hi all,
I'm using Data Firehose to store events into an S3 bucket. Basically an Event Rule sends the events to a Firehose and then S3 is used as a target.
Events --> Firehose --> S3
In Firehose, I...
0
answers
0
votes
23
views
asked 10 hours agolg...
I am using EKS Fargate and trying to use AWS built-in Fluent Bit to send logs to Elastic Cloud, but I am encountering the following error:
```
{ "log": "[2024/05/16 14:35:17] [error]...
2
answers
0
votes
173
views
asked 3 days agolg...
Hello!
I'm new to Flink, and have managed to set up a kinesis -> managed-flink pipeline very quickly! It's definitely a very cool system.
In my last paragraph in Flink, I'm using SSQL to generate a...
0
answers
0
votes
20
views
asked 5 days agolg...
Hey everyone,
I'm currently working with a lot of data consumption via kinesis stream and firehose, previously i used only firehose with direct puts but it seems that if you have a lot of throughput...
1
answers
0
votes
283
views
asked 8 days agolg...
Hi,
I have seen a lot of examples where data records are sent from KDS to KDF even there is NO real-time processing is required. Why can't we ingest data directly to KDF and store the records in data...
1
answers
0
votes
190
views
asked 12 days agolg...
Hi Minds,
I have an use-case to stream data from Kafka to Redshift. My Kafkas are hosted in Kubernetes in a AWS account(Account B) and not using MSK, how do I stream that to my Redshift Managed...
1
answers
0
votes
117
views
asked 20 days agolg...
I'm using debezium to generate CDC events that I want to get into S3. There are two easy paths forward:
1. Use Debezium Server and push events into Kinesis -> Firehose -> S3.
2. Use MSK and MSK...
0
answers
0
votes
58
views
asked a month agolg...
According to AWS docs:
*You are charged an hourly rate based on the number of Kinesis Processing Units (KPUs) used to run your applications. A single KPU comprises 1 vCPU compute and 4 GB of memory....
0
answers
0
votes
518
views
asked a month agolg...
I have a step function for doing a migration task on a dynamo table. I need to turn of the kinesis stream associated with the table using aws SDK first step and then run the migration task then turn...
1
answers
0
votes
113
views
asked a month agolg...
Kinesis Firehose allows to configure S3 as a destination and in the Parquet section allows selecting a Glue catalog table of format Iceberg. However I had little to no luck querying the data.
Does...
1
answers
0
votes
104
views
asked a month agolg...