Questions tagged with Amazon Data Firehose
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
A gaming company created a game leaderboard by using a Multi-AZ deployment of an Amazon RDS database. The number of users is growing, and the queries to get individual player rankings are
getting...
2
answers
0
votes
335
views
asked a year agolg...
Are there any GitHub AWS CDK code examples available for Kinesis Data stream, preferably written in Javascript, Typescript YAML format.
I want to deploy and use Kinesis streams for my Amazon Connect...
2
answers
0
votes
1117
views
asked a year agolg...
we have kinesis data stream on us-west-2 region and we would like to access the same data stream into kinesis firhose which is exists in ap-south-1. Please suggest what action needs to be taken to...
1
answers
0
votes
466
views
asked a year agolg...
Can you explain the trade-offs and considerations involved in choosing between the "direct" and "buffering" delivery modes in Amazon Kinesis Firehose, and under what scenarios each mode would be more...
1
answers
0
votes
802
views
asked a year agolg...
Hi,
I am writing data to S3 from an event bus using dynamic partitioning of the scheme...
1
answers
1
votes
698
views
asked a year agolg...
How do you debug your Eventbridge pipe line with self hosted kafka as source and firehose as targetlg...
Hello,
I am having hard time getting the eventbridge pipeline to work. I tried all different combinations. I am using the self hosted kafka cluster(cloudkarafka.com deployed on aws) and my target is...
0
answers
0
votes
116
views
asked a year agolg...
Delivering records to Security Lake custom source prefix is not possible with Kinesis Firehose?lg...
I'm trying to set up custom sources for Security Lake and have a Kinesis Firehose delivery stream configured to deliver parquet files into the Security Lake bucket under the ext/ prefix.
The problem...
1
answers
0
votes
327
views
asked a year agolg...
I want to take advantage of AWS Kinesis Data Firehose with a destination of HTTP endpoint to stream text records. The destination expects for authentication an HTTP header of the form:...
1
answers
0
votes
966
views
asked a year agolg...
Hi there, I'm looking at my CloudWatch logs to try to estimate the average size of a record delivered to S3 via my firehose instance. Here's my math:
I look at `Records delivered to Amazon S3 (Sum)`...
1
answers
0
votes
538
views
asked a year agolg...
I have an architecture where two entities are posting data to an API gateway. They both follow their own (different) json schema, API GW then pushes it into Kinesis Stream/Firehose. Should I create a...
1
answers
0
votes
779
views
asked a year agolg...
Is there an additional cost when we compress data like bzip? It is not clear from the firehose pricing web and I need this information for some realistic cost...
2
answers
0
votes
321
views
asked a year agolg...
Hi there! I'm streaming a bunch of json data into an s3 bucket via firehose. I was wondering what's the best practice for uniqueness checks on those individual json objects since firehose aggregates...
2
answers
0
votes
433
views
asked a year agolg...