Questions tagged with Amazon Data Firehose
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
There is a relatively new feature for Firehose to append new line at the end of records before saving them to S3: https://docs.aws.amazon.com/firehose/latest/dev/create-destination.html
by enabling...
1
answers
0
votes
407
views
asked 2 months agolg...
I am trying to setup an API Gateway proxy service integration **to** Data Firehose. (Importantly, this has nothing to do with streaming access logs to Firehose)
However, I cannot seem to get it to...
1
answers
0
votes
226
views
asked 3 months agolg...
Hello,
We are sending the VPC flow data to Cloudwatch group and then later we added additional destination to send the VPC flow log to another account. We could see flow log was sent to splunk for...
2
answers
0
votes
373
views
asked 3 months agolg...
When creating a table with a leading space in the name, AWS Glue does not display any error during the creation process. However, upon checking the API logs, I noticed that the space is present in the...
1
answers
0
votes
470
views
asked 3 months agolg...
I'm trying to configure a streaming pipeline using Amazon Firehose with the new Snowflake integration. Both the AWS and Snowflake accounts are in **us-east-1** region.
I have an existing integration...
0
answers
0
votes
133
views
asked 3 months agolg...
As of Sept, 2023 kinesis firehose supports creating delivery stream to consume MSK Topic data and store that into s3 with...
1
answers
0
votes
366
views
asked 4 months agolg...
I followed cross-account principles and attached trusted policy in the source account as well as the target AWS account, still in target account B I am not getting the option to select kinesis stream...
1
answers
0
votes
155
views
asked 4 months agolg...
Hi,
Does PutRecord SDK has retry feature as KPL? I have found the below link about handling failures
https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-sdk.html
Can we say...
1
answers
0
votes
1338
views
asked 5 months agolg...
Hi,
We have a scenario where we want to send a JSON object that contains a nested list of records into Kinesis Firehose from an IoT Core rule, and have this list split into multiple records, with...
1
answers
0
votes
952
views
asked 5 months agolg...
I'm designing a system that will listen to over 1000 streams (1 for each device), and should be able to process the streamed data to take action when needed. I need the processing and taking action to...
0
answers
0
votes
1948
views
asked 6 months agolg...
Hello, dear community!
I have configured AWS Kinesis Data Firehose to stream data to an HTTP endpoint, with an S3 backup configuration enabled for storing all data in an S3 bucket. Despite this setup,...
0
answers
0
votes
213
views
asked 6 months agolg...
I need to call PutSubscriptionFilter for a Firehose data stream. I created my role that trusts the logs.amazonaws.com service and allows it to put records. There is a permission boundary on my user...
0
answers
0
votes
127
views
asked 6 months agolg...