Questions tagged with Amazon Data Firehose
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
When creating a table with a leading space in the name, AWS Glue does not display any error during the creation process. However, upon checking the API logs, I noticed that the space is present in the...
1
answers
0
votes
455
views
asked 3 months agolg...
I'm trying to configure a streaming pipeline using Amazon Firehose with the new Snowflake integration. Both the AWS and Snowflake accounts are in **us-east-1** region.
I have an existing integration...
0
answers
0
votes
126
views
asked 3 months agolg...
As of Sept, 2023 kinesis firehose supports creating delivery stream to consume MSK Topic data and store that into s3 with...
1
answers
0
votes
359
views
asked 3 months agolg...
I followed cross-account principles and attached trusted policy in the source account as well as the target AWS account, still in target account B I am not getting the option to select kinesis stream...
1
answers
0
votes
146
views
asked 3 months agolg...
Hi,
Does PutRecord SDK has retry feature as KPL? I have found the below link about handling failures
https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-sdk.html
Can we say...
1
answers
0
votes
1116
views
asked 5 months agolg...
Hi,
We have a scenario where we want to send a JSON object that contains a nested list of records into Kinesis Firehose from an IoT Core rule, and have this list split into multiple records, with...
1
answers
0
votes
932
views
asked 5 months agolg...
I'm designing a system that will listen to over 1000 streams (1 for each device), and should be able to process the streamed data to take action when needed. I need the processing and taking action to...
0
answers
0
votes
1712
views
asked 5 months agolg...
Hello, dear community!
I have configured AWS Kinesis Data Firehose to stream data to an HTTP endpoint, with an S3 backup configuration enabled for storing all data in an S3 bucket. Despite this setup,...
0
answers
0
votes
208
views
asked 6 months agolg...
I need to call PutSubscriptionFilter for a Firehose data stream. I created my role that trusts the logs.amazonaws.com service and allows it to put records. There is a permission boundary on my user...
0
answers
0
votes
123
views
asked 6 months agolg...
How to correctly estimate the expected JQ Processing Hours for dynamic partitioning in Kinesis Firehose as being asked in pricing calculator ? It's not very clear from the documentation. Does every...
1
answers
0
votes
258
views
asked 6 months agolg...
pipeLine : In order to index data to opensearch, kinesis is called from lambda and the data is forwarded to opensearch.
when sending demo data to 'Opensearch' from 'kdf', 'Opensearch' set index...
1
answers
0
votes
612
views
asked 7 months agolg...
I have a glue table specified that refers to a location in S3. I noticed that when Firehose puts data there in parquet format it might be not always compressed.
Will it cause issues for Glue table,...
1
answers
0
votes
307
views
asked 7 months agolg...