Questions tagged with Amazon Data Firehose
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
What is the cloud watch metric for failed glue jobs/runs?
Simply put I need a metric for failed glue jobs/runs.
The GlueExceptionAnalysisListener seems to be the only thing capturing failed glue...
2
answers
0
votes
518
views
asked 7 months agolg...
Hi,
We have a system where we ingest data via kinesis data stream, connected to kinesis firehose, and outputted to s3. Occasionally and seemingly arbitrarily, our monitor on GetRecords iterator age...
1
answers
0
votes
269
views
asked 7 months agolg...
We want to enable the schema validation for Firehose streams as described here: https://docs.aws.amazon.com/firehose/latest/dev/create-transform.html
Quote:
"To enable schema validation, check the...
0
answers
1
votes
172
views
asked 7 months agolg...
Hello all,
I have a Kinesis Data Stream in account A, and I need to stream the events from it to Kinesis Firehose in account B.
From what I see, there is no direct integration (even using IAM roles...
2
answers
0
votes
499
views
asked 8 months agolg...
We have a Kinesis Data Firehose that have
| Buffer hints | value |
| --- | --- |
| Buffer size | 128 MiB |
| Buffer interval | 900 seconds |
| Retry | 300 seconds |
Data Freshness = Time in Buffer +...
1
answers
1
votes
357
views
asked 8 months agolg...
I'm trying to use IoT Events Alarm actions with custom payload and Firehose as action target. When i look into the documentation i can't find any example of the syntax required to write a custom...
1
answers
0
votes
265
views
asked 8 months agolg...
Hi! I'm copying this tutorial almost exactly: https://aws.amazon.com/blogs/big-data/serverless-logging-with-amazon-opensearch-serverless-and-amazon-kinesis-data-firehose/
I've set up OpenSearch...
0
answers
0
votes
169
views
asked 8 months agolg...
NOTE: I cross-posted to StackOverflow [here](https://stackoverflow.com/questions/77138035/how-to-send-data-to-kinesis-data-firehose-using-the-aws-javascript-sdk).
I am trying to send JSON data to...
1
answers
0
votes
571
views
asked 8 months agolg...
**Background**: We have a kinesis Firehose configured to send to encrypted S3, it is converting from JSON to Parquet. The source is Direct PUT. The Buffer hints are set with 64MiB and interval of...
1
answers
0
votes
675
views
asked 8 months agolg...
1. How much does it cost to run Lambda function once a week?
2. How much does it cost for the Export task of the Log Group created by Lambda?
3. How much would it cost if we use Firehose for log...
2
answers
0
votes
309
views
asked 9 months agolg...
I'm looking for the optimal/inexpensive AWS service for live stream storage (from mobile device), but a live stream delivery/output funtion isn't needed.
I've looked at:
Amazon IVS
Amazon Kinesis...
2
answers
1
votes
507
views
asked 9 months agolg...
I have a Spark transformation batch job runs on EMR.
I want to write final transformed data in Spark data frame to OpenSearch via AWS Kinesis Data Firehose.
From the Firehose wiki, I do not see...
1
answers
0
votes
472
views
asked 10 months agolg...