How to calculate JQ Processing Hours for Firehose Cost Estimation

0

How to correctly estimate the expected JQ Processing Hours for dynamic partitioning in Kinesis Firehose as being asked in pricing calculator ? It's not very clear from the documentation. Does every record ingested into delivery stream invoke one JQ thread ?

Ravi
asked 3 months ago139 views
1 Answer
0

Hello ,

I understand you are having trouble estimating the expected JQ Processing Hours for dynamic partitioning in Kinesis Firehose

Regarding this , I would like to inform you that you may consider using firehose metric "JQProcessing.Duration" which Returns the amount of time it took to execute JQ expression in the JQ Lambda function. After this you can refer to the firehose pricing documentation to calculate on per hour basis .

Please find the documentation for reference :

[+] Monitoring Kinesis Data Firehose Using CloudWatch Metrics - Dynamic Partitioning CloudWatch Metrics - https://docs.aws.amazon.com/firehose/latest/dev/monitoring-with-cloudwatch-metrics.html#dp-metrics-cw

[+] Amazon Kinesis Data Firehose pricing : https://aws.amazon.com/kinesis/data-firehose/pricing/

AWS
answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions