Kinesis datastream iterator age is high
0
Hi,
We have a system where we ingest data via kinesis data stream, connected to kinesis firehose, and outputted to s3. Occasionally and seemingly arbitrarily, our monitor on GetRecords iterator age maximum > 5mins would trigger for a few hours at a time.
We added many more shards to the data stream than required (write throughput at <10% capacity), but had no impact.
According to the docs, When Kinesis Data Streams is configured as the data source, this quota doesn't apply, and Kinesis Data Firehose scales up and down with no limit. so it should not be a capacity issue here either.
What could cause this to happen?
1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
0
Hi,
Check this indicating reasons of having an increasing iterator age on the Kinesis Data Stream.
As hints, check if there are
- Any read throttles on the stream
- Even distribution of data on the shards
- Any other consumer on the stream other than the Firehose
beantwortet vor 5 Monaten
Relevanter Inhalt
AWS OFFICIALAktualisiert vor 2 Jahren- AWS OFFICIALAktualisiert vor 6 Monaten
- AWS OFFICIALAktualisiert vor einem Jahr
- AWS OFFICIALAktualisiert vor 6 Monaten