how to add consumer to existing kinesis stream from java MS?

0

I need to add new consumer to an existing stream. I'm stuck on a point where I'm getting both shards of the stream correct but without data. when I'm iterating on them (with many retries and sleeps between) I don't see any records. (they exist because other consumer of the same stream get them). what configuration is needed to see data? plus, data viewer tab doesn't show the records (using LATEST) . why?

1 Answer
0

Hi,

If you're using 'LATEST' iterator type, the consumer starts reading new data records from the most recent point onwards and does not read the data records written prior to it. For reading older data, you may consider using a 'TRIM_HORIZON' shard iterator type, which starts reading the oldest data record in the shard.

The above also holds true when using 'Data viewer' in Kinesis Streams via AWS Console.

[+] https://docs.aws.amazon.com/streams/latest/dev/data-viewer.html#:~:text=Latest%3A%20Show%20records%20just%20after%20the%20most%20recent%20record%20in%20the%20shard%2C%20so%20that%20you%20always%20read%20the%20most%20recent%20data%20in%20the%20shard

AWS
SUPPORT ENGINEER
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions