how to add consumer to existing kinesis stream from java MS?

0

I need to add new consumer to an existing stream. I'm stuck on a point where I'm getting both shards of the stream correct but without data. when I'm iterating on them (with many retries and sleeps between) I don't see any records. (they exist because other consumer of the same stream get them). what configuration is needed to see data? plus, data viewer tab doesn't show the records (using LATEST) . why?

gefragt vor einem Jahr360 Aufrufe
1 Antwort
0

Hi,

If you're using 'LATEST' iterator type, the consumer starts reading new data records from the most recent point onwards and does not read the data records written prior to it. For reading older data, you may consider using a 'TRIM_HORIZON' shard iterator type, which starts reading the oldest data record in the shard.

The above also holds true when using 'Data viewer' in Kinesis Streams via AWS Console.

[+] https://docs.aws.amazon.com/streams/latest/dev/data-viewer.html#:~:text=Latest%3A%20Show%20records%20just%20after%20the%20most%20recent%20record%20in%20the%20shard%2C%20so%20that%20you%20always%20read%20the%20most%20recent%20data%20in%20the%20shard

AWS
SUPPORT-TECHNIKER
beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen