Salta al contenuto

how to add consumer to existing kinesis stream from java MS?

0

I need to add new consumer to an existing stream. I'm stuck on a point where I'm getting both shards of the stream correct but without data. when I'm iterating on them (with many retries and sleeps between) I don't see any records. (they exist because other consumer of the same stream get them). what configuration is needed to see data? plus, data viewer tab doesn't show the records (using LATEST) . why?

posta 3 anni fa659 visualizzazioni

1 Risposta
0

Hi,

If you're using 'LATEST' iterator type, the consumer starts reading new data records from the most recent point onwards and does not read the data records written prior to it. For reading older data, you may consider using a 'TRIM_HORIZON' shard iterator type, which starts reading the oldest data record in the shard.

The above also holds true when using 'Data viewer' in Kinesis Streams via AWS Console.

[+] https://docs.aws.amazon.com/streams/latest/dev/data-viewer.html#:~:text=Latest%3A%20Show%20records%20just%20after%20the%20most%20recent%20record%20in%20the%20shard%2C%20so%20that%20you%20always%20read%20the%20most%20recent%20data%20in%20the%20shard

AWS
TECNICO DI SUPPORTO

con risposta 3 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.