Question on how KCL creates new RecordProcessors with multiple instances



I am trying to understand how KCL manages total number of RecordProcessors when there are multiple instances of workers(or consumers).
So I did have a look at below link, and the example in the doc makes sense.

But have a few follow up questions just to make sure if my understanding is correct.
In the example, it says # of "record processors" will automatically be updated per KCL worker.

And my question is:
So if I increased the same KCL worker (same application name and same kinesis configs), KCL will figure out how many workers (or instances) are out there based on the application name, and readjust # of record processors for each KCL worker accordingly.

Thanks in advance!

posta 3 anni fa330 visualizzazioni
1 Risposta

Yes, your understanding is correct.

con risposta 3 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande