Question on how KCL creates new RecordProcessors with multiple instances



I am trying to understand how KCL manages total number of RecordProcessors when there are multiple instances of workers(or consumers).
So I did have a look at below link, and the example in the doc makes sense.

But have a few follow up questions just to make sure if my understanding is correct.
In the example, it says # of "record processors" will automatically be updated per KCL worker.

And my question is:
So if I increased the same KCL worker (same application name and same kinesis configs), KCL will figure out how many workers (or instances) are out there based on the application name, and readjust # of record processors for each KCL worker accordingly.

Thanks in advance!

preguntada hace 3 años332 visualizaciones
1 Respuesta

Yes, your understanding is correct.

respondido hace 3 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas