By using AWS re:Post, you agree to the Terms of Use

Question on how KCL creates new RecordProcessors with multiple instances

0

Hi,

I am trying to understand how KCL manages total number of RecordProcessors when there are multiple instances of workers(or consumers).
So I did have a look at below link, and the example in the doc makes sense.
https://docs.aws.amazon.com/streams/latest/dev/kinesis-record-processor-scaling.html

But have a few follow up questions just to make sure if my understanding is correct.
In the example, it says # of "record processors" will automatically be updated per KCL worker.

And my question is:
So if I increased the same KCL worker (same application name and same kinesis configs), KCL will figure out how many workers (or instances) are out there based on the application name, and readjust # of record processors for each KCL worker accordingly.

Thanks in advance!

asked 2 years ago40 views
1 Answer
0

Yes, your understanding is correct.

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions