Lambda concurrency for Self managed Kafka event source

0

I created an event source mapping between self-managed Kafka and a lambda function following documents this and this.

Lambda function is getting triggered but all batches are getting processed serially. The expectation from the documentation is that there will be concurrent lambdas whose number is equal to the number of partitions in that topic. I am not observing this.

I want to understand under what conditions, threshold or ranges, for consumer_lag and consumer_offset for which one can observe concurrent Lambda invocations and scaling.

KKR
feita há 2 anos644 visualizações
1 Resposta
0

I understand by Self-Managed Kafka, that you are not using the AWS MSK service and have installed kafka somewhere in AWS infra. My case is exactly similar except that I am using MSK.

respondido há 2 anos

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas