Lambda concurrency for Self managed Kafka event source

0

I created an event source mapping between self-managed Kafka and a lambda function following documents this and this.

Lambda function is getting triggered but all batches are getting processed serially. The expectation from the documentation is that there will be concurrent lambdas whose number is equal to the number of partitions in that topic. I am not observing this.

I want to understand under what conditions, threshold or ranges, for consumer_lag and consumer_offset for which one can observe concurrent Lambda invocations and scaling.

KKR
posta 2 anni fa644 visualizzazioni
1 Risposta
0

I understand by Self-Managed Kafka, that you are not using the AWS MSK service and have installed kafka somewhere in AWS infra. My case is exactly similar except that I am using MSK.

con risposta 2 anni fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande