Lambda concurrency for Self managed Kafka event source

0

I created an event source mapping between self-managed Kafka and a lambda function following documents this and this.

Lambda function is getting triggered but all batches are getting processed serially. The expectation from the documentation is that there will be concurrent lambdas whose number is equal to the number of partitions in that topic. I am not observing this.

I want to understand under what conditions, threshold or ranges, for consumer_lag and consumer_offset for which one can observe concurrent Lambda invocations and scaling.

KKR
demandé il y a 2 ans644 vues
1 réponse
0

I understand by Self-Managed Kafka, that you are not using the AWS MSK service and have installed kafka somewhere in AWS infra. My case is exactly similar except that I am using MSK.

répondu il y a 2 ans

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions