En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post

"errorMessage": "NoBrokersAvailable" for python kafka producer in a lambda

0

I created the lambda in the same vpc as the amazon msk cluster and has proper execution role. What could be the possible reason for this error ? Also, for the lambda that is using msk as teh trigger , also reporting error " Last processing result: PROBLEM: Connection error. Please check your event source connection configuration. If your event source lives in a VPC, try setting up a new Lambda function or EC2 instance with the same VPC, Subnet, and Security Group settings. Connect the new device to the Kafka cluster and consume messages to ensure that the issue is not related to VPC or Endpoint configuration. If the new device is able to consume messages, please contact Lambda customer support for further investigation."

I can connect and run console kafka producer and consumer from EC2 instance for the same msk cluster.

Also, is there a good example code for using kafka-python in aws lambda for producer ?

Sujets
Réseaux et diffusion de contenuSans serveurCalculAnalytique
Balises
Amazon VPCAWS LambdaStreaming géré par Amazon pour Apache Kafka (Amazon MSK)
Langue
English
Mn
demandé il y a 10 mois1187 vues
1 réponse
0

Are you configured to connect to the msk cluster from Lambda's?
Are security groups, for example, allowed to connect from Lambda?
https://repost.aws/knowledge-center/lambda-trigger-msk-kafka-cluster

Also, is Lambda connected to a private subnet?
Also, is it possible to connect to an external network from a Lambda in a VPC with a NAT Gateway or similar set up?

profile picture
EXPERT
Riku_Kobayashi
répondu il y a 10 mois
profile pictureAWS
EXPERT
Jonathan_D
vérifié il y a 9 mois
  • Mn
    il y a 10 mois

    Thank you.

    I added the AWSLambdaMSKExecutionRole in the permission for both producer and consumer lambda. I already created these lambdas in the same vpc , used same security groups .

    For the consumer , now the msk trigger is at least not throwing "connection" error , the status is showing "ok" . But I do not see it is consuming events and sometimes teh trigger drops the connection and shows error , when I reload it few times the connection is successful again.

    For the producer , it still throws 'no broker' error. Any knowledge base to create a producer properly

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions

Contenus pertinents