Downgrade type kafka msk

0

Hello, I need help because I can't reduce my instance of kafka, I'm getting the message below, even though I have the correct amount of partitions, could you help me?

Amazon MSK wasn't able to update the broker type Amazon MSK wasn't able to update the broker type for all the brokers in the cluster. Wait a few minutes, then try again. API response Brokers [1, 2, 3, 4, 5, 6] are above the recommended partition count for broker type kafka.t3.small. Reduce the number of partitions on the brokers or choose a larger broker type. Then, try the operation again.

Thiago
asked 9 months ago520 views
1 Answer
0

This error means you have too many partitions. There is a limit of 300 partitions (including all replicas) per broker. with the default RF=3, you should have under 100 partition leaders per broker. There is a metric in the CloudWatch that will show how many partitions you currently have.

Also, if you would like a deeper and better answers, I would recommend to update your question with the following information:

  • what is the current instance type
  • what is the desired instance type (I assume it's t3.small)
  • number of partitions including replicas per broker (from cloudwatch)
  • full output (with masked sensitive information) with the exception
AWS
EdbE
answered 9 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions