Downgrade type kafka msk

Question

Hello, I need help because I can't reduce my instance of kafka, I'm getting the message below, even though I have the correct amount of partitions, could you help me?

Amazon MSK wasn't able to update the broker type
Amazon MSK wasn't able to update the broker type for all the brokers in the cluster. Wait a few minutes, then try again.
API response
Brokers [1, 2, 3, 4, 5, 6] are above the recommended partition count for broker type kafka.t3.small. Reduce the number of partitions on the brokers or choose a larger broker type. Then, try the operation again.

Answer

This error means you have too many partitions. There is a limit of 300 partitions (including all replicas) per broker. with the default RF=3, you should have under 100 partition leaders per broker. There is a metric in the CloudWatch that will show how many partitions you currently have.

Also, if you would like a deeper and better answers, I would recommend to update your question with the following information:
- what is the current instance type
- what is the desired instance type (I assume it's `t3.small`)
- number of partitions including replicas per broker (from cloudwatch)
- full output (with masked sensitive information) with the exception

Downgrade type kafka msk

相關內容