By using AWS re:Post, you agree to the Terms of Use
/Why is there a strict rule of number of brokers as multiple of AZ?/

Why is there a strict rule of number of brokers as multiple of AZ?

0

AWS MSK allows the number of brokers only as multiple of the number of availability zones selected.
It is recommended for a well-balanced infra, but why is has this been enforced?

I can't have 4/5 brokers in my 3 AZs & will therefore have to bear x2 cost instead.

1 Answers
0

We keep a consistent number of brokers across AZs and recommend that replication factors are set to at least 3 and replicas placed to ensure placement across all 3 AZs. This is intended to preserve the durability and availability of your cluster in case of a failure in an AZ. The availability aspect is the most significant factor in balancing brokers across AZs, since the loss of a single AZ in an unbalanced cluster would have a disproportional impact on the other two AZ's brokers, and lead to unpredictable availability. This explains why this is a best practice. The service design enforces this best practice, while simplifying operations, by keeping the broker numbers synchronized across AZs.

answered 9 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions