Does MSK cluster configuration update will affect existing topic configuration?

0

For example, if I change partion num in my cluster configuration and apply to the cluster, will it also help me update the existing topic partition number? If not, is there a list of configuration that will not be overriden by cluster configuration change after the resource has been initialized?

AWS
preguntada hace 2 años901 visualizaciones
1 Respuesta
1
Respuesta aceptada

Hi there, please find the answers inline

  1. For example, if I change partition num in my cluster configuration and apply to the cluster, will it also help me update the existing topic partition number?
  • Partition number (num.partitions), replication factor (default.replication.factor) etc which can be set in cluster level configuration only applies to the 'auto created topics'(auto.create.topics.enable=true).

  • And when you change this configuration it applies only to the auto created topics after the update was made, it doesn't update the existing topics configuration.

  1. If not, is there a list of configuration that will not be overridden by cluster configuration change after the resource has been initialized?
  • We do not currently have a list but parameters that can be applied on both topic level and cluster level are mostly only retention related parameters, segment related parameters and min.insync.replicas. The retention and segment related parameters set at topic level takes precedence over retention set at cluster level. Same applies to min.insync.replicas which by default is 2 at cluster level. But you can set it at topic level which takes precedence. So for above parameters topic level configurations takes precedence and cluster level settings won't override it.
AWS
INGENIERO DE SOPORTE
respondido hace 2 años
AWS
EXPERTO
revisado hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas