Does MSK cluster configuration update will affect existing topic configuration?
0
For example, if I change partion num in my cluster configuration and apply to the cluster, will it also help me update the existing topic partition number? If not, is there a list of configuration that will not be overriden by cluster configuration change after the resource has been initialized?
asked 4 months ago16 views
1 Answers
1
Accepted Answer
Hi there, please find the answers inline
- For example, if I change partition num in my cluster configuration and apply to the cluster, will it also help me update the existing topic partition number?
-
Partition number (num.partitions), replication factor (default.replication.factor) etc which can be set in cluster level configuration only applies to the 'auto created topics'(auto.create.topics.enable=true).
-
And when you change this configuration it applies only to the auto created topics after the update was made, it doesn't update the existing topics configuration.
- If not, is there a list of configuration that will not be overridden by cluster configuration change after the resource has been initialized?
- We do not currently have a list but parameters that can be applied on both topic level and cluster level are mostly only retention related parameters, segment related parameters and min.insync.replicas. The retention and segment related parameters set at topic level takes precedence over retention set at cluster level. Same applies to min.insync.replicas which by default is 2 at cluster level. But you can set it at topic level which takes precedence. So for above parameters topic level configurations takes precedence and cluster level settings won't override it.
Relevant questions
Online configuration changes for cluster availability included in 5.0.6?
asked 2 years agoMSK Custom Configuration using Cloudformation
asked 4 months agoMixed Fleet configuration for Elastic memcache Cluster
asked 2 months agoCloudformation support for creating configurations
asked 3 years agoDoes MSK cluster configuration update will affect existing topic configuration?
Accepted Answerasked 4 months agoUsing cloudformation for setting upp global database and second cluster from existing cluster
asked 4 months agoAurora cluster requires a system update?
asked 3 years agoDMS CDC to Redshift during cluster resize
Accepted Answerasked 2 years agoHow to update cluster config when the original ebs snapshot is gone
Accepted Answerasked 10 months agoI can't stop/close my redshift cluster
Accepted Answerasked 6 months ago