AWS MSK quota setting

0

Hey team

I am recently working Kafka quota settings and couldn't find too much informations in AWS documentation so there are some questions.

  • What is default quota for MSK?

    In the Kafka documentation, it says By default, clients receive an unlimited quota. Does it also apply to MSK?

  • How to set default quota for MSK?

    We are using CDK to deploy MSK however, I couldn't find any configurations that related to quotas. Based on the Kafka documentation here, it is using the kafka-configs.sh to set the quotas. I wonder how can we do this for MSK?

Thanks in advance.

Eric

asked 10 months ago607 views
2 Answers
2

Hi Eric,

Amazon Managed Streaming for Apache Kafka (Amazon MSK) is AWS's managed offering for Apache Kafka. So while Amazon MSK takes care of many details when setting up and managing your Kafka clusters, most of the default parameters of the Kafka cluster and how you interact with them will remain the same, with respect to the Kafka version you have deployed. When it comes to interacting with your MSK cluster to change configuration details, Amazon MSK supports using either the Kafka AlterConfig API or the kafka-configs.sh tool to adjust configuration properties.

Information on additional quotas or requirements that Amazon MSK does add can be found here, for both Provisioned MSK clusters and MSK Serverless. It is important to note that for service-level quotas on Amazon MSK, you can always open a support case if you need to expand beyond the default service quotas.

Additionally, you can look into this blog series, which discusses enforcing Kafka network bandwidth quotas in detail on multi-tenant Amazon MSK clusters, and additional controls that you can make use of if you are using IAM access controls for client applications to access your Amazon MSK cluster.

Hope this helps, Austin

AWS
EXPERT
agroe
answered 7 months ago
0

Hi, if you are using the serverless version of MSK, all quotas are detailled heree https://docs.aws.amazon.com/msk/latest/developerguide/limits.html

Hope it helps Didier

profile pictureAWS
EXPERT
answered 10 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions