By using AWS re:Post, you agree to the Terms of Use
AWS re:Postre:Post
/MSK - HELP Backup/

MSK - HELP Backup

0

Hi everyone, I need to create a backup for AWS MSK, and I found this article https://aws.amazon.com/en/blogs/big-data/back-up-and-restore-kafka-topic-data - using-amazon-msk-connect/ but the problem is that we have too many topics and new topics are created every day. How do I use this MSK backup solution in disaster recovery cases?

Topics
StorageAnalytics
Tags
Backup & RecoveryAmazon Managed Streaming for Apache Kafka (Amazon MSK)
Luis
asked 3 months ago59 views
1 Answers
0

Hello Luis,

I understand that you looking for Disaster Recovery solution for your AWS MSK topics. The blog you mentioned is currently the most effective method of backing up your MSK topic data.

To adjust the suggested method from the blog for a Disaster recovery solution, I recommend using MSK connect to backup data from your topics to a single S3 bucket. When it comes time to recover that data, Amazon Athena can be used to query said data to a new MSK cluster using MSK Connect.

You can move the MSK connector to the new cluster after recovery.

Resources: https://docs.aws.amazon.com/msk/latest/developerguide/mkc-S3sink-connector-example.html

https://docs.aws.amazon.com/athena/latest/ug/what-is.html

Prithvidhar_P
answered a month ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant questions