How to measure the lag between AWS Redshift MV and MSK topics in an architecture involving AWS Redshift streaming ingestion from MSK?

0

In our architecture we have data from AWS MSK being ingested into AWS Redshift using the Amazon Redshift Streaming Ingestion feature. In this approach, we define an external schema where we have the Materialized Views (MVs) being defined on the topics in MSK cluster. These MVs have auto-refresh turned on.

At any given point in time, what are the design options to measure the lag between the data in the MSK topics and the Redshift Materialized Views i.e. how far the Redshift MVs are the from the kafka topics respectively?

  • Any inputs on this would be appreciated?

MK
已提問 6 個月前檢視次數 114 次
沒有答案

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南