Kinesis Data Stream. Scaling and filtering

0

I have Kinesis Data Streams in one region and consumers in number of another regions. Consumers should receive messages regardless of whether they are delivered to other regions. Also consumers can be scaled in and out. Please advise how I can do the following

  1. Ensure that each consumer only read messages to which it's subscribed and doesn't read messages to which it shouldn't have access
  2. Scale Kinesis Data Stream based on consumer scaling. For example, consumer scaled-out by adding additional pod and then KDS adds more shards to the stream.
AWS
已提問 10 個月前檢視次數 1035 次
1 個回答
0

In Kinesis data streams the access controls to stream is implemented using IAM policies , check out example here https://docs.aws.amazon.com/streams/latest/dev/controlling-access.html .

Regarding scaling, the recommended method is to use Kinesis Data Stream On-Demand Mode https://aws.amazon.com/blogs/aws/amazon-kinesis-data-streams-on-demand-stream-data-at-scale-without-managing-capacity/

AWS
已回答 10 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南