Kinesis Data Stream. Scaling and filtering

0

I have Kinesis Data Streams in one region and consumers in number of another regions. Consumers should receive messages regardless of whether they are delivered to other regions. Also consumers can be scaled in and out. Please advise how I can do the following

  1. Ensure that each consumer only read messages to which it's subscribed and doesn't read messages to which it shouldn't have access
  2. Scale Kinesis Data Stream based on consumer scaling. For example, consumer scaled-out by adding additional pod and then KDS adds more shards to the stream.
AWS
feita há 10 meses1040 visualizações
1 Resposta
0

In Kinesis data streams the access controls to stream is implemented using IAM policies , check out example here https://docs.aws.amazon.com/streams/latest/dev/controlling-access.html .

Regarding scaling, the recommended method is to use Kinesis Data Stream On-Demand Mode https://aws.amazon.com/blogs/aws/amazon-kinesis-data-streams-on-demand-stream-data-at-scale-without-managing-capacity/

AWS
respondido há 10 meses

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas