Kinesis Data Stream. Scaling and filtering

0

I have Kinesis Data Streams in one region and consumers in number of another regions. Consumers should receive messages regardless of whether they are delivered to other regions. Also consumers can be scaled in and out. Please advise how I can do the following

  1. Ensure that each consumer only read messages to which it's subscribed and doesn't read messages to which it shouldn't have access
  2. Scale Kinesis Data Stream based on consumer scaling. For example, consumer scaled-out by adding additional pod and then KDS adds more shards to the stream.
AWS
posta 10 mesi fa1047 visualizzazioni
1 Risposta
0

In Kinesis data streams the access controls to stream is implemented using IAM policies , check out example here https://docs.aws.amazon.com/streams/latest/dev/controlling-access.html .

Regarding scaling, the recommended method is to use Kinesis Data Stream On-Demand Mode https://aws.amazon.com/blogs/aws/amazon-kinesis-data-streams-on-demand-stream-data-at-scale-without-managing-capacity/

AWS
con risposta 10 mesi fa

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande