Kinesis Data Stream. Scaling and filtering

0

I have Kinesis Data Streams in one region and consumers in number of another regions. Consumers should receive messages regardless of whether they are delivered to other regions. Also consumers can be scaled in and out. Please advise how I can do the following

  1. Ensure that each consumer only read messages to which it's subscribed and doesn't read messages to which it shouldn't have access
  2. Scale Kinesis Data Stream based on consumer scaling. For example, consumer scaled-out by adding additional pod and then KDS adds more shards to the stream.
AWS
demandé il y a 10 mois1035 vues
1 réponse
0

In Kinesis data streams the access controls to stream is implemented using IAM policies , check out example here https://docs.aws.amazon.com/streams/latest/dev/controlling-access.html .

Regarding scaling, the recommended method is to use Kinesis Data Stream On-Demand Mode https://aws.amazon.com/blogs/aws/amazon-kinesis-data-streams-on-demand-stream-data-at-scale-without-managing-capacity/

AWS
répondu il y a 10 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions