Perché Kinesis Data Firehose crea tutti questi piccoli file in S3?

Come posso rilevare e risolvere le eccezioni ReadProvisionedThroughputExceeded in Flusso di dati Amazon Kinesis?

Perché si verifica un errore di consegna dei dati in Kinesis Data Firehose con un dominio Servizio OpenSearch come destinazione?

Come posso modificare il numero di partizioni aperte nel flusso di dati Kinesis?

Yesterday we saw an event that couple of `Shards` in our Kinesis data streams were not processed at all.

## Setup

We have a kinesis stream and we have a fargate service which is consuming the records from kinesis shards.

### We have total 16 shards and 16 ECS tasks consuming from these shards.

### What could be the possible root causes for stuck shards? What all things we should lookout for to debug this as we are seeing this issue continuously

[Orphaned Kinesis Shards] Shards got stuck and are not processing any data

Setup

We have total 16 shards and 16 ECS tasks consuming from these shards.

What could be the possible root causes for stuck shards? What all things we should lookout for to debug this as we are seeing this issue continuously

Contenuto pertinente