Does AWS Kinesis auto scaling support setting different level of parallelism for different operators?

0

We are trying to run a Query on AWS Kinesis, and use autoscaling.

We found that if user specified the Parallelism option in AWS Kinesis configuration, AWS Kinesis will apply the specified parallelism to all the operators.

We also tried run the query without specifing any parallelism (set ConfigurationType to DEFAULT). And in this case, Kinesis will only start 1 task manager with 1 slots, even if that's not enough to run our Query.

So we are wondering does AWS Kinesis auto scaling supports setting different level of parallelism for different operators?

Thanks

posta 2 anni fa59 visualizzazioni
Nessuna risposta

Accesso non effettuato. Accedi per postare una risposta.

Una buona risposta soddisfa chiaramente la domanda, fornisce un feedback costruttivo e incoraggia la crescita professionale del richiedente.

Linee guida per rispondere alle domande