Does AWS Kinesis auto scaling support setting different level of parallelism for different operators?

0

We are trying to run a Query on AWS Kinesis, and use autoscaling.

We found that if user specified the Parallelism option in AWS Kinesis configuration, AWS Kinesis will apply the specified parallelism to all the operators.

We also tried run the query without specifing any parallelism (set ConfigurationType to DEFAULT). And in this case, Kinesis will only start 1 task manager with 1 slots, even if that's not enough to run our Query.

So we are wondering does AWS Kinesis auto scaling supports setting different level of parallelism for different operators?

Thanks

preguntada hace 2 años59 visualizaciones
No hay respuestas

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas