Does AWS Kinesis auto scaling support setting different level of parallelism for different operators?

0

We are trying to run a Query on AWS Kinesis, and use autoscaling.

We found that if user specified the Parallelism option in AWS Kinesis configuration, AWS Kinesis will apply the specified parallelism to all the operators.

We also tried run the query without specifing any parallelism (set ConfigurationType to DEFAULT). And in this case, Kinesis will only start 1 task manager with 1 slots, even if that's not enough to run our Query.

So we are wondering does AWS Kinesis auto scaling supports setting different level of parallelism for different operators?

Thanks

asked 2 years ago55 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions