Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

ECS RunTask API throttling

0

Hi Team,

I have so many schedules run in AWS EventBridge schedules approx (3500+) out of which more than 30 schedules run in every minute, but the rate quota for the calls to the amazon ECS RunTask API is 20 calls per second, so what is happening, there could be a chance all the 30 executions that needs to be run in a min could fire all at same second, so initial 20 will fire, another 10 will be throttle. My all schedules are of cron execution type, which can not be handled at second level, we have control over min level only. If I will go for at(...) execution type then this is one time schedule means my hourly jobs needs to be updated their timestamp in every hour also daily running jobs should be updating every day.

what should I do?? or I should ask AWS support team to increase the quota. but the thing is there is no any limit, it could be 50 trigger as well in a minute.

Topics
Application IntegrationDevOps
Tags
DevOpsAmazon EventBridge SchedulerAmazon EventBridge
Language
English

asked a year ago276 views

2 Answers
0

When you create a schedule in EventBridge, you have the opportunity to choose a flexible time window. This allows the scheduler to randomly distribute your schedule invocations within the time window you specify, reducing the likelihood of all schedules being fired at the same second and thus, hitting ECS runTask limit.

Besides, consider configuring a retry policy and dead letter queue for those scenarios when the invocation fails. EventBridge Scheduler will attempts to retry them according to your settings, increasing the likelihood of all them being processed.

If none of the above works, you may need to re-architect the solution. You could have an SQS queue as a the target of your schedules and trigger your ECS tasks based off the queue at the supported rate.

AWS

answered a year ago

-1

You can service quota in your AWS console. This will shows the applied quotas for each service. Filter/search by ECS and you can find the relevant quota. If the quota is adjustable, then you can update it or you might need to log a support ticket. If it's not adjustable - that is a hard limit, then you cannot update it. You will need to rearchitect your design to overcome the hard limit.

EXPERT

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content