How to avoid rate limiting in CodePipeline / CodeBuild

0

I have a CodePipeline that has 1 Source Stage with 1 Source Action, then 1 Build Stage with 3 Build Actions.

The 3 Build Actions are all run as batch executions and each one spins up about 50 instances. When I run this, 1/3 Build Actions fails with:

BATCH_START_BUILD_ERROR: Failed calling StartBuild for a batch.. Failed while calling StartBuild for buildType BATCH_BUILD with exception message: Rate exceeded (Service: AWSCodeBuild; Status Code: 400; Error Code: ThrottlingException; Request ID: <GUID>; Proxy: null)

In other words, CodeBuild is grumpy that I'm trying to simultaneously spawn 150ish instances.

What is the best way to avoid this? I know I could add a Stage and run the 3 Build Actions in 3 different Stages, but that would slow down the overall pipeline. Is there any way for me to request a limit increase for this or is there an alternative solution that would allow me to run this in parallel?

  • Hi, have you tried requesting a quota increase for "Concurrently running builds for <type>/<size>". You can have a look at the default quotas and steps to request increases through the User Guide.

  • Hi @Gary_S - Good suggestion, but I am already allocated double the number of builds I need in that category (300). This seems to be an API rate limiter in the internal request from CodeBuild to spin up an instance.

질문됨 10달 전54회 조회
답변 없음

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠