A fargate task schedule via EventBridge fails to launch sometimes with stopReason "Rate limit exceeded while preparing network interface to be attached to instance"

Hello all,

Our environment contains:

AWS EventBridge event to run an AWS Fargate task once an hour;
AWS ECS event and lambda to monitor task status changes

Lately, we sometimes see that the AWS Fargate task fails to start due to the stopReason:

Rate limit exceeded while preparing network interface to be attached to instance

I have checked our quotas, and we are very far (<50 ENIs out of 5000 per region).

What is the cause for this error?
Is a retry (the lambda to RunTask the task) a good workaround?

Thank you in advance, Boris.

주제

서버리스 컨테이너 애플리케이션 통합

태그

AWS Fargate 아마존 EventBridge 컨테이너

언어

English

Boris Figovsky

질문됨 2년 전781회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

It sounds as though perhaps there's something in your account/region, unknown to you so far, that is manipulating ENIs frequently. I would recommend enabling CloudTrail and checking the activity logs for EC2 AttachNetworkInterface actions. A high request rate could result in the symptom you're describing.

전문가

MichaelFischer

답변함 2년 전

Rodney Lester
2년 전
You can then make a request for a limit increase via support.
Boris Figovsky
2년 전
I have CloudTrail enabled with API access set to All, and the AttachNetworkInterface event is missing. In the RunTask event with the EventBridge identity, I do see the response: the task's launchType is FARGATE and the ENI's state is PRECREATED.

A fargate task schedule via EventBridge fails to launch sometimes with stopReason "Rate limit exceeded while preparing network interface to be attached to instance"

관련 콘텐츠