By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

ResourceNumberLimitExceededException but Quotas are Okay

0

Hi Everyone, I'm having an issue with AWS Glue ETL Job. Every time I try to run the Job it return me the following error:

Failed to start job [gluestudio-service.us-east-1.amazonaws.com] startJobRun: ResourceNumberLimitExceededException: Reached the limit while starting a run for job with name: ctag-dgzt-zaragoza-consumes-clean. (Service: AWSGlue; Status Code: 400; Error Code: ResourceNumberLimitExceededException; Request ID: f3ff0e11-9534-4683-ba32-1cb69a348f70; Proxy: null)

I'm not able to find the log in Cloud Watch and dig deeper in the problem. I read that sometimes Quotas deconfigure themselves but mines all are setted to default value (At least those related with Glue Service).

The job is pretty simple and I have the exactly same configuration running in another AWS Account. I'm out of ideas here :(

Thank you very much!

Topics
Analytics
Tags
AWS Glue
Language
English
sauleiros
asked 9 months ago169 views
1 Answer
0

Please check "max concurrent job runs per account" quota at service quota console for glue service.

I understand that you have already checked service quota values, but in my experience, when I faced this error, I had to reach out to AWS support to get it fixed however I have seen cases where this quota value is lesser than the actual number of jobs running in that account, so please make sure that total number of jobs running in that account is less than this quota "max concurrent job runs per account" value. Also check "Max jobs per trigger" service quota value.

When you check the service quotas, make sure that region is same in which you are running glue jobs.

Additional Reference:

Glue Start Job Errors

Hope you find this information helpful.

Comment here if you have additional questions, happy to help.

Abhishek

profile pictureAWS
EXPERT
secondabhi_aws
answered 9 months ago
  • sauleiros
    9 months ago

    Thanks for the quick answer. Unfortunatelly I already checked this, and seems to be normal. And there are no other jubs runing.

    Max concurrent jobs per account are configured to 200, as the default value.

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content