glue job not running ??

0

''failed to execute with exception Task allocated capacity exceeded the limit. (Service: AWSGlueJobExecutor; Status Code: 400; Error Code: InvalidInputException; Request ID: 8d31d112-91e4-4892-900f-048d993e0da1; Proxy: null) this error is coming when ever I run a job.

saksham
asked 2 years ago1871 views
1 Answer
0

It would be helpful to understand more details to understand why you are facing this issue.

In my experience, I have faced this exact same issue when I use more than 300 under "Requested number of workers". The maximum number of workers you can define is

  • 299 for G.1X (For AWS Glue version 2.0 or later jobs)
  • 149 for G.2X (For AWS Glue version 2.0 or later jobs)
  • For older job types that use "Standard", choose an integer from 2 to 100. The default is 10.

Another reason could be the service quotas and you could check your quotas. You can use Service Quotas console to view and request increases for most AWS quotas.

profile pictureAWS
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions