1 Antwort
- Neueste
- Die meisten Stimmen
- Die meisten Kommentare
2
Hi! Good question.
For General Glue Service Quotas (Limits), please see here: https://docs.aws.amazon.com/general/latest/gr/glue.html
Default Glue Quotas include things like:
- Max concurrent job runs per account (50)
- Max jobs per trigger (50)
To increase those and other limits, you can open a Service Quota Increase Request.
For Throttling Exceptions (https://docs.aws.amazon.com/glue/latest/webapi/CommonErrors.html), I'm not sure on the exact limit where API calls will get limited - if that's the case, you may need to use exponential backoff to retry (I've seen this for other API calls): https://docs.aws.amazon.com/general/latest/gr/api-retries.html
beantwortet vor 2 Jahren
Thanks. I ended up using the retry/back off options on each of those jobs to have them retry after 5 seconds.
Relevanter Inhalt
- AWS OFFICIALAktualisiert vor 2 Jahren
- AWS OFFICIALAktualisiert vor einem Jahr
- AWS OFFICIALAktualisiert vor einem Jahr
- AWS OFFICIALAktualisiert vor einem Jahr
Hello tjtoll, would you mind to post the code snippet, which solves the issue for your case?
Would be highly appreciate, thank you very much!
Kind regards, Armin