1개 답변
- 최신
- 최다 투표
- 가장 많은 댓글
0
❓Can you describe the specific jobs and triggers within your workflow, particularly how many there are, their complexity, and the detail level of the logs they generate?
🍀 A hypothesis for the error in your AWS Glue workflow could be that the workflow is configured with a high logging verbosity, leading to the generation of extensive detailed logs for each job and trigger.
There was a trigger linked to 80 jobs, we changed it and left 37. The only problem is that it doesn't always cause a problem, some days it runs then the next it doesn't run and out of nowhere the next day it runs normally (before changing anything)
The problem that I still don't understand is why the Workflow itself doesn't generate a more specific error, researching this error I didn't find anything and I didn't find how to enable logging in the workflow
Thanks for the help