Al usar AWS re:Post, aceptas las AWS re:Post Términos de uso
AWS re:Postre:Post

Workflow run metadata size exceeded.

0

Hello,

We have an AWS Glue Workflow that triggers a a lot of jobs, but eventually, out of the blue an error occurs in the workflow that doesn't generate any logs: Workflow run metadata size exceeded.

Any thoughts to fix that?

Temas
Análisis
Etiquetas
AWS Glue
Idioma
English
Marcelo
preguntada hace 2 meses100 visualizaciones
1 Respuesta
1
Respuesta aceptada

❓Can you describe the specific jobs and triggers within your workflow, particularly how many there are, their complexity, and the detail level of the logs they generate?

🍀 A hypothesis for the error in your AWS Glue workflow could be that the workflow is configured with a high logging verbosity, leading to the generation of extensive detailed logs for each job and trigger.

profile picture
EXPERTO
Osvaldo Marte
respondido hace 2 meses
profile picture
EXPERTO
Oleksii Bebych
revisado hace 11 días
profile picture
EXPERTO
A_J
revisado hace 2 meses
  • Marcelo
    hace 2 meses

    There was a trigger linked to 80 jobs, we changed it and left 37. The only problem is that it doesn't always cause a problem, some days it runs then the next it doesn't run and out of nowhere the next day it runs normally (before changing anything)

    The problem that I still don't understand is why the Workflow itself doesn't generate a more specific error, researching this error I didn't find anything and I didn't find how to enable logging in the workflow

    Thanks for the help

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas

Contenido relevante