One glue job for multiple workflows

0

Hello there:

We have ingest jobs A, B, C, and D and Transformation jobs X and Y in PySpark

For Workflow 1: the steps are:

  1. Once Job A, B, and C successfully done
  2. Start transformation job X

For Workflow 2: the steps are:

  1. Once job A, C, and D are successfully done
  2. Start transformation job Y

Jobs A, B, C, and D need to run only once (if it runs in Workflow 1, it should nor run in Workflow 2) Does Glue job workflow support this?

Please advise

Thanks a lot in advance

Li

feita há 2 anos112 visualizações
Sem respostas

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas