One glue job for multiple workflows

0

Hello there:

We have ingest jobs A, B, C, and D and Transformation jobs X and Y in PySpark

For Workflow 1: the steps are:

  1. Once Job A, B, and C successfully done
  2. Start transformation job X

For Workflow 2: the steps are:

  1. Once job A, C, and D are successfully done
  2. Start transformation job Y

Jobs A, B, C, and D need to run only once (if it runs in Workflow 1, it should nor run in Workflow 2) Does Glue job workflow support this?

Please advise

Thanks a lot in advance

Li

已提问 2 年前112 查看次数
没有答案

您未登录。 登录 发布回答。

一个好的回答可以清楚地解答问题和提供建设性反馈,并能促进提问者的职业发展。

回答问题的准则