One glue job for multiple workflows

0

Hello there:

We have ingest jobs A, B, C, and D and Transformation jobs X and Y in PySpark

For Workflow 1: the steps are:

  1. Once Job A, B, and C successfully done
  2. Start transformation job X

For Workflow 2: the steps are:

  1. Once job A, C, and D are successfully done
  2. Start transformation job Y

Jobs A, B, C, and D need to run only once (if it runs in Workflow 1, it should nor run in Workflow 2) Does Glue job workflow support this?

Please advise

Thanks a lot in advance

Li

已提問 2 年前檢視次數 112 次
沒有答案

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南