Hello there:
We have ingest jobs A, B, C, and D and Transformation jobs X and Y in PySpark
For Workflow 1: the steps are:
- Once Job A, B, and C successfully done
- Start transformation job X
For Workflow 2: the steps are:
- Once job A, C, and D are successfully done
- Start transformation job Y
Jobs A, B, C, and D need to run only once (if it runs in Workflow 1, it should nor run in Workflow 2)
Does Glue job workflow support this?
Please advise
Thanks a lot in advance
Li