One glue job for multiple workflows

0

Hello there:

We have ingest jobs A, B, C, and D and Transformation jobs X and Y in PySpark

For Workflow 1: the steps are:

  1. Once Job A, B, and C successfully done
  2. Start transformation job X

For Workflow 2: the steps are:

  1. Once job A, C, and D are successfully done
  2. Start transformation job Y

Jobs A, B, C, and D need to run only once (if it runs in Workflow 1, it should nor run in Workflow 2) Does Glue job workflow support this?

Please advise

Thanks a lot in advance

Li

asked 2 years ago106 views
No Answers

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions