By using AWS re:Post, you agree to the Terms of Use

Difference between a Job that is tied to a Project vs Recipe + Dataset


When you create a job you can associate it with a project OR specifically enter the dataset and recipe to be used.
Say we have Project_A that uses Recipe_A and Dataset_A.
What would be the difference of creating a job by using Project_A vs specifying Recipe_A + Dataset_A.
Would they be identical?

asked 2 years ago15 views
2 Answers

The main difference is in the use case, whether you're in an experimental phase of building up a recipe and trying it out (via a project job) or operationalizing (via a standalone recipe job).

A standalone recipe job (Recipe_A + Dataset_A) also requires that your recipe is published - 1.0, 2.0, etc. With the project job DataBrew implicitly creates a snapshot of the Working version of the recipe as a new minor version - 0.2, 0.3, etc

Hope this helps clarify!

  • Romi
answered 2 years ago

This makes sense -- thanks for the reply!

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions