Is it possible to link sagemaker notebook jobs?

Question

Hi I'm working on a project where I would like to schedule notebook jobs so that one notebook job is triggered after conclusion of another notebook job.

In other words, I would like to schedule notebook job 'A' to run every monday at 0 hours (chron '0 0 * * 1') then notebook job 'B' to run on job 'A' completion and so on A->B->C->...->N --for any given amount of jobs.

Is this possible?

Didier Durand · Answer

Hi, 
Sagemaker Pipelines is probably what you are looking for: https://aws.amazon.com/sagemaker/pipelines/

Also have a look at https://docs.aws.amazon.com/sagemaker/latest/dg/pipelines-sdk.html

Riku_Kobayashi · Answer

I believe it is possible to manage SageMaker jobs using Step Functions.  
https://docs.aws.amazon.com/step-functions/latest/dg/connect-sagemaker.html  
https://sagemaker-examples.readthedocs.io/en/latest/step-functions-data-science-sdk/machine_learning_workflow_abalone/machine_learning_workflow_abalone.html

Is it possible to link sagemaker notebook jobs?

Add your answer

Relevant content