how to hook up CI/CD with sagemaker pipelines in sagemaker sudio?

0

https://github.com/aws/amazon-sagemaker-examples/blob/main/sagemaker-pipelines/tabular/abalone_build_train_deploy/sagemaker-pipelines-preprocess-train-evaluate-batch-transform.ipynb, I have created various pipeline step and tie those together and create a pipeline at the end. once these pipelines are created , how do i link this pipeline with steps for data preprocessing, training with other pipelines, say one for evaluation , another for deployment. is there anything inbuild in sagemaker studio to do this , or do we have to write our own code for this ? how can i link/feed output/artifact from one pipeline to another?

from sagemaker.workflow.steps import TrainingStep
from sagemaker.workflow.steps import ProcessingStep
from sagemaker.workflow.pipeline import Pipeline

processor_args = sklearn_processor.run(    inputs=  ...  ,    outputs=...  ,    code="code/preprocessing.py",)

my_processing_step = ProcessingStep(name="my_processing_step ", step_args=processor_args)

.....
my_training_train = TrainingStep(    name="my_training_train ",    step_args=train_args,)
...
pipeline_name = f"experiment_Pipeline"
pipeline = Pipeline(   name=pipeline_name,
    parameters= .., 
    steps=[my_processing_step , my_training_train  ...],
)

1 Answer
0

SageMaker PipelineAmazon SageMaker Model Building Pipelines Normally, registering a model is the end of life of a pipeline. For now, AFAIK, there is no linking facilities in SageMaker Pipeline.

However, you may consider SageMaker Project, which is another feature in SageMaker Studio. It maintain a whole CI/CD workflow, by linking sagemaker model build pipeline with codepipeline/codecommit to achieve the secondary evaluation and deployment in staging/prod. Details about SageMaker Project via https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-projects-whatis.html

AWS
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions