how to hook up CI/CD with sagemaker pipelines in sagemaker sudio?

0

https://github.com/aws/amazon-sagemaker-examples/blob/main/sagemaker-pipelines/tabular/abalone_build_train_deploy/sagemaker-pipelines-preprocess-train-evaluate-batch-transform.ipynb, I have created various pipeline step and tie those together and create a pipeline at the end. once these pipelines are created , how do i link this pipeline with steps for data preprocessing, training with other pipelines, say one for evaluation , another for deployment. is there anything inbuild in sagemaker studio to do this , or do we have to write our own code for this ? how can i link/feed output/artifact from one pipeline to another?

from sagemaker.workflow.steps import TrainingStep
from sagemaker.workflow.steps import ProcessingStep
from sagemaker.workflow.pipeline import Pipeline

processor_args = sklearn_processor.run(    inputs=  ...  ,    outputs=...  ,    code="code/preprocessing.py",)

my_processing_step = ProcessingStep(name="my_processing_step ", step_args=processor_args)

.....
my_training_train = TrainingStep(    name="my_training_train ",    step_args=train_args,)
...
pipeline_name = f"experiment_Pipeline"
pipeline = Pipeline(   name=pipeline_name,
    parameters= .., 
    steps=[my_processing_step , my_training_train  ...],
)

1 Antwort
0

SageMaker PipelineAmazon SageMaker Model Building Pipelines Normally, registering a model is the end of life of a pipeline. For now, AFAIK, there is no linking facilities in SageMaker Pipeline.

However, you may consider SageMaker Project, which is another feature in SageMaker Studio. It maintain a whole CI/CD workflow, by linking sagemaker model build pipeline with codepipeline/codecommit to achieve the secondary evaluation and deployment in staging/prod. Details about SageMaker Project via https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-projects-whatis.html

AWS
beantwortet vor einem Jahr

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen