What is the difference between SageMaker Pipelines and SageMaker Step Function SDK?

Question

The [official Pipelines notebook][1] is basically only doing a workflow - pretty much a copy cat of what step functions has been doing for years. In the nice video from [Julien Simon][2] I see CICD capacities mentioned, where are those? any demos?

[1]: https://github.com/aws/amazon-sagemaker-examples/blob/master/sagemaker-pipelines/sagemaker-pipelines-preprocess-train-evaluate-batch-transform.ipynb
  [2]: https://www.youtube.com/watch?v=Hvz2GGU3Z8g

Accepted Answer

Hey, that demo is missing the project part of Pipelines and therefore the SM provided project templates. Go to SM studio and on the Studio summary hit edit settings and then enable access and provisioning of Service Catalog Portfolio of products in SM Studio. Then check your service catalog portfolios.
Haven't tried it out yet though.

Answer

both StepFunctions and SageMaker pipeline can be used to build a pipeline for ML. In the end, we need a SageMaker DAG StepFunction can integrate with different services, and good when one already used it. SageMaker pipeline is natively integrated with SageMaker system.

This is my example using both to build a ML Pipeline GitHub

This is my example using both to build a ML Pipeline 
[GitHub](https://github.com/entest-hai/sagemaker-pipeline/tree/stepfunctions)

What is the difference between SageMaker Pipelines and SageMaker Step Function SDK?

Relevanter Inhalt