How to register a multi container model to a model registry?
I have created a multi-container model in SageMaker notebook and deployed it through an endpoint. But while attempting to do the same through a SageMaker Studio Project (build, train and deploy model template), I need to register the multi-container model through a 'sagemaker.workflow.step_collections.RegisterModel' step, which I am unable to do. What I understand till now is multi-container model is created through boto3 api call. I haven't found a way to create it using 'sagemaker.model.Model' and hence not being able to register it. Please help.
in order to register a multi-container model you need to use the PipelineModel class instead of the Model one you are trying to do currently.
An example of this can be found in this notebook: https://github.com/aws/amazon-sagemaker-examples/blob/main/sagemaker-pipelines/tabular/train-register-deploy-pipeline-model/train%20register%20and%20deploy%20a%20pipeline%20model.ipynb
In this example a pipeline model is created with 2 containers, first one is an sklearn one doing some preprocessing and the second an XGBoost one for ML inference. However, in your case, the number or containers, type, invocation order and more, may differ, but you should be able to draw parallels based on this example.
Hope this helps,
Thank you for the answer. Please correct me if I'm wrong but in case of an inference pipeline using a PipelineModel class, the models are run serially and the output of the first model goes in as input of second model. What I'm trying to achieve is through invoking the same endpoint, I want to retrieve output from a sentiment prediction model and an intent recognition model.
SageMaker endpoint creation fails for Multi Modelasked 3 months ago
Tracking the lineage between Amazon SageMaker endpoint model and Model Monitor captured dataAccepted AnswerEXPERTasked 2 years ago
SageMaker Multi Model endpoint creation fails while creating for model built on container sagemaker-scikit-learn:0.23-1-cpu-py3asked a month ago
SageMaker Model Registry - how to set the Stage column of a Model Package?asked 7 months ago
SageMaker Multi Model EndPoint and Inference Data Capture featureAccepted Answerasked 3 months ago
Host multiple TensorFlow computer vision models using Amazon SageMaker multi-model endpointsasked 5 months ago
Accessing SageMaker model after registering itAccepted Answerasked 4 months ago
Batch deployment from model registryasked 17 days ago
How to register a multi container model to a model registry?asked 11 days ago
How to create (Serverless) SageMaker Endpoint using exiting tensorflow pb (frozen model) file?asked 2 months ago