The above notebook shows how to seed a pre-existing model in an already built container. This functionality could be replicated with other Amazon SageMaker Algorithms, as well as the TensorFlow and MXNet containers. Although this is certainly an easy method to bring your own model, it is not likely to provide the flexibility of a bringing your own scoring container. Please refer to other example notebooks which show how to dockerize your own training and scoring container which could be modified appropriately to your use case.
In general it is recommended to Bring your Own docker container along with your custom model, SageMaker Inference Toolkit is a library that bootstraps MMS in a way that is compatible with SageMaker multi-model endpoints, while still allowing you to tweak important performance parameters, such as the number of workers per model. The inference container in this example uses the Inference Toolkit to start MMS which can be seen in the
In order to deep-dive further I would request you to open a support ticket with the aws premium support for further investigation in to the cloudwatch logs and the specific resource of the endpoint.
If you still have difficulties, I recommend to cut a support case and provide more detail about your account information and cloudwatch logs. Due to security reason, we cannot discuss account specific issue in the public posts.
SageMaker endpoint creation fails for Multi Modelasked 6 months ago
Tracking the lineage between Amazon SageMaker endpoint model and Model Monitor captured dataAccepted Answer
SageMaker Multi Model endpoint creation fails while creating for model built on container sagemaker-scikit-learn:0.23-1-cpu-py3asked 4 months ago
SageMaker Model SpendAccepted Answerasked 2 years ago
Redshift ML with multi-container Sagemaker modelasked 2 months ago
SageMaker Multi Model EndPoint and Inference Data Capture featureAccepted Answerasked 6 months ago
How to register a multi container model to a model registry?asked 3 months ago
Cloudformation Deployment for Serverless Sagemaker Model Endpointasked 3 months ago
Does SageMaker Multi-Model Endpoint support SageMaker Model Monitor?Accepted Answer
Failing to create multi-model endpointasked 2 years ago