We would need a bit more information to help you, including a bit more detail on how you create the model (code wise) as well as more details on the errors you receive.
I would also suggest first trying out one of the available examples for multi model endpoints, like this one: Amazon SageMaker Multi-Model Endpoints using Scikit Learn and from there modify to your own needs.
SageMaker Multi Model EndPoint and Inference Data Capture featureAccepted Answerasked 6 months ago
Accessing SageMaker model after registering itAccepted Answerasked 7 months ago
Register MultiDataModel in Model Registryasked 2 months ago
Sagemaker Endpoint is not created when deploying HuggingFace Model using it.asked 2 months ago
SageMaker Multi Model endpoint creation fails while creating for model built on container sagemaker-scikit-learn:0.23-1-cpu-py3asked 4 months ago
SageMaker Model SpendAccepted Answerasked 2 years ago
Does SageMaker Multi-Model Endpoint support SageMaker Model Monitor?Accepted AnswerEXPERTasked 2 years ago
Failing to create multi-model endpointasked 2 years ago
SageMaker endpoint creation fails for Multi Modelasked 6 months ago
How to register a multi container model to a model registry?asked 3 months ago