How can I have a model with different weights on sage maker?

Question

Hi,

I want to deploy a model to sagemaker, however this model takes In different weights depending on some scenarios. Is there any way that I can deploy an endpoint which is able to use different weights?

Thanks

Answer

Hi,

As per my understanding you are looking for providing weight to your model so that you can can distribute the number of calls to the model.

To achieve this you can provide the value of weight for `InitialVariantWeight` while creating your endpoint config.

You can refer below article to provide weight while creating or updating the endpoints
https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreateEndpointConfig.html
https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_UpdateEndpointWeightsAndCapacities.html#API_UpdateEndpointWeightsAndCapacities_RequestSyntax

Thanks

How can I have a model with different weights on sage maker?

Relevant content