Create endpoint from Python

Question

Hello,  
  
I have trained my model on sagemaker. I have deleted the endpoint, but I am keeping the model and the endpoint configuration which points to the model.  
  
From the sagemaker dashboard I am able to recreate the endpoint using the existing endpoint configuration. However I don't want to keep the endpoint on all the time, as I will use it only once a day for a few minutes.  
  
Is it possible to create in on demand from a Python script? I would assume that it is possible, but can't find how. Can someone point me in the right direction?  
  
Regards.

Accepted Answer

Hello hugoflores,   
  
You can use SageMaker APIs - https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_DeleteEndpoint.html to delete the endpoint and https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreateEndpoint.html. to create an endpoint. This an be automated either using SageMaker Pipelines or a Lambda function.  
  
Here are a few resources towards that:  
  
https://awsfeed.com/whats-new/machine-learning/build-a-ci-cd-pipeline-for-deploying-custom-machine-learning-models-using-aws-services  
https://github.com/aws-samples/aws-lambda-layer-create-script  
https://github.com/aws/sagemaker-python-sdk/issues/1200  
https://aws.amazon.com/blogs/machine-learning/call-an-amazon-sagemaker-model-endpoint-using-amazon-api-gateway-and-aws-lambda/  
https://www.sagemakerworkshop.com/step/deploymodel/  
  
HTH,   
  
Chaitanya

Answer

Thanks Chaitanya,  
  
I was able to create the endpoint using the "create_endpoint" method and following one of the links provided.

```python
def create_endpoint(endpoint_name, config_name):
    """ Create SageMaker endpoint with input endpoint configuration.
    Args:
        endpoint_name (string): Name of endpoint to create.
        config_name (string): Name of endpoint configuration to create endpoint with.
    Returns:
        (None)
    """
    try:
        sagemaker.create_endpoint(
            EndpointName=endpoint_name,
            EndpointConfigName=config_name
        )
    except Exception as e:
        print(e)
        print('Unable to create endpoint.')
        raise(e)

name = 'name-of-the-endpoint'
config = 'name-of-the-endpoint-config' #this one has to exist on the Endpoint configuration list on sagemaker
create_endpoint(name, config)
```

Regards  
  
Edited by: hugoflores on Aug 17, 2021 9:36 AM

Create endpoint from Python

Relevanter Inhalt