Cannot Find Running Instance

Hello learn2skills: Thank you very much for your answer. I have followed the cleanup instructions earlier, and have no Notebooks or Endpoints. I will work to configure CloudWatch to see if that helps, but the billing shows the instance type and region. Will CloudWatch provide more information? Do you have additional suggestions? Thank you.

HI,

ml EC2 instances do not appear in the EC2 console. You can find their metrics in Cloudwatch though, and create dashboards to monitor what you need:

They don't appear in the EC2 UI and API as they are being managed by the SageMaker control plane

Notebook instance: you have two options if you do not want to keep the notebook instance running. If you would like to save it for later, you can stop rather than deleting it.

1. To stop a notebook instance: click the Notebook instances link in the left pane of the SageMaker console home page. Next, click the Stop link under the ‘Actions’ column to the left of your notebook instance’s name. After the notebook instance is stopped, you can start it again by clicking the Start link. Keep in mind that if you stop rather than delete it, you will be charged for the storage associated with it.

2. To delete a notebook instance: first stop it per the instruction above. Next, click the radio button next to your notebook instance, then select **Delete **from the Actions drop down menu.

Endpoints: these are the clusters of one or more instances serving inferences from your models. If you did not delete them from within a notebook, you can delete them via the SageMaker console. To do so:

1. Click the Endpoints link in the left panel.

2. Then, for each endpoint, click the radio button next to it, then select Delete from the Actions drop down menu.

3. You can follow a similar procedure to delete the related Models and Endpoint configurations.

Clean up

• Open the SageMaker console at https://console.aws.amazon.com/sagemaker/ and delete the notebook instance. Stop the instance before deleting it.

Refer-

1. https://docs.aws.amazon.com/sagemaker/latest/dg/automatic-model-tuning-ex-cleanup.html
2. https://docs.aws.amazon.com/sagemaker/latest/dg/realtime-endpoints-delete-resources.html

If the Answer is helpful, please click Accept Answer & UPVOTE, this can be beneficial to other community members.

@rePost-User-6397876

You can use the following script to find idle instances. You can modify the script to stop the instance if idle for more than 5 minutes or have a cron job to stop the instance.

import boto3

last_modified_threshold = 5 * 60
sm_client = boto3.client('sagemaker')
response = sm_client.list_notebook_instances()

for item in response['NotebookInstances']:
    last_modified_seconds = item['LastModifiedTime'].timestamp()
    last_modified_minutes = last_modified_seconds/60
    print(last_modified_minutes)
    if last_modified_minutes > last_modified_threshold:
        print('Notebook {0} has been idle for more than {1} minutes'.format(item['NotebookInstanceName'], last_modified_threshold/60))