SageMaker Multi Model EndPoint and Inference Data Capture feature


Does Data Capture feature used for model monitor and analytics work with the multi model endpoint (one container).. we ran into an error. See error " An error occurred (ValidationException) when calling the CreateEndPointConfig operation: Data Capture Feature is not supported with MultiModel mode" Theoretically, it should work because it is calling the DataCaptureConfig:

from sagemaker.model_monitor import DataCaptureConfig

endpoint_name = 'your-pred-model-monitor-' + strftime("%Y-%m-%d-%H-%M-%S", gmtime()) print("EndpointName={}".format(endpoint_name))

data_capture_config=DataCaptureConfig( enable_capture = True, sampling_percentage=100, destination_s3_uri=s3_capture_upload_path)

asked 2 years ago941 views
1 Answer
Accepted Answer

SageMaker multi-model endpoints do not have support for SageMaker Model monitor as of writing this answer. So the error is pointing to exactly that.

However, if you are looking to implement data drift using sagemaker model monitor then you can do that my mimicking data capture config functionality by capturing inference input and prediction output and storing it in the format supported by Model Monitor. And then setup a customer monitoring container using the instructions listed

answered 2 years ago
profile picture
reviewed 3 months ago
  • Thank you for the confirmation and workaround. We will give it a try. Appreciate it!

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions