SageMaker endpoint creation fails for Multi Model


When using scikit to create multi model, it throws an exception, but when in single model it works.

Complains about model_fn implementation or ping issues, any tips on how to fix this?

e.g container={\n", " 'Image' : image_uri,", " 'Mode': 'MultiModel',", " 'ModelDataUrl': 's3://somepatch/with/all/models/,", " 'Environment': {'SAGEMAKER_SUBMIT_DIRECTORY': mme_artifacts_path,", " 'SAGEMAKER_PROGRAM': ''} "

File "/miniconda3/bin/serve", line 8, in <module> sys.exit(serving_entrypoint()) File "/miniconda3/lib/python3.7/site-packages/sagemaker_sklearn_container/", line 144, in serving_entrypoint start_model_server() File "/miniconda3/lib/python3.7/site-packages/sagemaker_sklearn_container/", line 124, in start_model_server modules.import_module(serving_env.module_dir, serving_env.module_name) File "/miniconda3/lib/python3.7/site-packages/sagemaker_containers/", line 263, in import_module six.reraise(_errors.ImportModuleError, _errors.ImportModuleError(e), sys.exc_info()[2]) File "/miniconda3/lib/python3.7/site-packages/", line 702, in reraise raise value.with_traceback(tb) File "/miniconda3/lib/python3.7/site-packages/sagemaker_containers/", line 258, in import_module module = importlib.import_module(name) File "/miniconda3/lib/python3.7/importlib/", line 118, in import_module if name.startswith('.'):

preguntada hace 2 años464 visualizaciones
1 Respuesta


We would need a bit more information to help you, including a bit more detail on how you create the model (code wise) as well as more details on the errors you receive.

I would also suggest first trying out one of the available examples for multi model endpoints, like this one: Amazon SageMaker Multi-Model Endpoints using Scikit Learn and from there modify to your own needs.

respondido hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas