ModelError while using InvokeEndpoint with Sagemaker

Question

I've deployed a pytorch model onto Sagemaker and have confirmed that the endpoint is in service, but using the invoke endpoint operation results in the following error: **"ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error (500) from primary and could not load the entire response body."**
I've ensured that the tar.gz file contains the inference code, model, tokenizer, etc., and have tried simplifying the model script so it returns the bare minimum to make sure there are no problems with how data is being processed, but the error persists. 
If anyone has experienced this before or has any advice on what to try, I'd appreciate any help!

rePost-User-5414752 · Accepted Answer

Hi Siddharth,

There's not a whole lot of information for us to go off from here. It's a general error, but I've faced it before when passing the inputs to the model incorrectly. What type of data are you trying pass through?

A suggestion is to try run [Sagemaker in local mode](https://docs.aws.amazon.com/sagemaker/latest/dg/pipelines-local-mode.html). If you run locally, do you experience a similar error?

To help more, I'd need to see any further tracebacks, cloudwatch logs or more information on what you're trying to achieve.

Let me know how you get on.

Cheers
James

ModelError while using InvokeEndpoint with Sagemaker

添加回答

相关内容