SageMaker PyTorch Hosting 1.6 works only with artifacts named model.pth ?

0

Hi, does SageMaker PyTorch Hosting 1.6 works only with artifacts named model.pth ? I'm trying this sample with 1.6 and the deployment fails with error

FileNotFoundError: [Errno 2] No such file or directory: '/opt/ml/model/model.pth'

the documentation doesn't mention such a constraint

AWS
전문가
질문됨 3년 전741회 조회
1개 답변
1
수락된 답변

Yes - from the thread on this open issue: https://github.com/aws/sagemaker-pytorch-inference-toolkit/issues/86

In the issue thread they note that the new Pytorch 1.6 image requires that the model filename is model.pth, linking to the relevant code where this default is set: https://github.com/aws/sagemaker-pytorch-inference-toolkit/blob/9a6869e/src/sagemaker_pytorch_serving_container/torchserve.py#L121

Also noted in the thread is that users have successfully adapted their code to use torchserve in Pytorch 1.6 by changing it to save their model in a file named model.pth. Once renamed, they were still able to use custom inference scripts to load their model by defining a custom model_fn: https://github.com/data-science-on-aws/workshop/blob/374329adf15bf1810bfc4a9e73501ee5d3b4e0f5/09_deploy/wip/pytorch/code/inference.py

AWS
답변함 3년 전

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠