Using Pytorch 2.0.1 on INF2 instance in Sagemaker

0

hello, i'm using pytorch-inference:2.0.1-gpu-py310-cu118-ubuntu20.04-sagemaker image to run the service i'd like to switch to INF2 instance. I think i can try to use pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.14.1-ubuntu20.04 image and follow this guide https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu20-pytorch-dlami.html#setup-torch-neuronx-ubuntu20-dlami-pytorch the question is:

  1. will pytorch 2.0.1 be supported using AWS neuron? (worry about compilation errors going forward)
  2. If not how i could make it work/is it currently possible?

Thank you for your help! :)

Ana
asked a year ago678 views
1 Answer
1
AWS
answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions