1 Answer
- Newest
- Most votes
- Most comments
0
For anyone that comes across this with the same problem:
-
Really consider using either the Hugging Face Deep Learning AMI from the AWS marketplace, or the Neuron DLAMI. While these show a cost, that cost is for the underlying instance. As of August 2024, there is no additional cost for the software.
-
If you really want to do it yourself, follow the instructions in the SDK documentation. In your case, it looks like you need to add the AWS repo to the apt sources. Current instructions for Ubuntu 22.04 are here under "Install Drivers and Tools": https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/pytorch/neuronx/ubuntu/torch-neuronx-ubuntu22.html#setup-torch-neuronx-ubuntu22
Relevant content
- asked 2 years ago
