For the most recent update on ongoing service disruptions affecting the AWS Middle East (UAE) Region (ME-CENTRAL-1), refer to the AWS Health Dashboard. For information on AWS Service migration, see How do I migrate my services to another region?
Not found the "pytorch-1.13 environment for Inf1" in the “Deep Learning AMI Neuron (Ubuntu 22.04)”
AWS Neuron Documentation says that the “Deep Learning AMI Neuron (Ubuntu 22.04)” has "pytorch-1.13 environment for Inf1" as below.
Step 2: Activate the desired virtual environment
You can activate one of the virtual environments below depending on the library or framework you are interested in.
...
PyTorch Neuron 1.13.1 (Inf1) (Torch Neuron) | source /opt/aws_neuron_venv_pytorch_1_13_inf1/bin/activate
However, it does not, which seems to be a documentation error obviously.
$ source /opt/aws_neuron_venv_pytorch_1_13_inf1/bin/activate
-bash: /opt/aws_neuron_venv_pytorch_1_13_inf1/bin/activate: No such file or directory
$ ls /opt/
amazon/ aws_neuronx_venv_pytorch_2_5_nxd_training/
aws/ aws_neuronx_venv_pytorch_2_5_transformers/
aws_neuron_venv_tensorflow_2_10_inf1/ aws_neuronx_venv_tensorflow_2_10/
aws_neuronx_venv_jax_0_4/ containerd/
aws_neuronx_venv_pytorch_2_5/ eni/
aws_neuronx_venv_pytorch_2_5_nxd_inference/
Welcome to Ubuntu 22.04.5 LTS (GNU/Linux 5.15.0-1031-aws x86_64)
* Documentation: https://help.ubuntu.com
* Management: https://landscape.canonical.com
* Support: https://ubuntu.com/pro
=============================================================================
__| __|_ )
_| ( / Deep Learning AMI Neuron 2.21.1 (Ubuntu 22.04)
___|\___|___|
=============================================================================
* Supported EC2 instances: Inf1, Inf2, Trn1, Trn1n, Trn2.
* To activate pre-built pytorch-2.5 environment for Inf2 and Trn* run: 'source /opt/aws_neuronx_venv_pytorch_2_5/bin/activate'
* To activate pre-built pytorch-2.5 NxDI environment for Inf2 and Trn* run: 'source /opt/aws_neuronx_venv_pytorch_2_5_nxd_inference/bin/activate'
* To activate pre-built pytorch-2.5 NxDT environment for Inf2 and Trn* run: 'source /opt/aws_neuronx_venv_pytorch_2_5_nxd_training/bin/activate'
* To activate pre-built Transformers NeuronX (PyTorch 2.5) environment for Inf2 and Trn* run: 'source /opt/aws_neuronx_venv_pytorch_2_5_transformers/bin/activate'
* To activate pre-built tensorflow-2.10 environment for Inf2 and Trn* run: 'source /opt/aws_neuronx_tensorflow_2_10/bin/activate'
* To activate pre-built jax-0.4 environment for Inf2 and Trn* run: 'source /opt/aws_neuron_venv_jax_0_4/bin/activate'
* To activate pre-built tensorflow-2.10 Inf1 environment for Inf1 run: 'source /opt/aws_neuron_tensorflow_2_10_inf1/bin/activate'
* Neuron driver version:: 2.19.64.0
- Language
- English
- Newest
- Most votes
- Most comments
You are correct in observing that there appears to be a discrepancy between the documentation and the actual environment on the Deep Learning AMI Neuron (Ubuntu 22.04). The PyTorch 1.13.1 environment for Inf1 instances that you're looking for is indeed not present in the location specified in the documentation.
This situation likely stems from recent changes in AWS Neuron support. AWS has announced the end of support for certain Neuron virtual environments, including those for PyTorch 1.13 on some instance types. However, it's important to note that PyTorch 1.13 support is continuing for Inf1 instances.
Given this context, it's possible that the AMI structure or the way these environments are set up has changed, and the documentation hasn't been fully updated to reflect these changes. This could explain why you're not finding the environment at the specified path.
To resolve this issue, you might want to check if there are any other PyTorch environments available that could be suitable for your Inf1 instance. Alternatively, you may need to install PyTorch 1.13 manually or use a different version that is available.
It would be helpful to report this discrepancy to AWS support or through their documentation feedback channels to ensure they're aware of the issue and can update the documentation accordingly.
Sources
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/_sources/general/announcements/neuron2.x/announce-eos-multiframework-dlamis-inf1.rst
https://awsdocs-neuron.readthedocs-hosted.com/en/latest/_sources/general/announcements/neuron2.x/announce-eos-pytorch-1-1-3.rst
Get Started with Neuron on Ubuntu 22 with Neuron Multi-Framework DLAMI — AWS Neuron Documentation
Relevant content
- AWS OFFICIALUpdated 2 years ago
