All Content tagged with AWS Neuron

AWS Neuron is a software development kit (SDK) for running machine learning inference using AWS Inferentia chips.

Content language: English

Select tags to filter
Sort by most recent
47 results
[AWS Neuron Documentation](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/neuron-setup/multiframework/multi-framework-ubuntu22-neuron-dlami.html#setup-ubuntu22-multi-framework-d...
1
answers
0
votes
36
views
AWS
asked 14 days ago
profile pictureAWS
published 2 months ago3 votes4K views
Step by Step guide to deploy DeepSeek R1 Distilled models.
profile pictureAWS
published 2 months ago0 votes123 views
A list of resources to use when you are first starting with the Neuron SDK and Inferentia or Trainium instances.
Steps to set up Jupyter notebooks and VS Code remote server on Trainium and Inferentia Neuron systems.
profile pictureAWS
published 3 months ago0 votes523 views
Key announcements and discover how industry leaders, like Apple and Anthropic, are revolutionizing AI with AWS Trainium and Inferentia
Get started with Inferentia and Trainium on EC2 using the Hugging Face Neuron Deep Learning Amazon Machine Image (AMI). A short walkthrough of how to deploy an EC2 image with all the Neuron drivers a...
profile pictureAWS
published 4 months ago0 votes998 views
Are you heading to **AWS re:Invent 2024** and looking for AWS Inferentia and Trainium sessions to take your machine learning skills to the next level?
Hi, I'm trying to run the neuron-device-plugin in our EKS cluster (following https://awsdocs-neuron.readthedocs-hosted.com/en/latest/containers/tutorials/k8s-setup.html) to run inf2.48xlarge nodes. ...
2
answers
0
votes
79
views
asked 4 months ago
I want to test Neuron on an AWS trn1.32xlarge instance using SDK version 2.20 and a PyTorch 2.1 Deep Learning AMI. We've encountered an error with the 'ResizeBilinear' operation, which isn't supported...
2
answers
0
votes
78
views
AWS
asked 5 months ago
profile pictureAWS
published 7 months ago1 votes779 views
See what regions have instances, and find out how to generate your own list with a python script.
Please, guide me how to install neuron runtime on ubuntu 22.04? I always get cannot locate collectives after running this "sudo apt-get install aws-neuronx-collectives=2.* -y" I have WSL Ubuntu 22.04....
1
answers
0
votes
460
views
asked 9 months ago
profile pictureAWS
published 9 months ago4 votes1.4K views
Quick first steps to find out if Inferentia or Trainium is an option for you.