All Content tagged with AWS Neuron

AWS Neuron is a software development kit (SDK) for running machine learning inference using AWS Inferentia chips.

Content language: English

Select tags to filter
Sort by most recent
46 results
profile pictureAWS
published 15 days ago3 votes3.3K views
Step by Step guide to deploy DeepSeek R1 Distilled models.
profile pictureAWS
published a month ago0 votes85 views
A list of resources to use when you are first starting with the Neuron SDK and Inferentia or Trainium instances.
Steps to set up Jupyter notebooks and VS Code remote server on Trainium and Inferentia Neuron systems.
profile pictureAWS
published 2 months ago0 votes441 views
Key announcements and discover how industry leaders, like Apple and Anthropic, are revolutionizing AI with AWS Trainium and Inferentia
Get started with Inferentia and Trainium on EC2 using the Hugging Face Neuron Deep Learning Amazon Machine Image (AMI). A short walkthrough of how to deploy an EC2 image with all the Neuron drivers a...
profile pictureAWS
published 2 months ago0 votes966 views
Are you heading to **AWS re:Invent 2024** and looking for AWS Inferentia and Trainium sessions to take your machine learning skills to the next level?
Hi, I'm trying to run the neuron-device-plugin in our EKS cluster (following https://awsdocs-neuron.readthedocs-hosted.com/en/latest/containers/tutorials/k8s-setup.html) to run inf2.48xlarge nodes. ...
2
answers
0
votes
67
views
asked 3 months ago
I want to test Neuron on an AWS trn1.32xlarge instance using SDK version 2.20 and a PyTorch 2.1 Deep Learning AMI. We've encountered an error with the 'ResizeBilinear' operation, which isn't supported...
2
answers
0
votes
73
views
AWS
asked 3 months ago
profile pictureAWS
published 6 months ago1 votes582 views
See what regions have instances, and find out how to generate your own list with a python script.
Please, guide me how to install neuron runtime on ubuntu 22.04? I always get cannot locate collectives after running this "sudo apt-get install aws-neuronx-collectives=2.* -y" I have WSL Ubuntu 22.04....
1
answers
0
votes
413
views
asked 8 months ago
profile pictureAWS
published 8 months ago4 votes1.4K views
Quick first steps to find out if Inferentia or Trainium is an option for you.
profile pictureAWS
published a year ago1 votes1.2K views
Step by step guide on how to use ahead-of-time compilation to speed up SageMaker training jobs running on Amazon EC2 Trn1 (AWS Trainium) Instances by up to 10x using the neuron_parallel_compile utilit...