Questions tagged with AWS Neuron
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I am initializing an `inf1.6xlarge` Sagemaekr instance via
```
sudo tee /etc/yum.repos.d/neuron.repo > /dev/null <<EOF
[neuron]
name=Neuron YUM...
1
answers
0
votes
567
views
asked a year agolg...
I have setup a DLAMI (both with Deep Learning Base AMI (Amazon Linux 2) Version 57.2 (ID: ami-07d28e42a376a75fe) or Deep Learning Base AMI (Ubuntu 18.04) Version 56.6 (ID: ami-0be3ca7b9b68fa36c)) and...
1
answers
0
votes
295
views
asked a year agolg...
Dear developers,
I am relatively new to AWS and EC2 instances. I have an EC2 Inf1 instance and I am trying to set up tensorflow neuron for deep learning applications.
When I running the 'Resnet50...
2
answers
0
votes
358
views
asked a year agolg...
Diffusers aren't yet supported for deployment on Inf instances?
If they already are, what docs could be the guide to achieve it?
Beforehand, thank you.
1
answers
0
votes
281
views
asked a year agolg...
We have a huggingfacemodel with zero-shot-classification with neuron infernetia. It's based on [the pretrained huggingface pipelines distilBert with TensorFlow2...
1
answers
0
votes
329
views
asked a year agolg...
These questions arose while I read the docs and couldn't find the answers.
1. Does the compiling has to be done on a CPU? Can I use accelerators such as GPUs to speed it up?
2. Does compiling on an...
Accepted AnswerAWS Neuron
1
answers
0
votes
580
views
asked a year agolg...
Hello,
We are testing the pipeline mode for neuron/inferentia, but can not get a model running for multi-core. The single core compiled model loads fine and is able to run inference on inferentia...
1
answers
0
votes
439
views
asked 2 years agolg...
I am trying to load a neuron compiled model generated as given in https://awsdocs-neuron.readthedocs-hosted.com/en/latest/src/examples/tensorflow/huggingface_bert/huggingface_bert.html . I am still a...
2
answers
0
votes
393
views
asked 2 years agolg...
Hi,
This link https://awsdocs-neuron.readthedocs-hosted.com/en/latest/frameworks/tensorflow/tensorflow-neuron/tutorials/bert_demo/bert_demo.html mentions how to compile using tensorflow 1. Can anyone...
1
answers
0
votes
463
views
asked 2 years agolg...
I just started using Neuron on Inf1 and I'm following the examples. I did the [resnet50](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/src/examples/pytorch/resnet50.html) example, no...
Accepted AnswerAWS Neuron
1
answers
0
votes
741
views
asked 2 years agolg...
I cant save neuron model after compile the model into an AWS Neuron optimized TorchScript.
My code:
```
import tensorflow # to workaround a protobuf version conflict issue
import torch
import...
1
answers
0
votes
378
views
asked 2 years agolg...
I followed user guide on updating torch neuron and then started compiling the model to neuron.
But got an error, from which I don't understand what's wrong.
In Neuron SDK you claim that it should...
1
answers
1
votes
818
views
asked 2 years agolg...