En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post

Will AWS Neuron support a PyTorch model that inferences audio to audio?

0

The audio going into the model would be different lengths, and I saw a post saying "At the time of writing, the AWS Neuron SDK does not support dynamic shapes, which means that the input size needs to be static for compiling and inference."

Does this mean I can't use Neuron (and therefore Inferentia2) without truncating my audio going into the model to a fixed size? Or am I misunderstanding?

Sujets
Calcul
Balises
AWS Neuron
Langue
English
mmx00178
demandé il y a un an237 vues
1 réponse
0

Variable shape tensors are normally dealt with using bucketing (to a nearest tensor size) and padding. So the limitation currently exists, but customers can normally work around it: https://awsdocs-neuron.readthedocs-hosted.com/en/v2.11.0/general/appnotes/torch-neuron/bucketing-app-note.html?highlight=bucketing

AWS
mrnikwaws
répondu il y a 10 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions

Contenus pertinents