By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

inf2 vs inf1 difference in bert output

0

Hi,

I have some code which generates a shape of torch.Size([1, 512, 1024] when calling bert on inf1. I have compiled the model for inf2. However the same code on inf2 produces a shape of torch.Size([1, 2]) . What could be the issue? Has anyone faced anything similar?

Topics
Machine Learning & AICompute
Tags
AWS InferentiaAWS Neuron
Language
English
rePost-User-6132983
asked 2 years ago456 views
1 Answer
0

This really is not enough information to get going with, please share the test code that produces this result

AWS
mrnikwaws
answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content