Error in src/examples/pytorch/torch-neuronx/t5-inference-tutorial.ipynb notebook. | AWS Neuron

The input_output_aliases argument is not yet added to the torch-neuronx API documentation. But the feature was released as a part of 2.13 release, so any artifacts starting from Neuron 2.13.0 release should work. We will be adding documentation for it soon.

The notebook was tested and can work with the following dependencies,

transformers>=4.31.0 
optimum-neuron>=0.0.8
torch-neuronx>=1.13.1.1.10.0
neuronx-cc>=2.9.0.40
libneuronxla>=0.5.391

Hi Bhuvanesh,

I have checked that this tutorial works as expected on my inf2 instance with Neuron SDK 2.13.2 (same as your versions). Will you follow the following troubleshooting note for Jupyter notebook and select the right kernel in your notebook using menu item "Kernel"->"Change kernel"->(your environment)?

To be sure, in your notebook you can select "Insert"->"Insert cell below" and add "!neuronx-cc -V" to run the check for neuronx-cc directly in your notebook instead of from the command line.

If this still doesn't work for you, could you walk me through the step-by-step setup you did? It can help me troubleshoot your problem.

I have also posted the above respond to: https://github.com/aws-neuron/aws-neuron-sdk/issues/737