Diffusers to be deployed on Inf instances

Hi there,

It is not currently supported, but it is definitely part of the roadmap. It is supposed to be available soon, this was indeed confirmed by our internal team.

Having said that, the below mentioned link shows the models that will run well in Inferentia [Inf Instances]. Please have a read and check it out!

https://awsdocs-neuron.readthedocs-hosted.com/en/v1.17.1/neuron-guide/models/models-inferentia.html#:~:text=Model%20architectures%20that%20run%20well%20on%20Inferentia,-Many%20popular%20models&text=Language%20Models%3A,TensorFlow%20and%20MXNet%20NLP%20tutorials

You can also have an eye on this GitHub link to be updated on the new features :

https://github.com/orgs/aws-neuron/projects/1/views/1

I hope this helps! Thank you!