在Inferentia对应的实例上部署Diffusers模型

0

【以下的问题经过翻译处理】 Inferentia对应的实例上是否支持Diffusers模型的部署?如果已经支持,有哪些文档可以指导如何实现呢?

profile picture
EXPERT
asked 8 months ago61 views
1 Answer
0

【以下的回答经过翻译处理】 目前,Stable Diffusion模型已经支持在Inf2实例上进行推理,请参考https://awsdocs-neuron.readthedocs-hosted.com/en/latest/release-notes/prev/rn.html了解最新支持情况。

关于Stable Diffusion模型在Inf2实例上的性能和实现,请参考https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/benchmarks/inf2/inf2-performance.html

关于Stable Diffusion模型在Inf2实例上的部署,请参考https://github.com/deepjavalibrary/djl-serving/commit/32ee6126c929d71f1baa85398311a00fda66f65f#diff-fd70585af92587202a9756f6c688c77427606e290f70f386147a07c1bf5ecda3

profile picture
EXPERT
answered 8 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions