1 個回答
- 最新
- 最多得票
- 最多評論
0
Hi,
When deploying large models, the ideal situation is that you can fit the model on a single GPU. This is the best option with respect to performance as it eliminates the overhead of communication between GPU devices. For some models it is simply impossible to fit them on a single GPU due to model size. For other models, they may fit on a single GPU, but it may be more cost effective to partition the model across multiple cheaper GPUs.
In your case, you may consider an instance like g4dn.xlarge
if using for inference. Details for using GPU can refer official document.
Hope it helps.
已回答 1 年前
相關內容
- 已提問 6 個月前
- 已提問 10 個月前
- AWS 官方已更新 1 年前
- AWS 官方已更新 2 年前
- AWS 官方已更新 2 年前