11B parameters support GPU

Hi,

This article demonstrates the use of Nvidia T4 for a 11B parameter model:

https://www.philschmid.de/deploy-t5-11b

AWS offers this GPU: https://aws.amazon.com/ec2/instance-types/g4/

those blog posts provide detailled examples of large-scale ML infrastructures on AWS cloud

• https://aws.amazon.com/blogs/machine-learning/achieve-high-performance-at-scale-for-model-serving-using-amazon-sagemaker-multi-model-endpoints-with-gpu/
• https://aws.amazon.com/blogs/machine-learning/create-train-and-deploy-a-billion-parameter-language-model-on-terabytes-of-data-with-tensorflow-and-amazon-sagemaker/
• https://aws.amazon.com/blogs/machine-learning/train-175-billion-parameter-nlp-models-with-model-parallel-additions-and-hugging-face-on-amazon-sagemaker/
• https://aws.amazon.com/blogs/machine-learning/how-latent-space-used-the-amazon-sagemaker-model-parallelism-library-to-push-the-frontiers-of-large-scale-transformers/