How much GPU memory are available on the g4, g5, p3d, and p4d series instances?

Question

Is there a link that shows how much GPU memory is available on the following GPU instances on AWS?

1. g4-series instances (NVidia T4)
2. g5-series instances (NVidia A10)
3. p3d-series instances (NVidia V100)
4. p4d-series instances (NVidia A100)

Update: the information is available for the [p3d series](https://aws.amazon.com/ec2/instance-types/p3/) and [g5 series](https://aws.amazon.com/ec2/instance-types/g5/), though not for the [g4 series](https://aws.amazon.com/ec2/instance-types/g4/) or the [p4 series](https://aws.amazon.com/ec2/instance-types/p4/) instances. Is it possible to retrieve the information for the latter two instances anywhere (without having to launch the instances)?

Accepted Answer

This link has a table that compares instances' GPU memory
https://docs.amazonaws.cn/en_us/AmazonECS/latest/developerguide/ecs-gpu.html

Answer

Hello Nathaniel,
You can find this information on the launch blogs here:

for G4 series: 16GB GPU Memory https://aws.amazon.com/blogs/aws/now-available-ec2-instances-g4-with-nvidia-t4-tensor-core-gpus/

for P4 ultraclusters:  320GB GPU Memory https://aws.amazon.com/blogs/aws/new-gpu-equipped-ec2-p4-instances-for-machine-learning-hpc/

Hope this helps

How much GPU memory are available on the g4, g5, p3d, and p4d series instances?

Relevanter Inhalt