What is a good AMI for GPU-based tensorflow work?

Question

Hi,
Using the ec2 instance (p3.8xlarge - 4 V100 GPUs) I cannot find an AMI that makes use of these with tensorflow [-gpu].

I've tried:
- NVIDIA GPU-Optimized AMI - issues, very little installed, but that's ok as it is ubuntu and you can install whatever.  But, with tensorflow-gpu installed:
print (tf.__version__)
print("Num GPUs Available: ", len(tf.config.list_physical_devices('GPU')))
2.9.1
Num GPUs Available:  0
Other AMI's see the GPUs, but are unable to utilize them (using nvidia-smi to monitor usage).  For this, I've tried:
- Deep Learning AMI GPU TensorFlow 2.9.1 (Amazon Linux 2) 20220803 
- Deep Learning AMI GPU TensorFlow 2.9.1 (Ubuntu 20.04) 20220803

Has anyone successfully deployed GPUs on a DLAMI?  This time last year I was able to use individual GPUs ok (distributed is another thing, but this year none are working).

Thanks,

Answer

Hello,

The size of your model should be a factor in selecting an instance. If your model exceeds an instance's available RAM, select a different instance type with enough memory for your application.

Amazon EC2 P3 Instances have up to 8 NVIDIA Tesla V100 GPUs.

Amazon EC2 P4 Instances have up to 8 NVIDIA Tesla A100 GPUs.

Amazon EC2 G3 Instances have up to 4 NVIDIA Tesla M60 GPUs.

Amazon EC2 G4 Instances have up to 4 NVIDIA T4 GPUs.

Amazon EC2 G5 Instances have up to 8 NVIDIA A10G GPUs.

Amazon EC2 G5g Instances have Arm-based AWS Graviton2 processors

Refer this link- https://docs.aws.amazon.com/dlami/latest/devguide/gpu.html for more details on the selection of instances.

Hope this helps, If yes, please click accepted answer.

What is a good AMI for GPU-based tensorflow work?

Relevant content