By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

TensorFlow instance

0

I'm considering launching an instance to work on one of my TensorFlow models since my current PC doesn't perform efficiently. My PC has 32GB of RAM, a 20CPU i7 processor, and an RTX 3050Ti 20GB GPU. I believe that the GPU is more important than the CPU for TensorFlow models, but I'm not entirely sure. I'm currently thinking of launching a p3.2xlarge instance, but I'd appreciate some suggestions from knowledgeable individuals. For instance, would it be better to launch an EC2 Inf1 instance instead of a P3 instance?

Best regards,

Topics
TensorFlow on AWSMachine Learning & AICompute
Tags
TensorFlow on AWSMachine Learning & AIComputeAWS Inferentia
Language
English
scholar
asked 6 months ago231 views
1 Answer
0

Hi,

You may be interested by this article from HuggingFace comparing Inf1, Inf2 and GPU NVIDIA A10G from Nvidia.

https://huggingface.co/blog/accelerate-transformers-with-inferentia2

And combine it with with one involving your GPU : https://askgeek.io/en/gpus/vs/NVIDIA_NVIDIA-A10-vs-NVIDIA_NVIDIA-GeForce-RTX-3050-Ti-GA107

Combining the 2 will allow you to relate your GPU to inf1 and better inf2.

Best,

Didier

profile pictureAWS
EXPERT
Didier_Durand
answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content