2 Answers
- Newest
- Most votes
- Most comments
1
Hi,
At this moment, you can use TensorFlow on Trainium via the Neuron Framework.
See:
- https://awsdocs-neuron.readthedocs-hosted.com/en/v2.9.1/frameworks/tensorflow/index.html
- https://repost.aws/articles/AR5rLph4rOQae4So67dIT54g/accelerating-sagemaker-training-jobs-running-on-aws-trainium
Best,
Didier
0
Arnoud,
Inferentia and Trainium both run the same Neuron Core v2 architecture. The main difference between them is the device interconnects.
Despite the name, it may make sense to use a Trainium instance for inference, especially if you are using a larger model.
Anything you can do with TensorFlow on Inferentia you can do on Trainium with the same code.
However, most of our training examples are built around PyTorch or our NeuronX Distributed or Transformers-NeuronX libraries.
Jim
Relevant content
- asked 4 months ago
- asked 8 months ago
- asked 2 years ago
- How do I resolve the storage full issue on my RDS for MySQL instance or my RDS for MariaDB instance?
AWS OFFICIALUpdated 10 months ago - AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 3 years ago
- AWS OFFICIALUpdated a year ago
Thanks for answering! This particular version you refer to (2.9.1) explicitly says: "TensorFlow Neuron support for Training is coming soon." The current version 2.18.2 (aka latest as in my link above) doesn't say this explicitly anymore but lacks any link to docs/samples. Only for Inference, not for Training.