1 Answer
- Newest
- Most votes
- Most comments
1
Hello,
EC2 Inf1 instances feature AWS Inferentia chips (high-performance machine learning inference chips designed and built by AWS). In order to monitor usage on these chips, you need to use tools available in the Neuron SDK as opposed to the GPU usage tools that you have tried. A guide to all of the available profiling, debugging, and monitoring tools available for Neuron can be found here: https://awsdocs-neuron.readthedocs-hosted.com/en/latest/neuron-guide/neuron-tools/index.html.
Thanks!
answered 2 years ago
Relevant content
- Accepted Answerasked 3 years ago
- AWS OFFICIALUpdated 7 months ago
- AWS OFFICIALUpdated 4 months ago
- AWS OFFICIALUpdated 10 months ago
- AWS OFFICIALUpdated 3 months ago