3 Answers
- Newest
- Most votes
- Most comments
1
If you're using an m5.8xlarge that has 32 vCPU but that's with hyperthreading enabled by default; that corresponds to 16 physical cores. I've seen some discussion (https://community.intel.com/t5/Intel-oneAPI-Math-Kernel-Library/Intel-MKL-threading-behavior-on-Hyper-Threading-systems/td-p/896702) that MKL caps out at the number of physical cores when hyperthreading is enabled unless you set MKL_DYNAMIC=FALSE
answered 2 years ago
0
FYI I suspect that the MKL needs to be updated since I updated my m5 instance from 16 core to 32 core. Not sure if this would help. I am looking at this link: https://docs.anaconda.com/mkl-optimizations/index.html
answered 2 years ago
0
No luck. Plan to create a new m5 instance with 32 core and setup mkl there,
answered 2 years ago
Relevant content
- Accepted Answerasked 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated a year ago
- AWS OFFICIALUpdated 3 years ago
This is it! Exporting MKL_DYNAMIC=FALSE and setting MKL_NUM_THREADS did the magic for me.