How to check smdistributed-modelparallel version?

Question

According to the doc ( https://sagemaker.readthedocs.io/en/stable/api/training/smd_model_parallel_general.html ), there are different parameters depending on the version of smdistributed-modelparallel module / package. However, I am unable to find a way to check the version (e.g. via sagemaker python SDK) or just from the training container documentation (e.g. https://github.com/aws/deep-learning-containers/blob/master/available_images.md#huggingface-training-containers ).

Any idea?

Thanks!

Any idea?

Thanks!

rePost-User-1679031 · Accepted Answer

Have not yet found a programmatic way to check the version.

However, for each DLC (Deep Learning Container) available at 
https://github.com/aws/deep-learning-containers/blob/master/available_images.md , we can look at the corresponding docker build files.

E.g. for `PyTorch 1.10.2 with HuggingFace transformers` DLC, the corresponding dockerfile is here: https://github.com/aws/deep-learning-containers/blob/master/huggingface/pytorch/training/docker/1.10/py3/cu113/Dockerfile.gpu

And we can see that the version: `smdistributed_modelparallel-1.8.1-cp38-cp38-linux_x86_64.whl`.

How to check smdistributed-modelparallel version?

Add your answer

Relevant content