How to check smdistributed-modelparallel version?

0

According to the doc ( https://sagemaker.readthedocs.io/en/stable/api/training/smd_model_parallel_general.html ), there are different parameters depending on the version of smdistributed-modelparallel module / package. However, I am unable to find a way to check the version (e.g. via sagemaker python SDK) or just from the training container documentation (e.g. https://github.com/aws/deep-learning-containers/blob/master/available_images.md#huggingface-training-containers ).

Any idea?

Thanks!

preguntada hace 2 años426 visualizaciones
1 Respuesta
0
Respuesta aceptada

Have not yet found a programmatic way to check the version.

However, for each DLC (Deep Learning Container) available at https://github.com/aws/deep-learning-containers/blob/master/available_images.md , we can look at the corresponding docker build files.

E.g. for PyTorch 1.10.2 with HuggingFace transformers DLC, the corresponding dockerfile is here: https://github.com/aws/deep-learning-containers/blob/master/huggingface/pytorch/training/docker/1.10/py3/cu113/Dockerfile.gpu

And we can see that the version: smdistributed_modelparallel-1.8.1-cp38-cp38-linux_x86_64.whl.

respondido hace 2 años

No has iniciado sesión. Iniciar sesión para publicar una respuesta.

Una buena respuesta responde claramente a la pregunta, proporciona comentarios constructivos y fomenta el crecimiento profesional en la persona que hace la pregunta.

Pautas para responder preguntas