Mistral 7b Sagemaker Jumpstart fine tuning

Question

I've been successfully fine tuning Mistral 7b using sagemaker jumpstart.

Today I started getting the error when fine tuning of "ImportError: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/__init__.py)"

I believe the wrong huggingface_hub dependency is now being installed but I can't seem to figure out how to override it.

Answer

I was able to work around this:

The bug is still in sagemaker but I was able to workaround it but downloading and unpacking the source from AWS that is used and manually fixing deps by building new linux whl's that don't break. Using the latest whls for linux 2014 for transformers, tokenizer and huggingface_hub will fix it.

Mistral 7b Sagemaker Jumpstart fine tuning

Contenido relevante