En utilisant AWS re:Post, vous acceptez les AWS re:Post Conditions d’utilisation
AWS re:Postre:Post

Mistral 7b Sagemaker Jumpstart fine tuning

0

I've been successfully fine tuning Mistral 7b using sagemaker jumpstart.

Today I started getting the error when fine tuning of "ImportError: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/init.py)"

I believe the wrong huggingface_hub dependency is now being installed but I can't seem to figure out how to override it.

Sujets
Machine Learning et AI
Balises
Amazon SageMakerMachine Learning et AIAmazon SageMaker JumpStart
Langue
English
Aadu
demandé il y a 3 mois1312 vues
1 réponse
0

I was able to work around this:

The bug is still in sagemaker but I was able to workaround it but downloading and unpacking the source from AWS that is used and manually fixing deps by building new linux whl's that don't break. Using the latest whls for linux 2014 for transformers, tokenizer and huggingface_hub will fix it.

Aadu
répondu il y a 3 mois

Vous n'êtes pas connecté. Se connecter pour publier une réponse.

Une bonne réponse répond clairement à la question, contient des commentaires constructifs et encourage le développement professionnel de la personne qui pose la question.

Instructions pour répondre aux questions

Contenus pertinents