Mistral 7b Sagemaker Jumpstart fine tuning

I've been successfully fine tuning Mistral 7b using sagemaker jumpstart.

Today I started getting the error when fine tuning of "ImportError: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/init.py)"

I believe the wrong huggingface_hub dependency is now being installed but I can't seem to figure out how to override it.

주제

기계 학습 및 AI

태그

아마존 SageMaker 기계 학습 및 AI 아마존 세이지메이커 점프스타트

언어

English

Aadu

질문됨 3달 전1310회 조회

1개 답변

최신
최다 투표
가장 많은 댓글

이 답변이 도움이 되었나요?커뮤니티가 여러분의 지식을 활용할 수 있도록 정답을 찬성하세요.

I was able to work around this:

The bug is still in sagemaker but I was able to workaround it but downloading and unpacking the source from AWS that is used and manually fixing deps by building new linux whl's that don't break. Using the latest whls for linux 2014 for transformers, tokenizer and huggingface_hub will fix it.

Aadu

답변함 3달 전

Mistral 7b Sagemaker Jumpstart fine tuning

관련 콘텐츠