Mistral 7b Sagemaker Jumpstart fine tuning

0

I've been successfully fine tuning Mistral 7b using sagemaker jumpstart.

Today I started getting the error when fine tuning of "ImportError: cannot import name 'insecure_hashlib' from 'huggingface_hub.utils' (/opt/conda/lib/python3.10/site-packages/huggingface_hub/utils/init.py)"

I believe the wrong huggingface_hub dependency is now being installed but I can't seem to figure out how to override it.

Aadu
質問済み 3ヶ月前1310ビュー
1回答
0

I was able to work around this:

The bug is still in sagemaker but I was able to workaround it but downloading and unpacking the source from AWS that is used and manually fixing deps by building new linux whl's that don't break. Using the latest whls for linux 2014 for transformers, tokenizer and huggingface_hub will fix it.

Aadu
回答済み 3ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ