Explain more about "finetunable" attribute on Jumpstart model card

0

This doc https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-fine-tune.html says only models with 'finetunable" can be finetuned. But I found that for mistral-7b, which is tagged as not "finetunable", can be finetuned in several tutorials (e.g. https://www.datacamp.com/tutorial/mistral-7b-tutorial).

Can you explain more about this attribute on the model card?

Spring
質問済み 4ヶ月前1839ビュー
3回答
1
承認された回答

Hi,

not finetunable in Sagemaker JumpStart doesn't mean that a model cannot be finetuned in general. It only means that this same model cannot be finetuned in the way that it has been packaged in JumpStart.

So, you can fine tune Mistral in Sagemaker if you load it from another way than Sagemaker JumpStart.

Best,

Didier

profile pictureAWS
エキスパート
回答済み 4ヶ月前
0

Thanks a lot, Didier.

Spring
回答済み 4ヶ月前
  • Happy to have helped! If the answer is satisfactory, please accept it to keep the ball rolling

  • Thanks to you for accepting the answer

0

Can I additionally know which version of mistralai/Mistral-7B-Instruct is being used in Jumpstart? Mistral now has mistralai/Mistral-7B-Instruct-v0.2.

Spring
回答済み 4ヶ月前

ログインしていません。 ログイン 回答を投稿する。

優れた回答とは、質問に明確に答え、建設的なフィードバックを提供し、質問者の専門分野におけるスキルの向上を促すものです。

質問に答えるためのガイドライン

関連するコンテンツ