Explain more about "finetunable" attribute on Jumpstart model card

0

This doc https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-fine-tune.html says only models with 'finetunable" can be finetuned. But I found that for mistral-7b, which is tagged as not "finetunable", can be finetuned in several tutorials (e.g. https://www.datacamp.com/tutorial/mistral-7b-tutorial).

Can you explain more about this attribute on the model card?

Spring
feita há 4 meses1838 visualizações
3 Respostas
1
Resposta aceita

Hi,

not finetunable in Sagemaker JumpStart doesn't mean that a model cannot be finetuned in general. It only means that this same model cannot be finetuned in the way that it has been packaged in JumpStart.

So, you can fine tune Mistral in Sagemaker if you load it from another way than Sagemaker JumpStart.

Best,

Didier

profile pictureAWS
ESPECIALISTA
respondido há 4 meses
0

Thanks a lot, Didier.

Spring
respondido há 4 meses
  • Happy to have helped! If the answer is satisfactory, please accept it to keep the ball rolling

  • Thanks to you for accepting the answer

0

Can I additionally know which version of mistralai/Mistral-7B-Instruct is being used in Jumpstart? Mistral now has mistralai/Mistral-7B-Instruct-v0.2.

Spring
respondido há 4 meses

Você não está conectado. Fazer login para postar uma resposta.

Uma boa resposta responde claramente à pergunta, dá feedback construtivo e incentiva o crescimento profissional de quem perguntou.

Diretrizes para responder a perguntas