Explain more about "finetunable" attribute on Jumpstart model card

Question

This doc https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-fine-tune.html says only models with 'finetunable" can be finetuned. But I found that for mistral-7b, which is tagged as not "finetunable", can be finetuned in several tutorials (e.g. https://www.datacamp.com/tutorial/mistral-7b-tutorial).

Can you explain more about this attribute on the model card?

Accepted Answer

Hi,

not finetunable in Sagemaker JumpStart doesn't mean that a model cannot be finetuned in general. It only means that this same model cannot be finetuned in the way that it has been packaged in JumpStart.

So, you can fine tune Mistral in Sagemaker if you load it from another way than Sagemaker JumpStart.

Best,

Didier

Answer

Can I additionally know which version of mistralai/Mistral-7B-Instruct is being used in Jumpstart? Mistral now has mistralai/Mistral-7B-Instruct-v0.2.

Answer

Thanks a lot, Didier.

Explain more about "finetunable" attribute on Jumpstart model card

Contenido relevante