Durch die Nutzung von AWS re:Post stimmt du den AWS re:Post Nutzungsbedingungen
AWS re:Postre:Post

Explain more about "finetunable" attribute on Jumpstart model card

0

This doc https://docs.aws.amazon.com/sagemaker/latest/dg/jumpstart-fine-tune.html says only models with 'finetunable" can be finetuned. But I found that for mistral-7b, which is tagged as not "finetunable", can be finetuned in several tutorials (e.g. https://www.datacamp.com/tutorial/mistral-7b-tutorial).

Can you explain more about this attribute on the model card?

Themen
Maschinelles Lernen & KI
Tags
Amazon SageMakerAmazon SageMaker JumpStart
Sprache
English
Spring
gefragt vor 4 Monaten1838 Aufrufe
3 Antworten
1
Akzeptierte Antwort

Hi,

not finetunable in Sagemaker JumpStart doesn't mean that a model cannot be finetuned in general. It only means that this same model cannot be finetuned in the way that it has been packaged in JumpStart.

So, you can fine tune Mistral in Sagemaker if you load it from another way than Sagemaker JumpStart.

Best,

Didier

profile pictureAWS
EXPERTE
Didier_Durand
beantwortet vor 4 Monaten
0

Thanks a lot, Didier.

Spring
beantwortet vor 4 Monaten
  • Didier_Durand EXPERTE
    vor 4 Monaten

    Happy to have helped! If the answer is satisfactory, please accept it to keep the ball rolling

  • Didier_Durand EXPERTE
    vor 4 Monaten

    Thanks to you for accepting the answer

0

Can I additionally know which version of mistralai/Mistral-7B-Instruct is being used in Jumpstart? Mistral now has mistralai/Mistral-7B-Instruct-v0.2.

Spring
beantwortet vor 4 Monaten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen

Relevanter Inhalt