SageMaker JumpStart question

0

Hello,

I am new to Amazon SageMaker and trying to use Mistral 7B instruct model from JumpStart. I get this error message when I press Deploy:

"Failed to deploy endpoint The account-level service limit 'ml.g5.2xlarge for endpoint usage' is 0 Instances, with current utilization of 0 Instances and a request delta of 1 Instances. Please use AWS Service Quotas to request an increase for this quota. If AWS Service Quotas is not available, contact AWS support to request an increase for this quota."

What should I do?

1 Antwort
2

Hi,

You should first check your Quota for such instances by going in the AWS Console to Service Quotas > AWS Services > AWS SageMaker and check in the quota list the service limits for endpoints to see if it is really 0 or not.

See some examples on my account

Enter image description here

Then, again from console, you will take to go Support and open a request for quota increaae via a ticket

Best,

Didier

profile pictureAWS
EXPERTE
beantwortet vor 4 Monaten

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen