By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post

SageMaker JumpStart question

0

Hello,

I am new to Amazon SageMaker and trying to use Mistral 7B instruct model from JumpStart. I get this error message when I press Deploy:

"Failed to deploy endpoint The account-level service limit 'ml.g5.2xlarge for endpoint usage' is 0 Instances, with current utilization of 0 Instances and a request delta of 1 Instances. Please use AWS Service Quotas to request an increase for this quota. If AWS Service Quotas is not available, contact AWS support to request an increase for this quota."

What should I do?

Topics
Machine Learning & AIManagement & Governance
Tags
Amazon SageMakerMachine Learning & AIAWS Account ManagementService QuotasAmazon SageMaker JumpStart
Language
English
Abdalla
asked 3 months ago1424 views
1 Answer
2

Hi,

You should first check your Quota for such instances by going in the AWS Console to Service Quotas > AWS Services > AWS SageMaker and check in the quota list the service limits for endpoints to see if it is really 0 or not.

See some examples on my account

Enter image description here

Then, again from console, you will take to go Support and open a request for quota increaae via a ticket

Best,

Didier

profile pictureAWS
EXPERT
Didier_Durand
answered 3 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions

Relevant content