Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

How can I get GPU quota?

1

I'm trying to use Sagemaker.

How, in practical terms, can I get quota for a ml.p4d.24xlarge for endpoint use? I know how to request quota, but my requests take days and usually get turned down. My organization has been using AWS lightly for years. I do not have paid support.

Do I need to pay for support for my quota requests to get taken seriously? If so will Developer support work? Will Business? Enterprise is out of my price range. Do I need to request quota in a different region? Is there anything else I need to do?

I notice that accounts owned by multinationals I have professional access to have quota of thousands of GPUs in regions my small company can't get quota for a couple of instances in. I don't believe there is no capacity.

EDIT: If paid support isn't needed to get GPU quota why am I told the following when my requests for a single instance are turned down: " The service team has provided feedback on the limit increase. The team has recommended that you work with the Account Manager in your Territiory with the help of your detailed use case to have the request reviewed. " ?

Topics
Machine Learning & AI
Tags
Amazon SageMakerService Quotas
Language
English

asked 2 years ago733 views

3 Answers
0

Hello.

I don't think paid support is necessary to increase AWS service quotas.
Are you trying to increase your service quota by a large amount at once?
In my experience, when increasing quotas by a large amount, explaining the use case in detail to AWS Support tends to make the application successful.
Service quota inquiries to AWS Support can be done through "Account and billing" and are free of charge.
https://docs.aws.amazon.com/servicequotas/latest/userguide/request-quota-increase.html

Quota increase requests don't receive priority support. AWS Support can approve, deny, or partially approve your requests. If you have an urgent quota request, or if your quota increase request is denied, contact AWS Support for assistance.

EXPERT

answered 2 years ago

  • sd
    2 years ago

    I'm requesting a couple of GPU instances, that's all. I've done this a few times with different instance types, different regions, and on different accounts. It takes days and often ends with a no. Support did suggest contacting sales instead, so I'll try that.

0

Hello, I created a new account and when starting a GPU sandbox I get the error: "GPU access not enabled for your account."

Please let me know:

  1. Whether GPU access is available on my plan
  2. How I can enable or request GPU access

Thank you.

answered 6 months ago

0

Hello, My account does not show any CPU sandbox option. When starting the sandbox I get: "GPU access not enabled for your account."

Please enable GPU access for my account or let me know what plan or approval is required.

Thank you.

answered 6 months ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content