跳至內容

How can I get GPU quota?

1

I'm trying to use Sagemaker.

How, in practical terms, can I get quota for a ml.p4d.24xlarge for endpoint use? I know how to request quota, but my requests take days and usually get turned down. My organization has been using AWS lightly for years. I do not have paid support.

Do I need to pay for support for my quota requests to get taken seriously? If so will Developer support work? Will Business? Enterprise is out of my price range. Do I need to request quota in a different region? Is there anything else I need to do?

I notice that accounts owned by multinationals I have professional access to have quota of thousands of GPUs in regions my small company can't get quota for a couple of instances in. I don't believe there is no capacity.

EDIT: If paid support isn't needed to get GPU quota why am I told the following when my requests for a single instance are turned down: " The service team has provided feedback on the limit increase. The team has recommended that you work with the Account Manager in your Territiory with the help of your detailed use case to have the request reviewed. " ?

已提問 2 年前檢視次數 790 次

3 個答案
0

Hello.

I don't think paid support is necessary to increase AWS service quotas.
Are you trying to increase your service quota by a large amount at once?
In my experience, when increasing quotas by a large amount, explaining the use case in detail to AWS Support tends to make the application successful.
Service quota inquiries to AWS Support can be done through "Account and billing" and are free of charge.
https://docs.aws.amazon.com/servicequotas/latest/userguide/request-quota-increase.html

Quota increase requests don't receive priority support. AWS Support can approve, deny, or partially approve your requests. If you have an urgent quota request, or if your quota increase request is denied, contact AWS Support for assistance.

專家

已回答 2 年前

  • I'm requesting a couple of GPU instances, that's all. I've done this a few times with different instance types, different regions, and on different accounts. It takes days and often ends with a no. Support did suggest contacting sales instead, so I'll try that.

0

Hello, I created a new account and when starting a GPU sandbox I get the error: "GPU access not enabled for your account."

Please let me know:

  1. Whether GPU access is available on my plan
  2. How I can enable or request GPU access

Thank you.

已回答 7 個月前

0

Hello, My account does not show any CPU sandbox option. When starting the sandbox I get: "GPU access not enabled for your account."

Please enable GPU access for my account or let me know what plan or approval is required.

Thank you.

已回答 7 個月前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。