Skip to content

About getting access to EC2 p4de.24xlarge instance (A100 80GB)

0

I would like to run experiments with 8 A100 (80GB) GPUs. It seems like only p4de-instance supports that set-up. However, I only see p4d in the list but not p4de when creating an instance. Could you please tell me where I can get the access to p4de? Thanks for the help!

asked 2 years ago2.6K views
3 Answers
2
Accepted Answer

According to Amazon EC2 instance types by Region, p4de instances are available only in Israel (Tel Aviv) — il-central-1 region.

Note that this region is not enabled by default so you'll need to enable it first in your account (see here).

You might also want to consider P5 instances which also have 8 GPUs with 80GB RAM each, but it's H100 instead of A100. These are available in more regions (see in the list on the first link I shared).

AWS
EXPERT
answered 2 years ago
EXPERT
reviewed 2 years ago
  • Thank you so much for your assistance! I’ve switched to the Israel (Tel Aviv) – il-central-1 region, but the P4de option still doesn’t appear in the dropdown. It seems that it might not be available in Israel at the moment. However, I did find the P5 option in many regions, so I may go with that instead. Thanks again for all your help!

  • You welcome Kevin :) Kindly accept the answer.

1

Which region are you looking in? According to the Product details section of https://aws.amazon.com/ec2/instance-types/p4/

P4de instances are available in the US East (N. Virginia) and US West (Oregon) Regions.

EXPERT
answered 2 years ago
EXPERT
reviewed 2 years ago
EXPERT
reviewed 2 years ago
  • Thank you for your response! I’ve reviewed the N. Virginia and Oregon regions and tested both Amazon Linux and Ubuntu (64-bit x86 architecture). However, I only see the P4d option in the dropdown, not the P4de. Is there any special access I need to request for the p4de option to appear?

1

Hello,

I noticed that AWS has removed the instance type you mentioned. This might be due to high demand. AWS had initially released this instance type for preview purposes only, as per the announcement:

[+] https://aws.amazon.com/about-aws/whats-new/2022/05/amazon-ec2-p4de-gpu-instances-ml-training-hpc/

If you definitely require this instance type, you can reach out to the AWS support team or the AWS sales team and share your requirements. Check if there is a possibility of obtaining it. Additionally, you might have to reserve that instance type for some time if you require it immediately.

[+] Sales Support: https://aws.amazon.com/contact-us/ [+] Account and Billing Support: https://support.console.aws.amazon.com/support/home

In the meantime, you can go with other instance types like p5 or p4d temporarily until AWS releases the p4de instance type permanently.

answered 2 years ago
EXPERT
reviewed 2 years ago
  • Thank you for your response! I’ve reviewed the Virginia and Oregon regions and tested both Amazon Linux and Ubuntu (64-bit x86 architecture). However, I only see the P4d option in the dropdown, not the P4de. Is there any special access I need to request for the p4de option to appear?

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.