GPU Instances with Grace and unified memory

As of this writing, AWS has not yet made NVIDIA GPUs with Grace processors and unified memory (such as GB200 or GH200) generally available in EC2.

While AWS and NVIDIA announced plans to bring NVIDIA Grace CPU Superchip-powered instances to Amazon EC2 in March 2023 [1], these instances are not yet listed in the publicly available EC2 instance types.

Reference :- [1] https://aws.amazon.com/solutions/case-studies/nvidia-keynote-aws-reinvent-2023/