GPUDirect Support in G6

Hi @Alok,

1. GPUDirect RDMA enhances inter-instance GPU communication by bypassing the CPU.
2. NVLink/NVSwitch is for intra-instance GPU communication, which is not available on g6.12xlarge.
3. G6 instances are designed for a balance of cost and performance, which influences the inclusion of features like NVLink/NVSwitch.

Step 1: GPUDirect RDMA Support G6 instances, including g6.8xlarge and g6.12xlarge, support GPUDirect RDMA when used with Elastic Fabric Adapter (EFA). This enables direct GPU access to the network, reducing latency.

Step 2: NVLink/NVSwitch Support The g6.12xlarge instance type does not have NVLink or NVSwitch interconnects between the GPUs. GPUs are connected to the CPU via PCIe.

Final Answer

• g6.8xlarge and g6.12xlarge: Support GPUDirect RDMA with EFA.
• g6.12xlarge: Does not have NVLink/NVSwitch.

If the Answer is helpful, please click Accept Answer and up-vote, so that it can help others in the community looking for help on similar topics.

@learn2skills can you confirm GPUDirect is supported in G6 by giving reference from aws/amazon site , as i dont see that information anywhere