Skip to content
By using AWS re:Post, you agree to the AWS re:Post Terms of Use
AWS re:Postre:Post
About re:Post

NCCL Support in EFA ( Nitro V3)

0

NCCL Operations uses RDMA WRITE/WRITE IMM for few of the collectives ( all_reduce, all2all) but looking the support page Nitro V3 dont support RDMA RDMA Write , that means NCCL dont run on Nitro V3 ?

Topics
Compute
Tags
Elastic Fabric Adapter
Language
English

asked a year ago223 views

1 Answer
1

As per Get started with EFA and NCCL for ML workloads on Amazon EC2, EFA and NCCL is supported on

  • p4d.24xlarge, p5.48xlarge and newer P series instance types
  • Amazon Linux 2023, Amazon Linux 2, Ubuntu 24.04, and Ubuntu 22.04 base AMIs
  • NCCL 2.4.2 and later

As per documentation, Nitro v3 Supports RDMA read with EFA for p4d(e).24xlarge instances. p5en.48xlarge runs on Nitro v5 and support RMDA write

AWS
EXPERT

answered a year ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Relevant content