Is it possible to do RDMA using libibverbs and EFA?
A customer is evaluating AWS for migrating an on-prem workload that, at the moment, consists of 10 bare metal servers communicating over Infiniband and RDMA using libibverbs.
I am considering C5n/R5n/P3dn instances and EFA as an alternative, but I am still at a loss whether the customer will be able to do RDMA later as desired.
Is it possible to do RDMA using libibverbs and EFA? If so, is there any documentation that I can share with the customer?
- Newest
- Most votes
- Most comments
EFA adapters are exposed through libfabrics (https://github.com/aws/libfabric) which offers a comparable interface in terms of functionality (slightly higher level actually). So an application written for libverbs won't work on EFA/libfabric without a significant rewrite.
It does not offer RDMA capabilities yet, but this is usually an implementation detail. What the customer usually cares about is the low-latency / high-throughput and not the fact that the messages are actually transmitted using RDMA.
Relevant content
- asked 3 years ago
- Accepted Answerasked 8 months ago
- asked a year ago
- asked 4 months ago
AWS OFFICIALUpdated 8 months ago- AWS OFFICIALUpdated 3 months ago
- AWS OFFICIALUpdated 2 years ago
- AWS OFFICIALUpdated 10 months ago
