RoCE vs InfiniBand: AI Inference Test on B200 Nodes
Lambda’s inference test on HGX B200 nodes found RoCE delivered about 70% lower throughput than NVIDIA Quantum InfiniBand near saturation.
Lambda’s inference test on HGX B200 nodes found RoCE delivered about 70% lower throughput than NVIDIA Quantum InfiniBand near saturation.