AI RESEARCH
The Big Send-off: Scalable and Performant Collectives for Deep Learning
arXiv CS.AI
•
ArXi:2504.18658v2 Announce Type: replace-cross Collective communication is becoming increasingly important in data center and supercomputer workloads with an increase in distributed AI related jobs. However, existing libraries that provide collective such as NCCL, RCCL, and Cray-MPICH exhibit several performance and scalability limitations on modern GPU supercomputers. To address these challenges, we