AI RESEARCH
veScale-FSDP: Flexible and High-Performance FSDP at Scale
arXiv CS.LG
•
ArXi:2602.22437v3 Announce Type: replace-cross Fully Sharded Data Parallel (FSDP), also known as Zero Redundancy Optimizer (ZeRO), is widely used for large-scale model