AI RESEARCH

Row-stochastic matrices can provably outperform doubly stochastic matrices in decentralized learning

arXiv CS.LG

ArXi:2511.19513v2 Announce Type: replace Decentralized learning often involves a weighted global loss with heterogeneous node weights $\lambda$. We revisit two natural strategies for incorporating these weights: (i) embedding them into the local losses to retain a uniform weight (and thus a doubly stochastic matrix), and (ii) keeping the original losses while employing a $\lambda$-induced row-stochastic matrix.