Any there any realistic avenues to decentralised model training?

It seems like our free lunch is slightly erroding with hints of some OS model providers moving away from at least providing as much, and fair enough, but I think we all here value the stability, privacy, and let's be honest the cool factor/fun of local models. What are the big barriers to a community growing a system for decentralised