Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch. - Arthur Douillard; Yanislav Donchev; Keith Rush; Satyen Kale; Zachary Charles; Zachary Garrett; Gabriel Teston; Dave Lacey; Ross McIlroy; Jiajun Shen; Alexandre Ramé; Arthur Szlam; et al. (CoRR, 2025)

Eager Updates For Overlapped Communication and Computation in DiLoCo. - Satyen Kale; Arthur Douillard; Yanislav Donchev (CoRR, 2025)