DiLoCo: Distributed Low-Communication Training of Language Models. - Arthur Douillard; Qixuang Feng; Andrei A. Rusu; Rachita Chhaparia; Yani Donchev; Adhiguna Kuncoro; Marc'Aurelio Ranzato; Arthur Szlam; Jiajun Shen (CoRR, 2023)

DiPaCo: Distributed Path Composition. - Arthur Douillard; Qixuan Feng; Andrei A. Rusu; Adhiguna Kuncoro; Yani Donchev; Rachita Chhaparia; Ionel Gog; Marc'Aurelio Ranzato; Jiajun Shen; Arthur Szlam (CoRR, 2024)

Scaling Instructable Agents Across Many Simulated Worlds. - SIMA Team; Maria Abi Raad; Arun Ahuja; Catarina Barros; Frederic Besse; Andrew Bolt; Adrian Bolton; Bethanie Brownfield; Gavin Buttimore; Max Cant; Sarah Chakera; Stephanie C. Y. Chan; et al. (CoRR, 2024)