A data-driven approach for learning to control computers. - Peter Conway Humphreys; David Raposo; Tobias Pohlen; Gregory Thornton; Rachita Chhaparia; Alistair Muldal; Josh Abramson; Petko Georgiev; Adam Santoro; Timothy P. Lillicrap (ICML, 2022)

A data-driven approach for learning to control computers. - Peter Conway Humphreys; David Raposo; Toby Pohlen; Gregory Thornton; Rachita Chhaparia; Alistair Muldal; Josh Abramson; Petko Georgiev; Alex Goldin; Adam Santoro; Timothy P. Lillicrap (CoRR, 2022)

DiLoCo: Distributed Low-Communication Training of Language Models. - Arthur Douillard; Qixuang Feng; Andrei A. Rusu; Rachita Chhaparia; Yani Donchev; Adhiguna Kuncoro; Marc'Aurelio Ranzato; Arthur Szlam; Jiajun Shen (CoRR, 2023)

Asynchronous Local-SGD Training for Language Modeling. - Bo Liu; Rachita Chhaparia; Arthur Douillard; Satyen Kale; Andrei A. Rusu; Jiajun Shen; Arthur Szlam; Marc'Aurelio Ranzato (CoRR, 2024)

DiPaCo: Distributed Path Composition. - Arthur Douillard; Qixuan Feng; Andrei A. Rusu; Adhiguna Kuncoro; Yani Donchev; Rachita Chhaparia; Ionel Gog; Marc'Aurelio Ranzato; Jiajun Shen; Arthur Szlam (CoRR, 2024)