Median K-Flats for hybrid linear modeling with many outliers. - Teng Zhang 002; Arthur Szlam; Gilad Lerman (ICCV Workshops, 2009)

Discriminative k-metrics. - Arthur Szlam; Guillermo Sapiro (ICML, 2009)

Semi-supervised Segmentation Based on Non-local Continuous Min-Cut. - Nawal Houhou; Xavier Bresson; Arthur Szlam; Tony F. Chan; Jean-Philippe Thiran (SSVM, 2009)

A Randomized Algorithm for Principal Component Analysis. - Vladimir Rokhlin; Arthur Szlam; Mark Tygert (SIAM J. Matrix Anal. Appl., 2009)

Randomized hybrid linear modeling by local best-fit flats. - Teng Zhang 002; Arthur Szlam; Yi Wang 009; Gilad Lerman (CVPR, 2010)

A split Bregman method for non-negative sparsity penalized least squares with applications to hyperspectral demixing. - Arthur Szlam; Zhaohui Guo; Stanley J. Osher (ICIP, 2010)

Total Variation, Cheeger Cuts. - Arthur Szlam; Xavier Bresson (ICML, 2010)

Convolutional Matching Pursuit and Dictionary Training - Arthur Szlam; Koray Kavukcuoglu; Yann LeCun (CoRR, 2010)

Structured sparse coding via lateral inhibition. - Arthur Szlam; Karol Gregor; Yann LeCun (NIPS, 2011)

Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video. - Jun He 006; Laura Balzano; Arthur Szlam (CVPR, 2012)

Fast Approximations to Structured Sparse Coding and Applications to Object Classification. - Arthur Szlam; Karol Gregor; Yann LeCun (ECCV (5), 2012)

K-subspaces with missing data. - Laura Balzano; Arthur Szlam; Benjamin Recht; Robert D. Nowak (SSP, 2012)

Hybrid Linear Modeling via Local Best-Fit Flats. - Teng Zhang 002; Arthur Szlam; Yi Wang 009; Gilad Lerman (Int. J. Comput. Vis., 2012)

Learning Stable Group Invariant Representations with Convolutional Networks - Joan Bruna; Arthur Szlam; Yann LeCun (ICLR (Workshop Poster), 2013)

Tree structured sparse coding on cubes - Arthur Szlam (ICLR (Workshop Poster), 2013)

Robust Locally Linear Analysis with Applications to Image Denoising and Blind Inpainting. - Yi Wang 009; Arthur Szlam; Gilad Lerman (SIAM J. Imaging Sci., 2013)

Better Feature Tracking through Subspace Constraints. - Bryan Poling; Gilad Lerman; Arthur Szlam (CVPR, 2014)

K-mappings and Regression trees. - Yi Wang 009; Arthur Szlam (ICASSP, 2014)

Signal recovery from Pooling Representations. - Joan Bruna Estrach; Arthur Szlam; Yann LeCun (ICML, 2014)

An Incremental Reseeding Strategy for Clustering. - Xavier Bresson; Huiyi Hu; Thomas Laurent 001; Arthur Szlam; James H. von Brecht (CoRR, 2014)

Spectral Networks and Locally Connected Networks on Graphs. - Joan Bruna; Wojciech Zaremba; Arthur Szlam; Yann LeCun (ICLR, 2014)

Unsupervised Feature Learning by Deep Sparse Coding. - Yunlong He; Koray Kavukcuoglu; Yun Wang; Arthur Szlam; Yanjun Qi (ICLR (Workshop), 2014)

Video (language) modeling: a baseline for generative models of natural videos. - Marc'Aurelio Ranzato; Arthur Szlam; Joan Bruna; Michaël Mathieu; Ronan Collobert; Sumit Chopra (CoRR, 2014)

An implementation of a randomized algorithm for principal component analysis. - Arthur Szlam; Yuval Kluger; Mark Tygert (CoRR, 2014)

Multi-class Transductive Learning Based on ℓ 1 Relaxations of Cheeger Cut and Mumford-Shah-Potts Model. - Xavier Bresson; Xue-Cheng Tai; Tony F. Chan; Arthur Szlam (J. Math. Imaging Vis., 2014)

Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks. - Emily L. Denton; Soumith Chintala; Arthur Szlam; Rob Fergus (NIPS, 2015)

End-To-End Memory Networks. - Sainbayar Sukhbaatar; Arthur Szlam; Jason Weston; Rob Fergus (NIPS, 2015)

A theoretical argument for complex-valued convolutional networks. - Joan Bruna; Soumith Chintala; Yann LeCun; Serkan Piantino; Arthur Szlam; Mark Tygert (CoRR, 2015)

Scale-invariant learning and convolutional networks. - Soumith Chintala; Marc'Aurelio Ranzato; Arthur Szlam; Yuandong Tian; Mark Tygert; Wojciech Zaremba (CoRR, 2015)

MazeBase: A Sandbox for Learning from Games. - Sainbayar Sukhbaatar; Arthur Szlam; Gabriel Synnaeve; Soumith Chintala; Rob Fergus (CoRR, 2015)

Weakly Supervised Memory Networks. - Sainbayar Sukhbaatar; Arthur Szlam; Jason Weston; Rob Fergus (CoRR, 2015)

Simple Baseline for Visual Question Answering. - Bolei Zhou; Yuandong Tian; Sainbayar Sukhbaatar; Arthur Szlam; Rob Fergus (CoRR, 2015)

Recurrent Orthogonal Networks and Long-Memory Tasks. - Mikael Henaff; Arthur Szlam; Yann LeCun (ICML, 2016)

The Product Cut. - Thomas Laurent 001; James H. von Brecht; Xavier Bresson; Arthur Szlam (NIPS, 2016)

Learning Multiagent Communication with Backpropagation. - Sainbayar Sukhbaatar; Arthur Szlam; Rob Fergus (NIPS, 2016)

Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systems. - Jesse Dodge; Andreea Gane; Xiang Zhang 013; Antoine Bordes; Sumit Chopra; Alexander H. Miller; Arthur Szlam; Jason Weston (ICLR (Poster), 2016)

Orthogonal RNNs and Long-Memory Tasks. - Mikael Henaff; Arthur Szlam; Yann LeCun (CoRR, 2016)

Accurate principal component analysis via a few iterations of alternating least squares. - Arthur Szlam; Andrew Tulloch; Mark Tygert (CoRR, 2016)

A Mathematical Motivation for Complex-Valued Convolutional Networks. - Mark Tygert; Joan Bruna; Soumith Chintala; Yann LeCun; Serkan Piantino; Arthur Szlam (Neural Comput., 2016)

Hard Mixtures of Experts for Large Scale Weakly Supervised Vision. - Sam Gross; Marc'Aurelio Ranzato; Arthur Szlam (CVPR, 2017)

Tracking the World State with Recurrent Entity Networks. - Mikael Henaff; Jason Weston; Arthur Szlam; Antoine Bordes; Yann LeCun (ICLR (Poster), 2017)

Automatic Rule Extraction from Long Short Term Memory Networks. - W. James Murdoch; Arthur Szlam (ICLR (Poster), 2017)

Transformation-Based Models of Video Sequences. - Joost R. van Amersfoort; Anitha Kannan; Marc'Aurelio Ranzato; Arthur Szlam; Du Tran; Soumith Chintala (CoRR, 2017)

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play. - Sainbayar Sukhbaatar; Ilya Kostrikov; Arthur Szlam; Rob Fergus (CoRR, 2017)

Training Language Models Using Target-Propagation. - Sam Wiseman; Sumit Chopra; Marc'Aurelio Ranzato; Arthur Szlam; Ruoyu Sun 004; Soumith Chintala; Nicolas Vasilache (CoRR, 2017)

Accurate Low-Rank Approximations Via a Few Iterations of Alternating Least Squares. - Arthur Szlam; Andrew Tulloch; Mark Tygert (SIAM J. Matrix Anal. Appl., 2017)

Geometric Deep Learning: Going beyond Euclidean data. - Michael M. Bronstein; Joan Bruna; Yann LeCun; Arthur Szlam; Pierre Vandergheynst (IEEE Signal Process. Mag., 2017)

Algorithm 971: An Implementation of a Randomized Algorithm for Principal Component Analysis. - Huamin Li; George C. Linderman; Arthur Szlam; Kelly P. Stanton; Yuval Kluger; Mark Tygert (ACM Trans. Math. Softw., 2017)

Personalizing Dialogue Agents: I have a dog, do you have pets too? - Saizheng Zhang; Emily Dinan; Jack Urbanek; Arthur Szlam; Douwe Kiela; Jason Weston (ACL (1), 2018)

Low-Shot Learning With Large-Scale Diffusion. - Matthijs Douze; Arthur Szlam; Bharath Hariharan; Hervé Jégou (CVPR, 2018)

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play. - Sainbayar Sukhbaatar; Zeming Lin; Ilya Kostrikov; Gabriel Synnaeve; Arthur Szlam; Rob Fergus (ICLR (Poster), 2018)

Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent. - Zhilin Yang 001; Saizheng Zhang; Jack Urbanek; Will Feng; Alexander H. Miller; Arthur Szlam; Douwe Kiela; Jason Weston (ICLR (Poster), 2018)

Optimizing the Latent Space of Generative Networks. - Piotr Bojanowski; Armand Joulin; David Lopez-Paz; Arthur Szlam (ICML, 2018)

Modeling Others using Oneself in Multi-Agent Reinforcement Learning. - Roberta Raileanu; Emily Denton; Arthur Szlam; Rob Fergus (ICML, 2018)

Composable Planning with Attributes. - Amy Zhang 001; Sainbayar Sukhbaatar; Adam Lerer; Arthur Szlam; Rob Fergus (ICML, 2018)

Lightweight Adaptive Mixture of Neural and N-gram Language Models. - Anton Bakhtin; Arthur Szlam; Marc'Aurelio Ranzato; Edouard Grave (CoRR, 2018)

Planning with Arithmetic and Geometric Attributes. - David Folqué; Sainbayar Sukhbaatar; Arthur Szlam; Joan Bruna (CoRR, 2018)

Learning Goal Embeddings via Self-Play for Hierarchical Reinforcement Learning. - Sainbayar Sukhbaatar; Emily Denton; Arthur Szlam; Rob Fergus (CoRR, 2018)

Dialogue Natural Language Inference. - Sean Welleck; Jason Weston; Arthur Szlam; Kyunghyun Cho (ACL (1), 2019)

Learning to Speak and Act in a Fantasy Text Adventure Game. - Jack Urbanek; Angela Fan; Siddharth Karamcheti; Saachi Jain; Samuel Humeau 001; Emily Dinan; Tim Rocktäschel; Douwe Kiela; Arthur Szlam; Jason Weston (EMNLP/IJCNLP (1), 2019)

Order-Aware Generative Modeling Using the 3D-Craft Dataset. - Zhuoyuan Chen; Kavya Srinet; Charles R. Qi; Haoqi Fan 001; Jerry Ma; Larry Zitnick; Demi Guo; Tong Xiao; Saining Xie; Xinlei Chen; Arthur Szlam; Shubham Tulsiani; et al. (ICCV, 2019)

Hierarchical RL Using an Ensemble of Proprioceptive Periodic Policies. - Kenneth Marino; Abhinav Gupta 001; Rob Fergus; Arthur Szlam (ICLR (Poster), 2019)

The Second Conversational Intelligence Challenge (ConvAI2). - Emily Dinan; Varvara Logacheva; Valentin Malykh; Alexander H. Miller; Kurt Shuster 001; Jack Urbanek; Douwe Kiela; Arthur Szlam; Iulian Serban; Ryan Lowe; Shrimai Prabhumoye; Alan W. Black; et al. (CoRR, 2019)

CraftAssist Instruction Parsing: Semantic Parsing for a Minecraft Assistant. - Yacine Jernite; Kavya Srinet; Jonathan Gray; Arthur Szlam (CoRR, 2019)

Real or Fake? Learning to Discriminate Machine from Human Generated Text. - Anton Bakhtin; Sam Gross; Myle Ott; Yuntian Deng; Marc'Aurelio Ranzato; Arthur Szlam (CoRR, 2019)

CraftAssist: A Framework for Dialogue-enabled Interactive Agents. - Jonathan Gray; Kavya Srinet; Yacine Jernite; Haonan Yu; Zhuoyuan Chen; Demi Guo; Siddharth Goyal; C. Lawrence Zitnick; Arthur Szlam (CoRR, 2019)

Why Build an Assistant in Minecraft? - Arthur Szlam; Jonathan Gray; Kavya Srinet; Yacine Jernite; Armand Joulin; Gabriel Synnaeve; Douwe Kiela; Haonan Yu; Zhuoyuan Chen; Siddharth Goyal; Demi Guo; Danielle Rothermel; et al. (CoRR, 2019)

Generating Interactive Worlds with Text. - Angela Fan; Jack Urbanek; Pratik Ringshia; Emily Dinan; Emma Qian; Siddharth Karamcheti; Shrimai Prabhumoye; Douwe Kiela; Tim Rocktäschel; Arthur Szlam; Jason Weston (AAAI, 2020)

CraftAssist Instruction Parsing: Semantic Parsing for a Voxel-World Assistant. - Kavya Srinet; Yacine Jernite; Jonathan Gray; Arthur Szlam (ACL, 2020)

Residual Energy-Based Models for Text Generation. - Yuntian Deng; Anton Bakhtin; Myle Ott; Arthur Szlam; Marc'Aurelio Ranzato (ICLR, 2020)

Fast Adaptation to New Environments via Policy-Dynamics Value Functions. - Roberta Raileanu; Maxwell Goldstein; Arthur Szlam; Rob Fergus (ICML, 2020)

I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-oriented dialogue agents. - Shrimai Prabhumoye; Margaret Li; Jack Urbanek; Emily Dinan; Douwe Kiela; Jason Weston; Arthur Szlam (CoRR, 2020)

Learning to Visually Navigate in Photorealistic Environments Without any Supervision. - Lina Mezghani; Sainbayar Sukhbaatar; Arthur Szlam; Armand Joulin; Piotr Bojanowski (CoRR, 2020)

Energy-Based Models for Text. - Anton Bakhtin; Yuntian Deng; Sam Gross; Myle Ott; Marc'Aurelio Ranzato; Arthur Szlam (CoRR, 2020)

Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions. - Stephen Roller; Y-Lan Boureau; Jason Weston; Antoine Bordes; Emily Dinan; Angela Fan; David Gunning; Da Ju; Margaret Li; Spencer Poff; Pratik Ringshia; Kurt Shuster 001; et al. (CoRR, 2020)

Empirically Verifying Hypotheses Using Reinforcement Learning. - Kenneth Marino; Rob Fergus; Arthur Szlam; Abhinav Gupta 001 (CoRR, 2020)

Fast Adaptation via Policy-Dynamics Value Functions. - Roberta Raileanu; Maxwell Goldstein; Arthur Szlam; Rob Fergus (CoRR, 2020)

Deploying Lifelong Open-Domain Dialogue Learning. - Kurt Shuster 001; Jack Urbanek; Emily Dinan; Arthur Szlam; Jason Weston (CoRR, 2020)

Few-shot Sequence Learning with Transformers. - Lajanugen Logeswaran; Ann Lee 001; Myle Ott; Honglak Lee; Marc'Aurelio Ranzato; Arthur Szlam (CoRR, 2020)

Linguistic calibration through metacognition: aligning dialogue agent responses with expected correctness. - Sabrina J. Mielke; Arthur Szlam; Y-Lan Boureau; Emily Dinan (CoRR, 2020)

Dialogue in the Wild: Learning from a Deployed Role-Playing Game with Humans and Bots. - Kurt Shuster 001; Jack Urbanek; Emily Dinan; Arthur Szlam; Jason Weston (ACL/IJCNLP (Findings), 2021)

Not All Memories are Created Equal: Learning to Forget by Expiring. - Sainbayar Sukhbaatar; Da Ju; Spencer Poff; Stephen Roller; Arthur Szlam; Jason Weston; Angela Fan (ICML, 2021)

CURI: A Benchmark for Productive Concept Learning Under Uncertainty. - Ramakrishna Vedantam; Arthur Szlam; Maximilian Nickel; Ari Morcos; Brenden M. Lake (ICML, 2021)

droidlet: modular, heterogenous, multi-modal agents. - Anurag Pratik; Soumith Chintala; Kavya Srinet; Dhiraj Gandhi; Rebecca Qian; Yuxuan Sun 004; Ryan Drew; Sara Elkafrawy; Anoushka Tiwari; Tucker Hart; Mary Williamson; Abhinav Gupta 001; et al. (ICRA, 2021)

How to Motivate Your Dragon: Teaching Goal-Driven Agents to Speak and Act in Fantasy Worlds. - Prithviraj Ammanabrolu; Jack Urbanek; Margaret Li; Arthur Szlam; Tim Rocktäschel; Jason Weston (NAACL-HLT, 2021)

Interactive Grounded Language Understanding in a Collaborative Environment: IGLU 2021. - Julia Kiseleva; Ziming Li 001; Mohammad Aliannejadi; Shrestha Mohanty; Maartje ter Hoeve; Mikhail Burtsev 001; Alexey Skrynnik; Artem Zholus; Aleksandr Panov; Kavya Srinet; Arthur Szlam; Yuxuan Sun 004; et al. (NeurIPS (Competition and Demos), 2021)

Interactive Grounded Language Understanding in a Collaborative Environment: Retrospective on Iglu 2022 Competition. - Julia Kiseleva; Alexey Skrynnik; Artem Zholus; Shrestha Mohanty; Negar Arabzadeh; Marc-Alexandre Côté; Mohammad Aliannejadi; Milagro Teruel; Ziming Li 001; Mikhail Burtsev 001; Maartje ter Hoeve; Zoya Volovikova; et al. (NeurIPS (Competition and Demos), 2021)

Hash Layers For Large Sparse Models. - Stephen Roller; Sainbayar Sukhbaatar; Arthur Szlam; Jason Weston (NeurIPS, 2021)

NeurIPS 2021 Competition IGLU: Interactive Grounded Language Understanding in a Collaborative Environment. - Julia Kiseleva; Ziming Li 001; Mohammad Aliannejadi; Shrestha Mohanty; Maartje ter Hoeve; Mikhail Burtsev 001; Alexey Skrynnik; Artem Zholus; Aleksandr I. Panov; Kavya Srinet; Arthur Szlam; Yuxuan Sun 004; et al. (CoRR, 2021)

Residual Energy-Based Models for Text. - Anton Bakhtin; Yuntian Deng; Sam Gross; Myle Ott; Marc'Aurelio Ranzato; Arthur Szlam (J. Mach. Learn. Res., 2021)

Beyond Goldfish Memory: Long-Term Open-Domain Conversation. - Jing Xu; Arthur Szlam; Jason Weston (ACL (1), 2022)

Can I see an Example? Active Learning the Long Tail of Attributes and Relations. - Tyler L. Hayes; Maximilian Nickel; Christopher Kanan; Ludovic Denoyer; Arthur Szlam (BMVC, 2022)

Language Models that Seek for Knowledge: Modular Search & Generation for Dialogue and Prompt Completion. - Kurt Shuster 001; Mojtaba Komeili; Leonard Adolphs; Stephen Roller; Arthur Szlam; Jason Weston (EMNLP (Findings), 2022)

Reason first, then respond: Modular Generation for Knowledge-infused Dialogue. - Leonard Adolphs; Kurt Shuster 001; Jack Urbanek; Arthur Szlam; Jason Weston (EMNLP (Findings), 2022)

Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity. - Kurt Shuster 001; Jack Urbanek; Arthur Szlam; Jason Weston (NAACL-HLT (Findings), 2022)

Many Episode Learning in a Modular Embodied Agent via End-to-End Interaction. - Yuxuan Sun 004; Ethan Carlson; Rebecca Qian; Kavya Srinet; Arthur Szlam (CoRR, 2022)

IGLU 2022: Interactive Grounded Language Understanding in a Collaborative Environment at NeurIPS 2022. - Julia Kiseleva; Alexey Skrynnik; Artem Zholus; Shrestha Mohanty; Negar Arabzadeh; Marc-Alexandre Côté; Mohammad Aliannejadi; Milagro Teruel; Ziming Li 001; Mikhail Burtsev 001; Maartje ter Hoeve; Zoya Volovikova; et al. (CoRR, 2022)

IGLU Gridworld: Simple and Fast Environment for Embodied Dialog Agents. - Artem Zholus; Alexey Skrynnik; Shrestha Mohanty; Zoya Volovikova; Julia Kiseleva; Arthur Szlam; Marc-Alexandre Côté; Aleksandr I. Panov (CoRR, 2022)

BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage. - Kurt Shuster 001; Jing Xu; Mojtaba Komeili; Da Ju; Eric Michael Smith; Stephen Roller; Megan Ung; Moya Chen; Kushal Arora; Joshua Lane; Morteza Behrooz; William Ngan; et al. (CoRR, 2022)

Collecting Interactive Multi-modal Datasets for Grounded Language Understanding. - Shrestha Mohanty; Negar Arabzadeh; Milagro Teruel; Yuxuan Sun 004; Artem Zholus; Alexey Skrynnik; Mikhail Burtsev 001; Kavya Srinet; Aleksandr Panov; Arthur Szlam; Marc-Alexandre Côté; Julia Kiseleva (CoRR, 2022)

Reducing Conversational Agents' Overconfidence through Linguistic Calibration. - Sabrina J. Mielke; Arthur Szlam; Emily Dinan; Y-Lan Boureau (Trans. Assoc. Comput. Linguistics, 2022)

A Data Source for Reasoning Embodied Agents. - Jack Lanchantin; Sainbayar Sukhbaatar; Gabriel Synnaeve; Yuxuan Sun 004; Kavya Srinet; Arthur Szlam (AAAI, 2023)

Learning to Reason and Memorize with Self-Notes. - Jack Lanchantin; Shubham Toshniwal; Jason Weston; Arthur Szlam; Sainbayar Sukhbaatar (NeurIPS, 2023)

CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memory. - Nur Muhammad (Mahi) Shafiullah; Chris Paxton 001; Lerrel Pinto; Soumith Chintala; Arthur Szlam (Robotics: Science and Systems, 2023)

Infusing Commonsense World Models with Graph Knowledge. - Alexander Gurung; Mojtaba Komeili; Arthur Szlam; Jason Weston; Jack Urbanek (CoRR, 2023)

Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models. - Jimmy Wei; Kurt Shuster 001; Arthur Szlam; Jason Weston; Jack Urbanek; Mojtaba Komeili (CoRR, 2023)

Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions. - Shrestha Mohanty; Negar Arabzadeh; Julia Kiseleva; Artem Zholus; Milagro Teruel; Ahmed Awadallah 001; Yuxuan Sun 004; Kavya Srinet; Arthur Szlam (CoRR, 2023)

DiLoCo: Distributed Low-Communication Training of Language Models. - Arthur Douillard; Qixuang Feng; Andrei A. Rusu; Rachita Chhaparia; Yani Donchev; Adhiguna Kuncoro; Marc'Aurelio Ranzato; Arthur Szlam; Jiajun Shen (CoRR, 2023)

Compositional Interfaces for Compositional Generalization. - Jelena Luketina; Jack Lanchantin; Sainbayar Sukhbaatar; Arthur Szlam (CoLLAs, 2024)

Asynchronous Local-SGD Training for Language Modeling. - Bo Liu; Rachita Chhaparia; Arthur Douillard; Satyen Kale; Andrei A. Rusu; Jiajun Shen; Arthur Szlam; Marc'Aurelio Ranzato (CoRR, 2024)

DiPaCo: Distributed Path Composition. - Arthur Douillard; Qixuan Feng; Andrei A. Rusu; Adhiguna Kuncoro; Yani Donchev; Rachita Chhaparia; Ionel Gog; Marc'Aurelio Ranzato; Jiajun Shen; Arthur Szlam (CoRR, 2024)

Deliberation in Latent Space via Differentiable Cache Augmentation. - Luyang Liu; Jonas Pfeiffer; Jiaxing Wu; Jun Xie; Arthur Szlam (CoRR, 2024)

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch. - Arthur Douillard; Yanislav Donchev; Keith Rush; Satyen Kale; Zachary Charles; Zachary Garrett; Gabriel Teston; Dave Lacey; Ross McIlroy; Jiajun Shen; Alexandre Ramé; Arthur Szlam; et al. (CoRR, 2025)

Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo. - Zachary Charles; Gabriel Teston; Lucio Dery; Keith Rush; Nova Fallen; Zachary Garrett; Arthur Szlam; Arthur Douillard (CoRR, 2025)