CLaC-BP at SemEval-2021 Task 8: SciBERT Plus Rules for MeasEval. - Benjamin Thérien; Parsa Bagherzadeh; Sabine Bergler (SemEval@ACL/IJCNLP, 2021)

Parametric Scattering Networks. - Shanel Gauthier; Benjamin Thérien; Laurent Alsène-Racicot; Irina Rish; Eugene Belilovsky; Michael Eickenberg; Guy Wolf (CoRR, 2021)

Parametric Scattering Networks. - Shanel Gauthier; Benjamin Thérien; Laurent Alsène-Racicot; Muawiz Chaudhary; Irina Rish; Eugene Belilovsky; Michael Eickenberg; Guy Wolf (CVPR, 2022)

Out-of-Distribution Detection for LiDAR-based 3D Object Detection. - Chengjie Huang; Van Duong Nguyen; Vahdat Abdelzad; Christopher Gus Mannes; Luke Rowe; Benjamin Thérien; Rick Salay; Krzysztof Czarnecki 001 (ITSC, 2022)

Interpretable Deep Tracking. - Benjamin Thérien; Krzysztof Czarnecki 001 (CoRR, 2022)

A Closer Look at Robustness to L-infinity and Spatial Perturbations and their Composition. - Luke Rowe; Benjamin Thérien; Krzysztof Czarnecki 001; Hongyang Zhang 001 (CoRR, 2022)

Towards Object Re-Identification from Point Clouds for 3D MOT. - Benjamin Thérien; Chengjie Huang; Adrian Chow; Krzysztof Czarnecki 001 (CoRR, 2023)

Continual Pre-Training of Large Language Models: How to (re)warm your model? - Kshitij Gupta; Benjamin Thérien; Adam Ibrahim; Mats L. Richter; Quentin Anthony; Eugene Belilovsky; Irina Rish; Timothée Lesort (CoRR, 2023)

Can We Learn Communication-Efficient Optimizers? - Charles-Étienne Joseph; Benjamin Thérien; Abhinav Moudgil; Boris Knyazev 001; Eugene Belilovsky (CoRR, 2023)

Dense Backpropagation Improves Routing for Sparsely-Gated Mixture-of-Experts. - Ashwinee Panda; Vatsal Baherwani; Zain Sarwar; Benjamin Thérien; Sambit Sahu; Stephen Rawls; Supriyo Chakraborty; Tom Goldstein (ENLSP, 2024)

StructMoE: Structured Mixture of Experts Using Low Rank Experts. - Zain Sarwar; Ashwinee Panda; Benjamin Thérien; Stephen Rawls; Anirban Das; Kartik Balasubramaniam; Berkcan Kapusuzoglu; Shixiong Zhang; Sambit Sahu; Milind Naphade; Supriyo Chakraborty (ENLSP, 2024)

Object Re-Identification from Point Clouds. - Benjamin Thérien; Chengjie Huang; Adrian Chow; Krzysztof Czarnecki 001 (WACV, 2024)

μLO: Compute-Efficient Meta-Generalization of Learned Optimizers. - Benjamin Thérien; Charles-Étienne Joseph; Boris Knyazev 001; Edouard Oyallon; Irina Rish; Eugene Belilovsky (CoRR, 2024)

Simple and Scalable Strategies to Continually Pre-train Large Language Models. - Adam Ibrahim; Benjamin Thérien; Kshitij Gupta; Mats L. Richter; Quentin Gregory Anthony; Eugene Belilovsky; Timothée Lesort; Irina Rish (Trans. Mach. Learn. Res., 2024)

Meta-learning Optimizers for Communication-Efficient Learning. - Charles-Étienne Joseph; Benjamin Thérien; Abhinav Moudgil; Boris Knyazev 001; Eugene Belilovsky (Trans. Mach. Learn. Res., 2025)

Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training. - Vaibhav Singh; Paul Janson; Paria Mehrbod; Adam Ibrahim; Irina Rish; Eugene Belilovsky; Benjamin Thérien (CoRR, 2025)

Continual Pre-training of MoEs: How robust is your router? - Benjamin Thérien; Charles-Étienne Joseph; Zain Sarwar; Ashwinee Panda; Anirban Das; Shi-Xiong Zhang 001; Stephen Rawls; Sambit Sahu; Eugene Belilovsky; Irina Rish (CoRR, 2025)

Dense Backpropagation Improves Training for Sparse Mixture-of-Experts. - Ashwinee Panda; Vatsal Baherwani; Zain Sarwar; Benjamin Thérien; Supriyo Chakraborty; Tom Goldstein (CoRR, 2025)

MuLoCo: Muon is a practical inner optimizer for DiLoCo. - Benjamin Thérien; Xiaolong Huang; Irina Rish; Eugene Belilovsky (CoRR, 2025)

PyLO: Towards Accessible Learned Optimizers in PyTorch. - Paul Janson; Benjamin Thérien; Quentin Anthony; Xiaolong Huang; Abhinav Moudgil; Eugene Belilovsky (CoRR, 2025)

Revisiting Replay and Gradient Alignment for Continual Pre-Training of Large Language Models. - Istabrak Abbes; Gopeshh Subbaraj; Matthew Riemer; Nizar Islah; Benjamin Thérien; Tsuguchika Tabaru; Hiroaki Kingetsu; Sarath Chandar; Irina Rish (CoRR, 2025)

Communication Efficient LLM Pre-training with SparseLoCo. - Amir Sarfi; Benjamin Thérien; Joel Lidin; Eugene Belilovsky (CoRR, 2025)