Benjamin Thérien

According to our database, Benjamin Thérien authored at least 20 papers between 2021 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

PyLO: Towards Accessible Learned Optimizers in PyTorch.

Paul Janson, Benjamin Thérien, Quentin Anthony, Xiaolong Huang, Abhinav Moudgil, Eugene Belilovsky

CoRR, June, 2025

MuLoCo: Muon is a practical inner optimizer for DiLoCo.

Benjamin Thérien, Xiaolong Huang, Irina Rish, Eugene Belilovsky

CoRR, May, 2025

Dense Backpropagation Improves Training for Sparse Mixture-of-Experts.

Ashwinee Panda, Vatsal Baherwani, Zain Sarwar, Benjamin Thérien, Supriyo Chakraborty, Tom Goldstein

CoRR, April, 2025

Continual Pre-training of MoEs: How robust is your router?

Benjamin Thérien, Charles-Étienne Joseph, Zain Sarwar, Ashwinee Panda, Anirban Das, Shi-Xiong Zhang, Stephen Rawls, Sambit Sahu, Eugene Belilovsky, Irina Rish

CoRR, March, 2025

Beyond Cosine Decay: On the effectiveness of Infinite Learning Rate Schedule for Continual Pre-training.

Vaibhav Singh, Paul Janson, Paria Mehrbod, Adam Ibrahim, Irina Rish, Eugene Belilovsky, Benjamin Thérien

CoRR, March, 2025

Meta-learning Optimizers for Communication-Efficient Learning.

Charles-Étienne Joseph, Benjamin Thérien, Abhinav Moudgil, Boris Knyazev, Eugene Belilovsky

Trans. Mach. Learn. Res., 2025

2024

Simple and Scalable Strategies to Continually Pre-train Large Language Models.

Adam Ibrahim, Benjamin Thérien, Kshitij Gupta, Mats L. Richter, Quentin Gregory Anthony, Eugene Belilovsky, Timothée Lesort, Irina Rish

Trans. Mach. Learn. Res., 2024

μLO: Compute-Efficient Meta-Generalization of Learned Optimizers.

Benjamin Thérien, Charles-Étienne Joseph, Boris Knyazev, Edouard Oyallon, Irina Rish, Eugene Belilovsky

CoRR, 2024

Object Re-Identification from Point Clouds.

Benjamin Thérien, Chengjie Huang, Adrian Chow, Krzysztof Czarnecki

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024

StructMoE: Structured Mixture of Experts Using Low Rank Experts.

Zain Sarwar, Ashwinee Panda, Benjamin Thérien, Stephen Rawls, Anirban Das, Kartik Balasubramaniam, Berkcan Kapusuzoglu, Shixiong Zhang, Sambit Sahu, Milind Naphade, Supriyo Chakraborty

Proceedings of the NeurIPS Efficient Natural Language and Speech Processing Workshop, 2024

Dense Backpropagation Improves Routing for Sparsely-Gated Mixture-of-Experts.

Ashwinee Panda, Vatsal Baherwani, Zain Sarwar, Benjamin Thérien, Sambit Sahu, Stephen Rawls, Supriyo Chakraborty, Tom Goldstein

Proceedings of the NeurIPS Efficient Natural Language and Speech Processing Workshop, 2024

2023

Can We Learn Communication-Efficient Optimizers?

Charles-Étienne Joseph, Benjamin Thérien, Abhinav Moudgil, Boris Knyazev, Eugene Belilovsky

CoRR, 2023

Continual Pre-Training of Large Language Models: How to (re)warm your model?

Kshitij Gupta, Benjamin Thérien, Adam Ibrahim, Mats L. Richter, Quentin Anthony, Eugene Belilovsky, Irina Rish, Timothée Lesort

CoRR, 2023

Towards Object Re-Identification from Point Clouds for 3D MOT.

Benjamin Thérien, Chengjie Huang, Adrian Chow, Krzysztof Czarnecki

CoRR, 2023

2022

A Closer Look at Robustness to L-infinity and Spatial Perturbations and their Composition.

Luke Rowe, Benjamin Thérien, Krzysztof Czarnecki, Hongyang Zhang

CoRR, 2022

Interpretable Deep Tracking.

Benjamin Thérien, Krzysztof Czarnecki

CoRR, 2022

Out-of-Distribution Detection for LiDAR-based 3D Object Detection.

Chengjie Huang, Van Duong Nguyen, Vahdat Abdelzad, Christopher Gus Mannes, Luke Rowe, Benjamin Thérien, Rick Salay, Krzysztof Czarnecki

Proceedings of the 25th IEEE International Conference on Intelligent Transportation Systems, 2022

Parametric Scattering Networks.

Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Muawiz Chaudhary, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

Parametric Scattering Networks.

Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf

CoRR, 2021

CLaC-BP at SemEval-2021 Task 8: SciBERT Plus Rules for MeasEval.

Benjamin Thérien, Parsa Bagherzadeh, Sabine Bergler

Proceedings of the 15th International Workshop on Semantic Evaluation, 2021