Samy Jelassi

According to our database, Samy Jelassi authored at least 26 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Collective Model Intelligence Requires Compatible Specialization.

Jyothish Pari, Samy Jelassi, Pulkit Agrawal

CoRR, 2024

Mixture of Parrots: Experts improve memorization more than reasoning.

Samy Jelassi, Clara Mohri, David Brandfonbrener, Alex Gu, Nikhil Vyas, Nikhil Anand, David Alvarez-Melis, Yuanzhi Li, Sham M. Kakade, Eran Malach

CoRR, 2024

LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks.

Akshara Prabhakar, Yuanzhi Li, Karthik Narasimhan, Sham M. Kakade, Eran Malach, Samy Jelassi

CoRR, 2024

Universal Length Generalization with Turing Programs.

Kaiying Hou, David Brandfonbrener, Sham M. Kakade, Samy Jelassi, Eran Malach

CoRR, 2024

How Does Overparameterization Affect Features?

Ahmet Cagri Duzgun, Samy Jelassi, Yuanzhi Li

CoRR, 2024

Repeat After Me: Transformers are Better than State Space Models at Copying.

Samy Jelassi, David Brandfonbrener, Sham M. Kakade, Eran Malach

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Q-Probe: A Lightweight Approach to Reward Maximization for Language Models.

Kenneth Li, Samy Jelassi, Hugh Zhang, Sham M. Kakade, Martin Wattenberg, David Brandfonbrener

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Algorithmic and architectural implicit biases in deep learning

Samy Jelassi

PhD thesis, 2023

Length Generalization in Arithmetic Transformers.

Samy Jelassi, Stéphane d'Ascoli, Carles Domingo-Enrich, Yuhuai Wu, Yuanzhi Li, François Charton

CoRR, 2023

Depth Dependence of μP Learning Rates in ReLU MLPs.

Samy Jelassi, Boris Hanin, Ziwei Ji, Sashank J. Reddi, Srinadh Bhojanapalli, Sanjiv Kumar

CoRR, 2023

2022

Depth separation beyond radial functions.

Luca Venturi, Samy Jelassi, Tristan Ozuch, Joan Bruna

J. Mach. Learn. Res., 2022

A Momentumized, Adaptive, Dual Averaged Gradient Method.

Aaron Defazio, Samy Jelassi

J. Mach. Learn. Res., 2022

Dissecting adaptive methods in GANs.

Samy Jelassi, David Dobre, Arthur Mensch, Yuanzhi Li, Gauthier Gidel

CoRR, 2022

Vision Transformers provably learn spatial structure.

Samy Jelassi, Michael E. Sander, Yuanzhi Li

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Towards understanding how momentum improves generalization in deep learning.

Samy Jelassi, Yuanzhi Li

Proceedings of the International Conference on Machine Learning, 2022

2021

Adaptivity without Compromise: A Momentumized, Adaptive, Dual Averaged Gradient Method for Stochastic Optimization.

Aaron Defazio, Samy Jelassi

CoRR, 2021

Auction Learning as a Two-Player Game.

Jad Rahme, Samy Jelassi, S. Matthew Weinberg

Proceedings of the 9th International Conference on Learning Representations, 2021

A Permutation-Equivariant Neural Network Architecture For Auction Design.

Jad Rahme, Samy Jelassi, Joan Bruna, S. Matthew Weinberg

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Dual Averaging is Surprisingly Effective for Deep Learning Optimization.

Samy Jelassi, Aaron Defazio

CoRR, 2020

A mean-field analysis of two-player zero-sum games.

Carles Domingo-Enrich, Samy Jelassi, Arthur Mensch, Grant M. Rotskoff, Joan Bruna

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Extra-gradient with player sampling for faster convergence in n-player games.

Samy Jelassi, Carles Domingo-Enrich, Damien Scieur, Arthur Mensch, Joan Bruna

Proceedings of the 37th International Conference on Machine Learning, 2020

2019

Extra-gradient with player sampling for provable fast convergence in n-player games.

Samy Jelassi, Carles Domingo-Enrich, Damien Scieur, Arthur Mensch, Joan Bruna

CoRR, 2019

Global convergence of neuron birth-death dynamics.

Grant M. Rotskoff, Samy Jelassi, Joan Bruna, Eric Vanden-Eijnden

CoRR, 2019

Towards closing the gap between the theory and practice of SVRG.

Othmane Sebbouh, Nidham Gazagnadou, Samy Jelassi, Francis R. Bach, Robert M. Gower

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Neuron birth-death dynamics accelerates gradient descent and converges asymptotically.

Grant M. Rotskoff, Samy Jelassi, Joan Bruna, Eric Vanden-Eijnden

Proceedings of the 36th International Conference on Machine Learning, 2019

2018

Smoothed analysis of the low-rank approach for smooth semidefinite programs.

Thomas Pumir, Samy Jelassi, Nicolas Boumal

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018