Mansheej Paul

According to our database, Mansheej Paul authored at least 12 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

μnit Scaling: Simple and Scalable FP8 LLM Training.

Saaketh Narayan, Abhay Gupta, Mansheej Paul, Davis W. Blalock

CoRR, February, 2025

Soup to go: mitigating forgetting during continual learning with model averaging.

Anat Kleiman, Gintare Karolina Dziugaite, Jonathan Frankle, Sham M. Kakade, Mansheej Paul

CoRR, January, 2025

Scaling Laws for Precision.

Tanishq Kumar, Zachary Ankner, Benjamin Frederick Spector, Blake Bordelon, Niklas Muennighoff, Mansheej Paul, Cengiz Pehlevan, Christopher Ré, Aditi Raghunathan

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models.

Zachary Ankner, Cody Blakeney, Kartik Sreenivasan, Max Marion, Matthew L. Leavitt, Mansheej Paul

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

LoRA Learns Less and Forgets Less.

Dan Biderman, Jacob P. Portes, Jose Javier Gonzalez Ortiz, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John Patrick Cunningham

Trans. Mach. Learn. Res., 2024

Critique-out-Loud Reward Models.

Zachary Ankner, Mansheej Paul, Brandon Cui, Jonathan D. Chang, Prithviraj Ammanabrolu

CoRR, 2024

Does your data spark joy? Performance gains from domain upsampling at the end of training.

Cody Blakeney, Mansheej Paul, Brett W. Larsen, Sean Owen, Jonathan Frankle

CoRR, 2024

2023

Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression.

Allan Raventós, Mansheej Paul, Feng Chen, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Unmasking the Lottery Ticket Hypothesis: What's Encoded in a Winning Ticket's Mask?

Mansheej Paul, Feng Chen, Brett W. Larsen, Jonathan Frankle, Surya Ganguli, Gintare Karolina Dziugaite

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

Lottery Tickets on a Data Diet: Finding Initializations with Sparse Trainable Networks.

Mansheej Paul, Brett W. Larsen, Surya Ganguli, Jonathan Frankle, Gintare Karolina Dziugaite

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

2021

Deep Learning on a Data Diet: Finding Important Examples Early in Training.

Mansheej Paul, Surya Ganguli, Gintare Karolina Dziugaite

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

Deep learning versus kernel learning: an empirical study of loss landscape geometry and the time evolution of the Neural Tangent Kernel.

Stanislav Fort, Gintare Karolina Dziugaite, Mansheej Paul, Sepideh Kharaghani, Daniel M. Roy, Surya Ganguli

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020