Sunny Sanyal

According to our database, Sunny Sanyal authored at least 10 papers between 2017 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models.

Sunny Sanyal, Ravid Shwartz-Ziv, Alex Dimakis, Sujay Sanghavi

Trans. Mach. Learn. Res., 2026

2025

Upweighting Easy Samples in Fine-Tuning Mitigates Forgetting.

Sunny Sanyal, Hayden Prairie, Rudrajit Das, Ali Kavis, Sujay Sanghavi

Proceedings of the Forty-second International Conference on Machine Learning, 2025

2024

Pre-training Small Base LMs with Fewer Tokens.

Sunny Sanyal, Sujay Sanghavi, Alexandros G. Dimakis

CoRR, 2024

DataComp-LM: In search of the next generation of training sets for language models.

Jeffrey Li, Alex Fang, Georgios Smyrnis, Maor Ivgi, Matt Jordan, Samir Yitzhak Gadre, Hritik Bansal, Etash Kumar Guha, Sedrick Scott Keh, Kushal Arora, Saurabh Garg, Rui Xin, Niklas Muennighoff, Reinhard Heckel, Jean Mercat, Mayee F. Chen, Suchin Gururangan, Mitchell Wortsman, Alon Albalak, Yonatan Bitton, Marianna Nezhurina, Amro Abbas, Cheng-Yu Hsieh, Dhruba Ghosh, Josh Gardner, Maciej Kilian, Hanlin Zhang, Rulin Shao, Sarah M. Pratt, Sunny Sanyal, Gabriel Ilharco, Giannis Daras, Kalyani Marathe, Aaron Gokaslan, Jieyu Zhang, Khyathi Raghavi Chandu, Thao Nguyen, Igor Vasiljevic, Sham M. Kakade, Shuran Song, Sujay Sanghavi, Fartash Faghri, Sewoong Oh, Luke Zettlemoyer, Kyle Lo, Alaaeldin El-Nouby, Hadi Pouransari, Alexander Toshev, Stephanie Wang, Dirk Groeneveld, Luca Soldaini, Pang Wei Koh, Jenia Jitsev, Thomas Kollar, Alex Dimakis, Yair Carmon, Achal Dave, Ludwig Schmidt, Vaishaal Shankar

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

2023

Understanding the Effectiveness of Early Weight Averaging for Training Large Language Models.

Sunny Sanyal, Jean Kaddour, Abhishek Kumar, Sujay Sanghavi

CoRR, 2023

2020

DeepMines: A fog Enabled Prediction Platform for Underground Coal Mines.

Sunny Sanyal, Animesh Chattopadhyay

Proceedings of the 2020 International Conference on COMmunication Systems & NETworkS, 2020

2019

Data Aggregation Techniques for Internet of Things.

Sunny Sanyal

CoRR, 2019

A Federated Filtering Framework for Internet of Medical Things.

Sunny Sanyal, Dapeng Wu, Boubakr Nour

Proceedings of the 2019 IEEE International Conference on Communications, 2019

2018

Improving Quality of Data: IoT Data Aggregation Using Device to Device Communications.

Sunny Sanyal, Puning Zhang

IEEE Access, 2018

2017

Trust-Oriented Partner Selection in D2D Cooperative Communications.

Junjie Yan, Dapeng Wu, Sunny Sanyal, Ruyan Wang

IEEE Access, 2017