Suriya Gunasekar

According to our database, Suriya Gunasekar authored at least 40 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of three.
• Erdős number of three.

2024

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

Marah I Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat S. Behl, Alon Benhaim, Misha Bilenko, Johan Bjorck, Sébastien Bubeck, Martin Cai, Caio César Teodoro Mendes, Weizhu Chen, Vishrav Chaudhary, Parul Chopra, Allie Del Giorno, Gustavo de Rosa, Matthew Dixon, Ronen Eldan, Dan Iter, Amit Garg, Abhishek Goswami, Suriya Gunasekar, Emman Haider, Junheng Hao, Russell J. Hewett, Jamie Huynh, Mojan Javaheripi, Xin Jin, Piero Kauffmann, Nikos Karampatziakis, Dongwoo Kim, Mahoud Khademi, Lev Kurilenko, James R. Lee, Yin Tat Lee, Yuanzhi Li, Chen Liang, Weishung Liu, Eric Lin, Zeqi Lin, Piyush Madan, Arindam Mitra, Hardik Modi, Anh Nguyen, Brandon Norick, Barun Patra, Daniel Perez-Becker, Thomas Portet, Reid Pryzant, Heyang Qin, Marko Radmilac, Corby Rosset, Sambudha Roy, Olatunji Ruwase, Olli Saarikivi, Amin Saied, Adil Salim, Michael Santacroce, Shital Shah, Ning Shang, Hiteshi Sharma, Xia Song, Masahiro Tanaka, Xin Wang, Rachel Ward, Guanhua Wang, Philipp Witte, Michael Wyatt, Can Xu, Jiahang Xu, Sonali Yadav, Fan Yang, Ziyi Yang, Donghan Yu, Chengruidong Zhang, Cyril Zhang, Jianwen Zhang, Li Lyna Zhang, Yi Zhang, Yue Zhang, Yunan Zhang, Xiren Zhou

CoRR, 2024

Attention Satisfies: A Constraint-Satisfaction Lens on Factual Errors of Language Models.

Mert Yüksekgönül, Varun Chandrasekaran, Erik Jones, Suriya Gunasekar, Ranjita Naik, Hamid Palangi, Ece Kamar, Besmira Nushi

Proceedings of the Twelfth International Conference on Learning Representations, 2024

How to Fine-Tune Vision Models with SGD.

Ananya Kumar, Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

Proceedings of the Twelfth International Conference on Learning Representations, 2024

KITAB: Evaluating LLMs on Constraint Satisfaction for Information Retrieval.

Marah I Abdin, Suriya Gunasekar, Varun Chandrasekaran, Jerry Li, Mert Yüksekgönül, Rahee Ghosh Peshawaria, Ranjita Naik, Besmira Nushi

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Textbooks Are All You Need II: phi-1.5 technical report.

Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, Yin Tat Lee

CoRR, 2023

Textbooks Are All You Need.

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Yin Tat Lee, Yuanzhi Li

CoRR, 2023

(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability.

Mathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas Flammarion

CoRR, 2023

(S)GD over Diagonal Linear Networks: Implicit bias, Large Stepsizes and Edge of Stability.

Mathieu Even, Scott Pesme, Suriya Gunasekar, Nicolas Flammarion

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Generalization to translation shifts: a study in architectures and augmentations.

Suriya Gunasekar

CoRR, 2022

Unveiling Transformers with LEGO: a synthetic reasoning task.

Yi Zhang, Arturs Backurs, Sébastien Bubeck, Ronen Eldan, Suriya Gunasekar, Tal Wagner

CoRR, 2022

Data Augmentation as Feature Manipulation: a story of desert cows and grass cows.

Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

CoRR, 2022

Data Augmentation as Feature Manipulation.

Ruoqi Shen, Sébastien Bubeck, Suriya Gunasekar

Proceedings of the International Conference on Machine Learning, 2022

Neural-Sim: Learning to Generate Training Data with NeRF.

Yunhao Ge, Harkirat S. Behl, Jiashu Xu, Suriya Gunasekar, Neel Joshi, Yale Song, Xin Wang, Laurent Itti, Vibhav Vineet

Proceedings of the Computer Vision - ECCV 2022, 2022

Inductive Bias of Multi-Channel Linear Convolutional Networks with Bounded Weight Norm.

Meena Jagadeesan, Ilya P. Razenshteyn, Suriya Gunasekar

Proceedings of the Conference on Learning Theory, 2-5 July 2022, London, UK., 2022

2021

Mirrorless Mirror Descent: A Natural Derivation of Mirror Descent.

Suriya Gunasekar, Blake E. Woodworth, Nathan Srebro

Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 2021

2020

NeurIPS 2020 Competition: Predicting Generalization in Deep Learning.

Yiding Jiang, Pierre Foret, Scott Yak, Daniel M. Roy, Hossein Mobahi, Gintare Karolina Dziugaite, Samy Bengio, Suriya Gunasekar, Isabelle Guyon, Behnam Neyshabur

CoRR, 2020

Mirrorless Mirror Descent: A More Natural Discretization of Riemannian Gradient Flow.

Suriya Gunasekar, Blake E. Woodworth, Nathan Srebro

CoRR, 2020

Implicit Regularization and Convergence for Weight Normalization.

Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren, Shanshan Wu, Zhiyuan Li, Suriya Gunasekar, Rachel A. Ward, Qiang Liu

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Implicit Bias in Deep Linear Classification: Initialization Scale vs Training Accuracy.

Edward Moroshko, Blake E. Woodworth, Suriya Gunasekar, Jason D. Lee, Nati Srebro, Daniel Soudry

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Methods and Analysis of The First Competition in Predicting Generalization of Deep Learning.

Yiding Jiang, Parth Natekar, Manik Sharma, Sumukh K. Aithal, Dhruva Kashyap, Natarajan Subramanyam, Carlos Lassance, Daniel M. Roy, Gintare Karolina Dziugaite, Suriya Gunasekar, Isabelle Guyon, Pierre Foret, Scott Yak, Hossein Mobahi, Behnam Neyshabur, Samy Bengio

Proceedings of the NeurIPS 2020 Competition and Demonstration Track, 2020

Kernel and Rich Regimes in Overparametrized Models.

Blake E. Woodworth, Suriya Gunasekar, Jason D. Lee, Edward Moroshko, Pedro Savarese, Itay Golan, Daniel Soudry, Nathan Srebro

Proceedings of the Conference on Learning Theory, 2020

2019

Implicit Regularization of Normalization Methods.

Xiaoxia Wu, Edgar Dobriban, Tongzheng Ren, Shanshan Wu, Zhiyuan Li, Suriya Gunasekar, Rachel A. Ward, Qiang Liu

CoRR, 2019

Lexicographic and Depth-Sensitive Margins in Homogeneous and Non-Homogeneous Deep Models.

Mor Shpigel Nacson, Suriya Gunasekar, Jason D. Lee, Nathan Srebro, Daniel Soudry

Proceedings of the 36th International Conference on Machine Learning, 2019

Convergence of Gradient Descent on Separable Data.

Mor Shpigel Nacson, Jason D. Lee, Suriya Gunasekar, Pedro Henrique Pamplona Savarese, Nathan Srebro, Daniel Soudry

Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, 2019

2018

The Implicit Bias of Gradient Descent on Separable Data.

Daniel Soudry, Elad Hoffer, Mor Shpigel Nacson, Suriya Gunasekar, Nathan Srebro

J. Mach. Learn. Res., 2018

Convergence of Gradient Descent on Separable Data.

Mor Shpigel Nacson, Jason D. Lee, Suriya Gunasekar, Nathan Srebro, Daniel Soudry

CoRR, 2018

Implicit Bias of Gradient Descent on Linear Convolutional Networks.

Suriya Gunasekar, Jason D. Lee, Daniel Soudry, Nati Srebro

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

On preserving non-discrimination when combining expert advice.

Avrim Blum, Suriya Gunasekar, Thodoris Lykouris, Nati Srebro

Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Characterizing Implicit Bias in Terms of Optimization Geometry.

Suriya Gunasekar, Jason D. Lee, Daniel Soudry, Nathan Srebro

Proceedings of the 35th International Conference on Machine Learning, 2018

2017

Implicit Regularization in Matrix Factorization.

Suriya Gunasekar, Blake E. Woodworth, Srinadh Bhojanapalli, Behnam Neyshabur, Nati Srebro

Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Learning Non-Discriminatory Predictors.

Blake E. Woodworth, Suriya Gunasekar, Mesrob I. Ohannessian, Nathan Srebro

Proceedings of the 30th Conference on Learning Theory, 2017

2016

Preference Completion from Partial Rankings.

Suriya Gunasekar, Oluwasanmi Koyejo, Joydeep Ghosh

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016

Identifiable Phenotyping using Constrained Non-Negative Matrix Factorization.

Shalmali Joshi, Suriya Gunasekar, David A. Sontag, Joydeep Ghosh

Proceedings of the 1st Machine Learning in Health Care, 2016

2015

Unified View of Matrix Completion under General Structural Constraints.

Suriya Gunasekar, Arindam Banerjee, Joydeep Ghosh

Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

Consistent Collective Matrix Completion under Joint Low Rank Structure.

Suriya Gunasekar, Makoto Yamada, Dawei Yin, Yi Chang

Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, 2015

2014

Face Detection on Distorted Images Augmented by Perceptual Quality-Aware Features.

Suriya Gunasekar, Joydeep Ghosh, Alan C. Bovik

IEEE Trans. Inf. Forensics Secur., 2014

Exponential Family Matrix Completion under Structural Constraints.

Suriya Gunasekar, Pradeep Ravikumar, Joydeep Ghosh

Proceedings of the 31th International Conference on Machine Learning, 2014

Face detection on distorted images using perceptual quality-aware features.

Suriya Gunasekar, Joydeep Ghosh, Alan C. Bovik

Proceedings of the Human Vision and Electronic Imaging XIX, 2014

2013

Noisy Matrix Completion Using Alternating Minimization.

Suriya Gunasekar, Ayan Acharya, Neeraj Gaur, Joydeep Ghosh

Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2013

2012

Review quality aware collaborative filtering.

Sindhu Raghavan, Suriya Gunasekar, Joydeep Ghosh

Proceedings of the Sixth ACM Conference on Recommender Systems, 2012