Abhishek Panigrahi

According to our database, Abhishek Panigrahi authored at least 15 papers between 2017 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Efficient Stagewise Pretraining via Progressive Subnetworks.

Abhishek Panigrahi, Nikunj Saunshi, Kaifeng Lyu, Sobhan Miryoosefi, Sashank J. Reddi, Satyen Kale, Sanjiv Kumar

CoRR, 2024

2023

Trainable Transformer in Transformer.

Abhishek Panigrahi, Sadhika Malladi, Mengzhou Xia, Sanjeev Arora

CoRR, 2023

Task-Specific Skill Localization in Fine-tuned Language Models.

Abhishek Panigrahi, Nikunj Saunshi, Haoyu Zhao, Sanjeev Arora

Proceedings of the International Conference on Machine Learning, 2023

Do Transformers Parse while Predicting the Masked Word?

Haoyu Zhao, Abhishek Panigrahi, Rong Ge, Sanjeev Arora

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

On the SDEs and Scaling Rules for Adaptive Gradient Algorithms.

Sadhika Malladi, Kaifeng Lyu, Abhishek Panigrahi, Sanjeev Arora

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Understanding Gradient Descent on the Edge of Stability in Deep Learning.

Sanjeev Arora, Zhiyuan Li, Abhishek Panigrahi

Proceedings of the International Conference on Machine Learning, 2022

2021

Learning and Generalization in RNNs.

Abhishek Panigrahi, Navin Goyal

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

Effect of Activation Functions on the Training of Overparametrized Neural Nets.

Abhishek Panigrahi, Abhishek Shetty, Navin Goyal

Proceedings of the 8th International Conference on Learning Representations, 2020

2019

Analyzing Social Book Reading Behavior on Goodreads and How It Predicts Amazon Best Sellers.

Suman Kalyan Maity, Abhishek Panigrahi, Animesh Mukherjee

Proceedings of the Influence and Behavior Analysis in Social Networks and Social Media, 2019

Non-Gaussianity of Stochastic Gradient Noise.

Abhishek Panigrahi, Raghav Somani, Navin Goyal, Praneeth Netrapalli

CoRR, 2019

DeepTagRec: A Content-cum-User Based Tag Recommendation Framework for Stack Overflow.

Suman Kalyan Maity, Abhishek Panigrahi, Sayan Ghosh, Arundhati Banerjee, Pawan Goyal, Animesh Mukherjee

Proceedings of the Advances in Information Retrieval, 2019

Word2Sense: Sparse Interpretable Word Embeddings.

Abhishek Panigrahi, Harsha Vardhan Simhadri, Chiranjib Bhattacharyya

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Analysis on Gradient Propagation in Batch Normalized Residual Networks.

Abhishek Panigrahi, Yueru Chen, C.-C. Jay Kuo

CoRR, 2018

Analyzing Social Book Reading Behavior on Goodreads and how it predicts Amazon Best Sellers.

Suman Kalyan Maity, Abhishek Panigrahi, Animesh Mukherjee

CoRR, 2018

2017

Book Reading Behavior on Goodreads Can Predict the Amazon Best Sellers.

Suman Kalyan Maity, Abhishek Panigrahi, Animesh Mukherjee

Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2017, Sydney, Australia, July 31, 2017