Deep Speech 2: End-to-End Speech Recognition in English and Mandarin. - Dario Amodei; Rishita Anubhai; Eric Battenberg; Carl Case; Jared Casper; Bryan Catanzaro; Jingdong Chen; Mike Chrzanowski; Adam Coates 002; Greg Diamos; Erich Elsen; Jesse H. Engel; et al. (CoRR, 2015)

Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin. - Dario Amodei; Sundaram Ananthanarayanan; Rishita Anubhai; Jingliang Bai; Eric Battenberg; Carl Case; Jared Casper; Bryan Catanzaro; Jingdong Chen; Mike Chrzanowski; Adam Coates 002; Greg Diamos; et al. (ICML, 2016)

DSD: Regularizing Deep Neural Networks with Dense-Sparse-Dense Training Flow. - Song Han 003; Jeff Pool; Sharan Narang; Huizi Mao; Shijian Tang; Erich Elsen; Bryan Catanzaro; John Tran; William J. Dally (CoRR, 2016)

DSD: Dense-Sparse-Dense Training for Deep Neural Networks. - Song Han 003; Jeff Pool; Sharan Narang; Huizi Mao; Enhao Gong; Shijian Tang; Erich Elsen; Peter Vajda; Manohar Paluri; John Tran; Bryan Catanzaro; William J. Dally (ICLR (Poster), 2017)

Exploring Sparsity in Recurrent Neural Networks. - Sharan Narang; Greg Diamos; Shubho Sengupta; Erich Elsen (ICLR (Poster), 2017)

Deep Voice 3: 2000-Speaker Neural Text-to-Speech. - Wei Ping; Kainan Peng; Andrew Gibiansky; Sercan Ömer Arik; Ajay Kannan; Sharan Narang; Jonathan Raiman; John Miller 001 (CoRR, 2017)

Block-Sparse Recurrent Neural Networks. - Sharan Narang; Eric Undersander; Gregory F. Diamos (CoRR, 2017)

Deep Learning Scaling is Predictable, Empirically. - Joel Hestness; Sharan Narang; Newsha Ardalani; Gregory F. Diamos; Heewoo Jun; Hassan Kianinejad; Md. Mostofa Ali Patwary; Yang Yang; Yanqi Zhou (CoRR, 2017)

Mixed Precision Training. - Paulius Micikevicius; Sharan Narang; Jonah Alben; Gregory F. Diamos; Erich Elsen; David García; Boris Ginsburg; Michael Houston; Oleksii Kuchaiev; Ganesh Venkatesh; Hao Wu (ICLR (Poster), 2018)

Deep Voice 3: Scaling Text-to-Speech with Convolutional Sequence Learning. - Wei Ping; Kainan Peng; Andrew Gibiansky; Sercan Ömer Arik; Ajay Kannan; Sharan Narang; Jonathan Raiman; John Miller 001 (ICLR (Poster), 2018)

Neural Assistant: Joint Action Prediction, Response Generation, and Latent Knowledge Reasoning. - Arvind Neelakantan; Semih Yavuz; Sharan Narang; Vishaal Prasad; Ben Goodrich; Daniel Duckworth; Chinnadhurai Sankar; Xifeng Yan (CoRR, 2019)

On Task-Level Dialogue Composition of Generative Transformer Model. - Prasanna Parthasarathi; Sharan Narang; Arvind Neelakantan (Insights, 2020)

WT5?! Training Text-to-Text Models to Explain their Predictions. - Sharan Narang; Colin Raffel; Katherine Lee; Adam Roberts; Noah Fiedel; Karishma Malkan (CoRR, 2020)

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. - Colin Raffel; Noam Shazeer; Adam Roberts; Katherine Lee; Sharan Narang; Michael Matena; Yanqi Zhou; Wei Li 133; Peter J. Liu (J. Mach. Learn. Res., 2020)

Do Transformer Modifications Transfer Across Implementations and Applications? - Sharan Narang; Hyung Won Chung; Yi Tay; Liam Fedus; Thibault Févry; Michael Matena; Karishma Malkan; Noah Fiedel; Noam Shazeer; Zhenzhong Lan; Yanqi Zhou; Wei Li 133; et al. (EMNLP (1), 2021)

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers. - Yi Tay; Mostafa Dehghani 001; Jinfeng Rao; William Fedus; Samira Abnar; Hyung Won Chung; Sharan Narang; Dani Yogatama; Ashish Vaswani; Donald Metzler (CoRR, 2021)

Scale Efficiently: Insights from Pretraining and Finetuning Transformers. - Yi Tay; Mostafa Dehghani 001; Jinfeng Rao; William Fedus; Samira Abnar; Hyung Won Chung; Sharan Narang; Dani Yogatama; Ashish Vaswani; Donald Metzler (ICLR, 2022)

Scaling Up Models and Data with t5x and seqio. - Adam Roberts; Hyung Won Chung; Anselm Levskaya; Gaurav Mishra; James Bradbury; Daniel Andor; Sharan Narang; Brian Lester; Colin Gaffney; Afroz Mohiuddin; Curtis Hawthorne; Aitor Lewkowycz; et al. (CoRR, 2022)

Scaling Instruction-Finetuned Language Models. - Hyung Won Chung; Le Hou; Shayne Longpre; Barret Zoph; Yi Tay; William Fedus; Eric Li; Xuezhi Wang 002; Mostafa Dehghani 001; Siddhartha Brahma; Albert Webson; Shixiang Shane Gu; et al. (CoRR, 2022)

FCM: Forgetful Causal Masking Makes Causal Language Models Better Zero-Shot Learners. - Hao Liu 055; Xinyang Geng; Lisa Lee; Igor Mordatch; Sergey Levine; Sharan Narang; Pieter Abbeel (CoRR, 2022)

ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models. - Linting Xue; Aditya Barua; Noah Constant; Rami Al-Rfou; Sharan Narang; Mihir Kale; Adam Roberts; Colin Raffel (Trans. Assoc. Comput. Linguistics, 2022)

Character-Aware Models Improve Visual Text Rendering. - Rosanne Liu; Dan Garrette; Chitwan Saharia; William Chan; Adam Roberts; Sharan Narang; Irina Blok; RJ Mical; Mohammad Norouzi 002; Noah Constant (ACL (1), 2023)

Understanding HTML with Large Language Models. - Izzeddin Gur; Ofir Nachum; Yingjie Miao; Mustafa Safdari; Austin V. Huang; Aakanksha Chowdhery; Sharan Narang; Noah Fiedel; Aleksandra Faust (EMNLP (Findings), 2023)

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? - Yi Tay; Mostafa Dehghani 001; Samira Abnar; Hyung Won Chung; William Fedus; Jinfeng Rao; Sharan Narang; Vinh Q. Tran 002; Dani Yogatama; Donald Metzler (EMNLP (Findings), 2023)

Self-Consistency Improves Chain of Thought Reasoning in Language Models. - Xuezhi Wang 002; Jason Wei; Dale Schuurmans; Quoc V. Le; Ed H. Chi; Sharan Narang; Aakanksha Chowdhery; Denny Zhou (ICLR, 2023)

UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining. - Hyung Won Chung; Xavier Garcia; Adam Roberts; Yi Tay; Orhan Firat; Sharan Narang; Noah Constant (ICLR, 2023)

A Theory on Adam Instability in Large-Scale Machine Learning. - Igor Molybog; Peter Albert; Moya Chen; Zachary DeVito; David Esiobu; Naman Goyal 001; Punit Singh Koura; Sharan Narang; Andrew Poulton; Ruan Silva; Binh Tang; Diana Liskovich; et al. (CoRR, 2023)

Llama 2: Open Foundation and Fine-Tuned Chat Models. - Hugo Touvron; Louis Martin; Kevin Stone; Peter Albert; Amjad Almahairi; Yasmine Babaei; Nikolay Bashlykov; Soumya Batra; Prajjwal Bhargava; Shruti Bhosale; Dan Bikel; Lukas Blecher; et al. (CoRR, 2023)

PaLM: Scaling Language Modeling with Pathways. - Aakanksha Chowdhery; Sharan Narang; Jacob Devlin; Maarten Bosma; Gaurav Mishra; Adam Roberts; Paul Barham 001; Hyung Won Chung; Charles Sutton; Sebastian Gehrmann; Parker Schuh; Kensen Shi; et al. (J. Mach. Learn. Res., 2023)

Scaling Up Models and Data with t5x and seqio. - Adam Roberts; Hyung Won Chung; Gaurav Mishra; Anselm Levskaya; James Bradbury; Daniel Andor; Sharan Narang; Brian Lester; Colin Gaffney; Afroz Mohiuddin; Curtis Hawthorne; Aitor Lewkowycz; et al. (J. Mach. Learn. Res., 2023)

Effective Long-Context Scaling of Foundation Models. - Wenhan Xiong; Jingyu Liu; Igor Molybog; Hejia Zhang; Prajjwal Bhargava; Rui Hou; Louis Martin; Rashi Rungta; Karthik Abinav Sankararaman; Barlas Oguz; Madian Khabsa; Han Fang; et al. (NAACL-HLT, 2024)

Quantifying Variance in Evaluation Benchmarks. - Lovish Madaan; Aaditya K. Singh; Rylan Schaeffer; Andrew Poulton; Sanmi Koyejo; Pontus Stenetorp; Sharan Narang; Dieuwke Hupkes (CoRR, 2024)

Scaling Instruction-Finetuned Language Models. - Hyung Won Chung; Le Hou; Shayne Longpre; Barret Zoph; Yi Tay; William Fedus; Yunxuan Li; Xuezhi Wang 002; Mostafa Dehghani 001; Siddhartha Brahma; Albert Webson; Shixiang Shane Gu; et al. (J. Mach. Learn. Res., 2024)

Compute Optimal Scaling of Skills: Knowledge vs Reasoning. - Nicholas Roberts; Niladri S. Chatterji; Sharan Narang; Mike Lewis; Dieuwke Hupkes (ACL (Findings), 2025)

Law of the Weakest Link: Cross Capabilities of Large Language Models. - Ming Zhong 005; Aston Zhang; Xuewei Wang; Rui Hou; Wenhan Xiong; Chenguang Zhu 001; Zhengxing Chen; Liang Tan; Chloe Bi; Mike Lewis; Sravya Popuri; Sharan Narang; et al. (ICLR, 2025)

Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks. - Rylan Schaeffer; Punit Singh Koura; Binh Tang; Ranjan Subramanian; Aaditya K. Singh; Todor Mihaylov; Prajjwal Bhargava; Lovish Madaan; Niladri S. Chatterji; Vedanuj Goswami; Sergey Edunov; Dieuwke Hupkes; et al. (CoRR, 2025)