PyText: A Seamless Path from NLP research to production. - Ahmed Aly; Kushal Lakhotia; Shicong Zhao; Mrinal Mohit; Barlas Oguz; Abhinav Arora; Sonal Gupta; Christopher Dewan; Stef Nelson-Lindall; Rushin Shah (CoRR, 2018)

FiD-Ex: Improving Sequence-to-Sequence Models for Extractive Rationale Generation. - Kushal Lakhotia; Bhargavi Paranjape; Asish Ghoshal; Scott Yih; Yashar Mehdad; Srini Iyer 001 (EMNLP (1), 2021)

Speech Resynthesis from Discrete Disentangled Self-Supervised Representations. - Adam Polyak; Yossi Adi; Jade Copet; Eugene Kharitonov; Kushal Lakhotia; Wei-Ning Hsu; Abdelrahman Mohamed; Emmanuel Dupoux (Interspeech, 2021)

SUPERB: Speech Processing Universal PERformance Benchmark. - Shu-Wen Yang; Po-Han Chi; Yung-Sung Chuang; Cheng-I Jeff Lai; Kushal Lakhotia; Yist Y. Lin; Andy T. Liu; Jiatong Shi; Xuankai Chang; Guan-Ting Lin; Tzu-Hsien Huang; Wei-Cheng Tseng; et al. (Interspeech, 2021)

Generative Spoken Language Modeling from Raw Audio. - Kushal Lakhotia; Evgeny Kharitonov; Wei-Ning Hsu; Yossi Adi; Adam Polyak; Benjamin Bolte; Tu Anh Nguyen; Jade Copet; Alexei Baevski; Adelrahman Mohamed; Emmanuel Dupoux (CoRR, 2021)

HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units. - Wei-Ning Hsu; Benjamin Bolte; Yao-Hung Hubert Tsai; Kushal Lakhotia; Ruslan Salakhutdinov; Abdelrahman Mohamed (IEEE ACM Trans. Audio Speech Lang. Process., 2021)

Text-Free Prosody-Aware Generative Spoken Language Modeling. - Eugene Kharitonov; Ann Lee 001; Adam Polyak; Yossi Adi; Jade Copet; Kushal Lakhotia; Tu Anh Nguyen; Morgane Rivière; Abdelrahman Mohamed; Emmanuel Dupoux; Wei-Ning Hsu (ACL (1), 2022)

SUPERB-SG: Enhanced Speech processing Universal PERformance Benchmark for Semantic and Generative Capabilities. - Hsiang-Sheng Tsai; Heng-Jui Chang; Wen-Chin Huang; Zili Huang; Kushal Lakhotia; Shu-Wen Yang; Shuyan Dong; Andy T. Liu; Cheng-I Lai; Jiatong Shi; Xuankai Chang; Phil Hall; et al. (ACL (1), 2022)

Salient Phrase Aware Dense Retrieval: Can a Dense Retriever Imitate a Sparse One? - Xilun Chen 002; Kushal Lakhotia; Barlas Oguz; Anchit Gupta; Patrick S. H. Lewis; Stan Peshterliev; Yashar Mehdad; Sonal Gupta; Wen-tau Yih (EMNLP (Findings), 2022)

Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction. - Bowen Shi; Wei-Ning Hsu; Kushal Lakhotia; Abdelrahman Mohamed (ICLR, 2022)

XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale. - Arun Babu; Changhan Wang; Andros Tjandra; Kushal Lakhotia; Qiantong Xu; Naman Goyal 001; Kritika Singh; Patrick von Platen; Yatharth Saraf; Juan Pino 001; Alexei Baevski; Alexis Conneau; et al. (INTERSPEECH, 2022)

Domain-matched Pre-training Tasks for Dense Retrieval. - Barlas Oguz; Kushal Lakhotia; Anchit Gupta; Patrick Lewis 001; Vladimir Karpukhin; Aleksandra Piktus; Xilun Chen 002; Sebastian Riedel 001; Scott Yih; Sonal Gupta; Yashar Mehdad (NAACL-HLT (Findings), 2022)

QUASER: Question Answering with Scalable Extractive Rationalization. - Asish Ghoshal; Srinivasan Iyer 001; Bhargavi Paranjape; Kushal Lakhotia; Scott Wen-tau Yih; Yashar Mehdad (SIGIR, 2022)

textless-lib: a Library for Textless Spoken Language Processing. - Eugene Kharitonov; Jade Copet; Kushal Lakhotia; Tu Anh Nguyen; Paden Tomasello; Ann Lee 001; Ali Elkahky; Wei-Ning Hsu; Abdelrahman Mohamed; Emmanuel Dupoux; Yossi Adi (CoRR, 2022)

A Large-Scale Evaluation of Speech Foundation Models. - Shu-Wen Yang; Heng-Jui Chang; Zili Huang; Andy T. Liu; Cheng-I Lai; Haibin Wu; Jiatong Shi; Xuankai Chang; Hsiang-Sheng Tsai; Wen-Chin Huang; Tzu-hsun Feng; Po-Han Chi; et al. (IEEE ACM Trans. Audio Speech Lang. Process., 2024)