Source Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language. - He Bai 002; Yu Zhou 001; Jiajun Zhang 001; Liang Zhao; Mei-Yuh Hwang; Chengqing Zong (COLING, 2018)

Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference. - He Bai 002; Yu Zhou 001; Jiajun Zhang 001; Chengqing Zong (ACL (1), 2019)

Cross-Lingual Training of Neural Models for Document Ranking. - Peng Shi 010; He Bai 002; Jimmy Lin (EMNLP (Findings), 2020)

Semantics of the Unwritten. - He Bai 002; Peng Shi 010; Jimmy Lin; Luchen Tan; Kun Xiong; Wen Gao 001; Jie Liu 035; Ming Li 001 (CoRR, 2020)

SegaBERT: Pre-training of Segment-aware BERT for Language Understanding. - He Bai 002; Peng Shi 010; Jimmy Lin; Luchen Tan; Kun Xiong; Wen Gao 001; Ming Li 001 (CoRR, 2020)

Latte-Mix: Measuring Sentence Semantic Similarity with Latent Categorical Mixtures. - Minghan Li 002; He Bai 002; Luchen Tan; Kun Xiong; Ming Li 001; Jimmy Lin (CoRR, 2020)

Segatron: Segment-Aware Transformer for Language Modeling and Understanding. - He Bai 002; Peng Shi 010; Jimmy Lin; Yuqing Xie 001; Luchen Tan; Kun Xiong; Wen Gao 001; Ming Li 001 (AAAI, 2021)

Semantics of the Unwritten: The Effect of End of Paragraph and Sequence Tokens on Text Generation with GPT2. - He Bai 002; Peng Shi 010; Jimmy Lin; Luchen Tan; Kun Xiong; Wen Gao 001; Jie Liu 035; Ming Li 001 (ACL (student), 2021)

Cross-Lingual Training with Dense Retrieval for Document Retrieval. - Peng Shi 010; Rui Zhang 037; He Bai 002; Jimmy Lin (CoRR, 2021)

Better Language Model with Hypernym Class Prediction. - He Bai 002; Tong Wang 012; Alessandro Sordoni; Peng Shi 010 (ACL (1), 2022)

Cross-lingual Text-to-SQL Semantic Parsing with Representation Mixup. - Peng Shi 010; Linfeng Song; Lifeng Jin; Haitao Mi; He Bai 002; Jimmy Lin; Dong Yu 001 (EMNLP (Findings), 2022)

XRICL: Cross-lingual Retrieval-Augmented In-Context Learning for Cross-lingual Text-to-SQL Semantic Parsing. - Peng Shi 010; Rui Zhang 037; He Bai 002; Jimmy Lin (EMNLP (Findings), 2022)

A3T: Alignment-Aware Acoustic and Text Pretraining for Speech Synthesis and Editing. - He Bai 002; Renjie Zheng; Jun-Kun Chen; Mingbo Ma; Xintong Li; Liang Huang 001 (ICML, 2022)

ERNIE-SAT: Speech and Text Joint Pretraining for Cross-Lingual Multi-Speaker Text-to-Speech. - Xiaoran Fan; Chao Pang; Tian Yuan; He Bai 002; Renjie Zheng; Pengfei Zhu; Shuohuan Wang; Jun-Kun Chen; Zeyu Chen; Liang Huang 001; Yu Sun 004; Hua Wu 003 (CoRR, 2022)

KGLens: A Parameterized Knowledge Graph Solution to Assess What an LLM Does and Doesn't Know. - Shangshang Zheng; He Bai 002; Yizhe Zhang 002; Yi Su; Xiaochuan Niu; Navdeep Jaitly (CoRR, 2023)

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling. - Pratyush Maini; Skyler Seto; Richard He Bai; David Grangier; Yizhe Zhang 002; Navdeep Jaitly (ACL (1), 2024)

Construction of Paired Knowledge Graph - Text Datasets Informed by Cyclic Evaluation. - Ali Mousavi 003; Xin Zhan; He Bai 002; Peng Shi 010; Theodoros Rekatsinas; Benjamin Han; Yunyao Li 001; Jeffrey Pound; Joshua M. Susskind; Natalie Schluter; Ihab F. Ilyas; Navdeep Jaitly (LREC/COLING, 2024)

Divide-or-Conquer? Which Part Should You Distill Your LLM? - Zhuofeng Wu 001; Richard He Bai; Aonan Zhang; Jiatao Gu; V. G. Vinod Vydiswaran; Navdeep Jaitly; Yizhe Zhang 002 (EMNLP (Findings), 2024)

How Far Are We from Intelligent Visual Deductive Reasoning? - Yizhe Zhang 002; He Bai 002; Ruixiang Zhang; Jiatao Gu; Shuangfei Zhai; Josh M. Susskind; Navdeep Jaitly (CoRR, 2024)

Denoising LM: Pushing the Limits of Error Correction Models for Speech Recognition. - Zijin Gu; Tatiana Likhomanenko; He Bai 002; Erik McDermott; Ronan Collobert; Navdeep Jaitly (CoRR, 2024)

dMel: Speech Tokenization made Simple. - He Bai 002; Tatiana Likhomanenko; Ruixiang Zhang; Zijin Gu; Zakaria Aldeneh; Navdeep Jaitly (CoRR, 2024)

Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis. - Akshita Gupta; Tatiana Likhomanenko; Karren Dai Yang; Richard He Bai; Zakaria Aldeneh; Navdeep Jaitly (CoRR, 2024)

Training Bilingual LMs with Data Constraints in the Targeted Language. - Skyler Seto; Maartje ter Hoeve; Richard He Bai; Natalie Schluter; David Grangier (ACL (Findings), 2025)

Reversal Blessing: Thinking Backward May Outpace Thinking Forward in Multi-choice Questions. - Yizhe Zhang 002; Richard He Bai; Zijin Gu; Ruixiang Zhang; Jiatao Gu; Emmanuel Abbe; Samy Bengio; Navdeep Jaitly (CoRR, 2025)

SpeakStream: Streaming Text-to-Speech with Interleaved Data. - Richard He Bai; Zijin Gu; Tatiana Likhomanenko; Navdeep Jaitly (CoRR, 2025)