Characterizing the Representer Theorem. - Yaoliang Yu; Hao Cheng 002; Dale Schuurmans; Csaba Szepesvári (ICML (1), 2013)

Convex Two-Layer Modeling. - Özlem Aslan; Hao Cheng 002; Xinhua Zhang; Dale Schuurmans (NIPS, 2013)

Convex Relaxations of Bregman Divergence Clustering. - Hao Cheng 002; Xinhua Zhang; Dale Schuurmans (UAI, 2013)

Language Models for Image Captioning: The Quirks and What Works. - Jacob Devlin; Hao Cheng 002; Hao Fang 002; Saurabh Gupta 001; Li Deng 001; Xiaodong He 001; Geoffrey Zweig; Margaret Mitchell (ACL (2), 2015)

Open-Domain Name Error Detection using a Multi-Task RNN. - Hao Cheng 002; Hao Fang 002; Mari Ostendorf (EMNLP, 2015)

Learning Latent Local Conversation Modes for Predicting Comment Endorsement in Online Discussions. - Hao Fang 002; Hao Cheng 002; Mari Ostendorf (SocialNLP@EMNLP, 2016)

Scalable and Sound Low-Rank Tensor Learning. - Hao Cheng 002; Yaoliang Yu; Xinhua Zhang; Eric P. Xing; Dale Schuurmans (AISTATS, 2016)

Bi-directional Attention with Agreement for Dependency Parsing. - Hao Cheng 002; Hao Fang 002; Xiaodong He 001; Jianfeng Gao 001; Li Deng 001 (EMNLP, 2016)

Learning Latent Local Conversation Modes for Predicting Community Endorsement in Online Discussions. - Hao Fang 002; Hao Cheng 002; Mari Ostendorf (CoRR, 2016)

A Factored Neural Network Model for Characterizing Online Discussions in Vector Space. - Hao Cheng 002; Hao Fang 002; Mari Ostendorf (EMNLP, 2017)

Sounding Board: A User-Centric and Content-Driven Social Chatbot. - Hao Fang 002; Hao Cheng 002; Maarten Sap; Elizabeth Clark; Ari Holtzman; Yejin Choi 001; Noah A. Smith; Mari Ostendorf (NAACL-HLT (Demonstrations), 2018)

Improving Span-based Question Answering Systems with Coarsely Labeled Data. - Hao Cheng 002; Ming-Wei Chang; Kenton Lee; Ankur P. Parikh; Michael Collins 001; Kristina Toutanova (CoRR, 2018)

A Dynamic Speaker Model for Conversational Interactions. - Hao Cheng 002; Hao Fang 002; Mari Ostendorf (NAACL-HLT (1), 2019)

Probabilistic Assumptions Matter: Improved Models for Distantly-Supervised Document-Level Question Answering. - Hao Cheng 002; Ming-Wei Chang; Kenton Lee; Kristina Toutanova (ACL, 2020)

The Microsoft Toolkit of Multi-Task Deep Neural Networks for Natural Language Understanding. - Xiaodong Liu 003; Yu Wang 009; Jianshu Ji; Hao Cheng 002; Xueyun Zhu; Emmanuel Awa; Pengcheng He; Weizhu Chen; Hoifung Poon; Guihong Cao; Jianfeng Gao 001 (ACL (demo), 2020)

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned. - Sewon Min; Jordan L. Boyd-Graber; Chris Alberti; Danqi Chen 001; Eunsol Choi; Michael Collins 001; Kelvin Guu; Hannaneh Hajishirzi; Kenton Lee; Jennimaria Palomaki; Colin Raffel; Adam Roberts; et al. (NeurIPS (Competition and Demos), 2020)

Adversarial Training for Large Neural Language Models. - Xiaodong Liu 003; Hao Cheng 002; Pengcheng He; Weizhu Chen; Yu Wang 009; Hoifung Poon; Jianfeng Gao 001 (CoRR, 2020)

UnitedQA: A Hybrid Approach for Open Domain Question Answering. - Hao Cheng 002; Yelong Shen; Xiaodong Liu 003; Pengcheng He; Weizhu Chen; Jianfeng Gao 001 (ACL/IJCNLP (1), 2021)

Dialogue State Tracking with a Language Model using Schema-Driven Prompting. - Chia-Hsuan Lee 001; Hao Cheng 002; Mari Ostendorf (EMNLP (1), 2021)

Domain-Specific Pretraining for Vertical Search: Case Study on Biomedical Literature. - Yu Wang 009; Jinchao Li; Tristan Naumann; Chenyan Xiong; Hao Cheng 002; Robert Tinn; Cliff Wong; Naoto Usuyama; Richard Rogahn; Zhihong Shen; Yang Qin; Eric Horvitz; et al. (KDD, 2021)

Posterior Differential Regularization with f-divergence for Improving Model Robustness. - Hao Cheng 002; Xiaodong Liu 003; Lis Pereira; Yaoliang Yu; Jianfeng Gao 001 (NAACL-HLT, 2021)

Targeted Adversarial Training for Natural Language Understanding. - Lis Pereira; Xiaodong Liu 003; Hao Cheng 002; Hoifung Poon; Jianfeng Gao 001; Ichiro Kobayashi (NAACL-HLT, 2021)

Few-Shot Learning Evaluation in Natural Language Understanding. - Subhabrata Mukherjee; Xiaodong Liu 003; Guoqing Zheng; Saghar Hosseini; Hao Cheng 002; Ge Yang; Christopher Meek; Ahmed Hassan Awadallah; Jianfeng Gao 001 (NeurIPS Datasets and Benchmarks, 2021)

Open Domain Question Answering over Virtual Documents: A Unified Approach for Data and Text. - Kaixin Ma; Hao Cheng 002; Xiaodong Liu 003; Eric Nyberg; Jianfeng Gao 001 (CoRR, 2021)

CLUES: Few-Shot Learning Evaluation in Natural Language Understanding. - Subhabrata Mukherjee; Xiaodong Liu 003; Guoqing Zheng; Saghar Hosseini; Hao Cheng 002; Greg Yang; Christopher Meek; Ahmed Hassan Awadallah; Jianfeng Gao 001 (CoRR, 2021)

Knowledge-Rich Self-Supervised Entity Linking. - Sheng Zhang 012; Hao Cheng 002; Shikhar Vashishth; Cliff Wong; Jinfeng Xiao; Xiaodong Liu 003; Tristan Naumann; Jianfeng Gao 001; Hoifung Poon (CoRR, 2021)

Open Domain Question Answering with A Unified Knowledge Interface. - Kaixin Ma; Hao Cheng 002; Xiaodong Liu 003; Eric Nyberg; Jianfeng Gao 001 (ACL (1), 2022)

Knowledge-Rich Self-Supervision for Biomedical Entity Linking. - Sheng Zhang 012; Hao Cheng 002; Shikhar Vashishth; Cliff Wong; Jinfeng Xiao; Xiaodong Liu 003; Tristan Naumann; Jianfeng Gao 001; Hoifung Poon (EMNLP (Findings), 2022)

Unsupervised Learning of Hierarchical Conversation Structure. - Bo-Ru Lu; Yushi Hu; Hao Cheng 002; Noah A. Smith; Mari Ostendorf (EMNLP (Findings), 2022)

Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge. - Kaixin Ma; Hao Cheng 002; Xiaodong Liu 003; Eric Nyberg; Jianfeng Gao 001 (EMNLP (Findings), 2022)

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. - Yichong Xu; Chenguang Zhu 001; Shuohang Wang; Siqi Sun; Hao Cheng 002; Xiaodong Liu 003; Jianfeng Gao 001; Pengcheng He; Michael Zeng 001; Xuedong Huang 001 (IJCAI, 2022)

A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models. - Da Yin; Li Dong 004; Hao Cheng 002; Xiaodong Liu 003; Kai-Wei Chang; Furu Wei; Jianfeng Gao 001 (CoRR, 2022)

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing. - Yu Gu 017; Robert Tinn; Hao Cheng 002; Michael Lucas; Naoto Usuyama; Xiaodong Liu 003; Tristan Naumann; Jianfeng Gao 001; Hoifung Poon (ACM Trans. Comput. Heal., 2022)

Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering. - Hao Cheng 002; Hao Fang 002; Xiaodong Liu 003; Jianfeng Gao 001 (ACL (2), 2023)

Chain-of-Skills: A Configurable Model for Open-Domain Question Answering. - Kaixin Ma; Hao Cheng 002; Yu Zhang 044; Xiaodong Liu 002; Eric Nyberg; Jianfeng Gao 001 (ACL (1), 2023)

Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding. - Yu Zhang 044; Hao Cheng 002; Zhihong Shen; Xiaodong Liu 003; Ye-Yi Wang; Jianfeng Gao 001 (EMNLP (Findings), 2023)

Optimizing Bi-Encoder for Named Entity Recognition via Contrastive Learning. - Sheng Zhang 012; Hao Cheng 002; Jianfeng Gao 001; Hoifung Poon (ICLR, 2023)

Visually-Augmented Language Modeling. - Weizhi Wang; Li Dong 004; Hao Cheng 002; Haoyu Song 002; Xiaodong Liu 003; Xifeng Yan; Jianfeng Gao 001; Furu Wei (ICLR, 2023)

Understand and Modularize Generator Optimization in ELECTRA-style Pretraining. - Chengyu Dong; Liyuan Liu; Hao Cheng 002; Jingbo Shang; Jianfeng Gao 001; Xiaodong Liu 003 (ICML, 2023)

Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models. - Pan Lu; Baolin Peng; Hao Cheng 002; Michel Galley; Kai-Wei Chang; Ying Nian Wu; Song-Chun Zhu; Jianfeng Gao 001 (NeurIPS, 2023)

Augmenting Language Models with Long-Term Memory. - Weizhi Wang; Li Dong 004; Hao Cheng 002; Xiaodong Liu 003; Xifeng Yan; Jianfeng Gao 001; Furu Wei (NeurIPS, 2023)

Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated Feedback. - Baolin Peng; Michel Galley; Pengcheng He; Hao Cheng 002; Yujia Xie; Yu Hu; Qiuyuan Huang; Lars Liden; Zhou Yu 005; Weizhu Chen; Jianfeng Gao 001 (CoRR, 2023)

Pre-training Transformers for Knowledge Graph Completion. - Sanxing Chen; Hao Cheng 002; Xiaodong Liu 003; Jian Jiao 007; Yangfeng Ji; Jianfeng Gao 001 (CoRR, 2023)

Chain-of-Skills: A Configurable Model for Open-domain Question Answering. - Kaixin Ma; Hao Cheng 002; Yu Zhang 044; Xiaodong Liu 003; Eric Nyberg; Jianfeng Gao 001 (CoRR, 2023)

Self-Verification Improves Few-Shot Clinical Information Extraction. - Zelalem Gero; Chandan Singh; Hao Cheng 002; Tristan Naumann; Michel Galley; Jianfeng Gao 001; Hoifung Poon (CoRR, 2023)

DIALGEN: Collaborative Human-LM Generated Dialogues for Improved Understanding of Human-Human Conversations. - Bo-Ru Lu; Nikita Haduong; Chia-Hsuan Lee 001; Zeqiu Wu; Hao Cheng 002; Paul Koester; Jean Utke; Tao Yu 009; Noah A. Smith; Mari Ostendorf (CoRR, 2023)

MathVista: Evaluating Math Reasoning in Visual Contexts with GPT-4V, Bard, and Other Large Multimodal Models. - Pan Lu; Hritik Bansal; Tony Xia; Jiacheng Liu 010; Chunyuan Li; Hannaneh Hajishirzi; Hao Cheng 002; Kai-Wei Chang; Michel Galley; Jianfeng Gao 001 (CoRR, 2023)

Automatic Hallucination Assessment for Aligned Large Language Models via Transferable Adversarial Attacks. - Xiaodong Yu 003; Hao Cheng 002; Xiaodong Liu 003; Dan Roth 001; Jianfeng Gao 001 (CoRR, 2023)

Enhancing Medical Text Evaluation with GPT-4. - Yiqing Xie; Sheng Zhang 012; Hao Cheng 002; Zelalem Gero; Cliff Wong; Tristan Naumann; Hoifung Poon (CoRR, 2023)

InSCIt: Information-Seeking Conversations with Mixed-Initiative Interactions. - Zeqiu Wu; Ryu Parish; Hao Cheng 002; Sewon Min; Prithviraj Ammanabrolu; Mari Ostendorf; Hannaneh Hajishirzi (Trans. Assoc. Comput. Linguistics, 2023)

Fine-tuning large neural language models for biomedical natural language processing. - Robert Tinn; Hao Cheng 002; Yu Gu 017; Naoto Usuyama; Xiaodong Liu 003; Tristan Naumann; Jianfeng Gao 001; Hoifung Poon (Patterns, 2023)

DocLens: Multi-aspect Fine-grained Medical Text Evaluation. - Yiqing Xie; Sheng Zhang 012; Hao Cheng 002; Pengfei Liu; Zelalem Gero; Cliff Wong; Tristan Naumann; Hoifung Poon; Carolyn P. Rosé (ACL (1), 2024)

Language Models as Inductive Reasoners. - Zonglin Yang 001; Li Dong 004; Xinya Du; Hao Cheng 002; Erik Cambria; Xiaodong Liu 003; Jianfeng Gao 001; Furu Wei (EACL (1), 2024)

LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents. - Shilong Liu; Hao Cheng 002; Haotian Liu; Hao Zhang 097; Feng Li 040; Tianhe Ren; Xueyan Zou; Jianwei Yang; Hang Su 006; Jun Zhu 001; Lei Zhang 001; Jianfeng Gao 001; et al. (ECCV (47), 2024)

Fast-ELECTRA for Efficient Pre-training. - Chengyu Dong; Liyuan Liu; Hao Cheng 002; Jingbo Shang; Jianfeng Gao 001; Xiaodong Liu 003 (ICLR, 2024)

MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts. - Pan Lu; Hritik Bansal; Tony Xia; Jiacheng Liu 010; Chunyuan Li; Hannaneh Hajishirzi; Hao Cheng 002; Kai-Wei Chang; Michel Galley; Jianfeng Gao 001 (ICLR, 2024)

OrchestraLLM: Efficient Orchestration of Language Models for Dialogue State Tracking. - Chia-Hsuan Lee 001; Hao Cheng 002; Mari Ostendorf (NAACL-HLT, 2024)

ReEval: Automatic Hallucination Evaluation for Retrieval-Augmented Large Language Models via Transferable Adversarial Attacks. - Xiaodong Yu 003; Hao Cheng 002; Xiaodong Liu 003; Dan Roth 001; Jianfeng Gao 001 (NAACL-HLT (Findings), 2024)

Encode Once and Decode in Parallel: Efficient Transformer Decoding. - Bo-Ru Lu; Nikita Haduong; Chien-Yu Lin; Hao Cheng 002; Noah A. Smith; Mari Ostendorf (CoRR, 2024)

Model Tells Itself Where to Attend: Faithfulness Meets Automatic Attention Steering. - Qingru Zhang; Xiaodong Yu 003; Chandan Singh; Xiaodong Liu 003; Liyuan Liu; Jianfeng Gao 001; Tuo Zhao; Dan Roth 001; Hao Cheng 002 (CoRR, 2024)

GRIN: GRadient-INformed MoE. - Liyuan Liu; Young Jin Kim 001; Shuohang Wang; Chen Liang 006; Yelong Shen; Hao Cheng 002; Xiaodong Liu 003; Masahiro Tanaka; Xiaoxia Wu; Wenxiang Hu; Vishrav Chaudhary; Zeqi Lin; et al. (CoRR, 2024)

CorrectionLM: Self-Corrections with SLM for Dialogue State Tracking. - Chia-Hsuan Lee 001; Hao Cheng 002; Mari Ostendorf (CoRR, 2024)

ReasonAgain: Using Extractable Symbolic Programs to Evaluate Mathematical Reasoning. - Xiaodong Yu 003; Ben Zhou; Hao Cheng 002; Dan Roth 001 (CoRR, 2024)

Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts. - Zeliang Zhang; Xiaodong Liu 003; Hao Cheng 002; Chenliang Xu; Jianfeng Gao 001 (ACL (Findings), 2025)

ExACT: Teaching AI Agents to Explore with Reflective-MCTS and Exploratory Learning. - Xiao Yu 011; Baolin Peng; Vineeth Vajipey; Hao Cheng 002; Michel Galley; Jianfeng Gao 001; Zhou Yu 005 (ICLR, 2025)

Generative Adapter: Contextualizing Language Models in Parameters with A Single Forward Pass. - Tong Chen; Hao Fang 002; Patrick Xia 002; Xiaodong Liu 003; Benjamin Van Durme; Luke Zettlemoyer; Jianfeng Gao 001; Hao Cheng 002 (ICLR, 2025)

SeCom: On Memory Construction and Retrieval for Personalized Conversational Agents. - Zhuoshi Pan; Qianhui Wu; Huiqiang Jiang; Xufang Luo; Hao Cheng 002; Dongsheng Li 002; Yuqing Yang 001; Chin-Yew Lin; H. Vicky Zhao; Lili Qiu; Jianfeng Gao 001 (ICLR, 2025)

Iterative Self-Tuning LLMs for Enhanced Jailbreaking Capabilities. - Chung-En Sun; Xiaodong Liu 003; Weiwei Yang; Tsui-Wei Weng; Hao Cheng 002; Aidan San; Michel Galley; Jianfeng Gao 001 (NAACL (Long Papers), 2025)

CollabLLM: From Passive Responders to Active Collaborators. - Shirley Wu; Michel Galley; Baolin Peng; Hao Cheng 002; Gavin Li; Yao Dou; Weixin Cai; James Zou 001; Jure Leskovec; Jianfeng Gao 001 (CoRR, 2025)

On Memory Construction and Retrieval for Personalized Conversational Agents. - Zhuoshi Pan; Qianhui Wu; Huiqiang Jiang; Xufang Luo; Hao Cheng 002; Dongsheng Li 002; Yuqing Yang 001; Chin-Yew Lin; H. Vicky Zhao; Lili Qiu; Jianfeng Gao 001 (CoRR, 2025)

Reinforcement Learning for Reasoning in Large Language Models with One Training Example. - Yiping Wang; Qing Yang; Zhiyuan Zeng; Liliang Ren; Lucas Liu; Baolin Peng; Hao Cheng 002; Xuehai He; Kuan Wang; Jianfeng Gao 001; Weizhu Chen; Shuohang Wang; et al. (CoRR, 2025)

Dyna-Think: Synergizing Reasoning, Acting, and World Model Simulation in AI Agents. - Xiao Yu 011; Baolin Peng; Ruize Xu; Michel Galley; Hao Cheng 002; Suman Nath; Jianfeng Gao 001; Zhou Yu 005 (CoRR, 2025)

Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation. - Liliang Ren; Congcong Chen; Haoran Xu; Young Jin Kim 001; Adam Atkinson; Zheng Zhan 004; Jiankai Sun; Baolin Peng; Liyuan Liu; Shuohang Wang; Hao Cheng 002; Jianfeng Gao 001; et al. (CoRR, 2025)

SAS: Simulated Attention Score. - Chuanyang Zheng; Jiankai Sun; Yihang Gao; Yuehao Wang; Peihao Wang; Jing Xiong; Liliang Ren; Hao Cheng 002; Janardhan Kulkarni; Yelong Shen; Atlas Wang; Mac Schwager; et al. (CoRR, 2025)