Learning Natural Language Inference with LSTM. - Shuohang Wang; Jing Jiang 001 (HLT-NAACL, 2016)

A Compare-Aggregate Model for Matching Text Sequences. - Shuohang Wang; Jing Jiang 001 (ICLR (Poster), 2017)

Machine Comprehension Using Match-LSTM and Answer Pointer. - Shuohang Wang; Jing Jiang 001 (ICLR (Poster), 2017)

R3: Reinforced Reader-Ranker for Open-Domain Question Answering. - Shuohang Wang; Mo Yu; Xiaoxiao Guo; Zhiguo Wang; Tim Klinger; Wei Zhang 057; Shiyu Chang; Gerald Tesauro; Bowen Zhou 002; Jing Jiang 001 (CoRR, 2017)

R3: Reinforced Ranker-Reader for Open-Domain Question Answering. - Shuohang Wang; Mo Yu; Xiaoxiao Guo; Zhiguo Wang; Tim Klinger; Wei Zhang 057; Shiyu Chang; Gerry Tesauro; Bowen Zhou 002; Jing Jiang 001 (AAAI, 2018)

A Co-Matching Model for Multi-choice Reading Comprehension. - Shuohang Wang; Mo Yu; Jing Jiang 001; Shiyu Chang (ACL (2), 2018)

Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering. - Shuohang Wang; Mo Yu; Jing Jiang 001; Wei Zhang 057; Xiaoxiao Guo; Shiyu Chang; Zhiguo Wang; Tim Klinger; Gerald Tesauro; Murray Campbell (ICLR (Poster), 2018)

Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives. - Yi Tay; Shuohang Wang; Anh Tuan Luu; Jie Fu 001; Minh C. Phan; Xingdi Yuan; Jinfeng Rao; Siu Cheung Hui; Aston Zhang (ACL (1), 2019)

Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks. - Yi Tay; Aston Zhang; Anh Tuan Luu; Jinfeng Rao; Shuai Zhang 007; Shuohang Wang; Jie Fu 001; Siu Cheung Hui (ACL (1), 2019)

Multi-hop Knowledge Base Question Answering with an Iterative Sequence Matching Model. - Yunshi Lan; Shuohang Wang; Jing Jiang 001 (ICDM, 2019)

Knowledge Base Question Answering with Topic Units. - Yunshi Lan; Shuohang Wang; Jing Jiang 001 (IJCAI, 2019)

Unsupervised Deep Structured Semantic Models for Commonsense Reasoning. - Shuohang Wang; Sheng Zhang 012; Yelong Shen; Xiaodong Liu 003; Jingjing Liu 001; Jianfeng Gao 001; Jing Jiang 001 (NAACL-HLT (1), 2019)

Compositional De-Attention Networks. - Yi Tay; Anh Tuan Luu; Aston Zhang; Shuohang Wang; Siu Cheung Hui (NeurIPS, 2019)

What does BERT Learn from Multiple-Choice Reading Comprehension Datasets? - Chenglei Si; Shuohang Wang; Min-Yen Kan; Jing Jiang 001 (CoRR, 2019)

Knowledge Base Question Answering With a Matching-Aggregation Model and Question-Specific Contextual Relations. - Yunshi Lan; Shuohang Wang; Jing Jiang 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2019)

Multi-Level Head-Wise Match and Aggregation in Transformer for Textual Sequence Matching. - Shuohang Wang; Yunshi Lan; Yi Tay; Jing Jiang 001; Jingjing Liu 001 (AAAI, 2020)

Multi-Fact Correction in Abstractive Text Summarization. - Yue Dong 002; Shuohang Wang; Zhe Gan; Yu Cheng 001; Jackie Chi Kit Cheung; Jingjing Liu 001 (EMNLP (1), 2020)

Hierarchical Graph Network for Multi-hop Question Answering. - Yuwei Fang; Siqi Sun; Zhe Gan; Rohit Pillai; Shuohang Wang; Jingjing Liu 001 (EMNLP (1), 2020)

Contrastive Distillation on Intermediate Representations for Language Model Compression. - Siqi Sun; Zhe Gan; Yuwei Fang; Yu Cheng 001; Shuohang Wang; Jingjing Liu 001 (EMNLP (1), 2020)

Cross-Thought for Sentence Encoder Pre-training. - Shuohang Wang; Yuwei Fang; Siqi Sun; Zhe Gan; Yu Cheng 001; Jingjing Liu 001; Jing Jiang 001 (EMNLP (1), 2020)

T3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack. - Boxin Wang; Hengzhi Pei; Boyuan Pan; Qian Chen 003; Shuohang Wang; Bo Li 026 (EMNLP (1), 2020)

Accelerating Real-Time Question Answering via Question Generation. - Yuwei Fang; Shuohang Wang; Zhe Gan; Siqi Sun; Jingjing Liu 001 (CoRR, 2020)

Cluster-Former: Clustering-based Sparse Transformer for Long-Range Dependency Encoding. - Shuohang Wang; Luowei Zhou; Zhe Gan; Yen-Chun Chen 001; Yuwei Fang; Siqi Sun; Yu Cheng 001; Jingjing Liu 001 (CoRR, 2020)

Counterfactual Variable Control for Robust and Interpretable Question Answering. - Sicheng Yu; Yulei Niu; Shuohang Wang; Jing Jiang 001; Qianru Sun (CoRR, 2020)

FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding. - Yuwei Fang; Shuohang Wang; Zhe Gan; Siqi Sun; Jingjing Liu 001 (AAAI, 2021)

EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets. - Xiaohan Chen; Yu Cheng 001; Shuohang Wang; Zhe Gan; Zhangyang Wang; Jingjing Liu 001 (ACL/IJCNLP (1), 2021)

Cluster-Former: Clustering-based Sparse Transformer for Question Answering. - Shuohang Wang; Luowei Zhou; Zhe Gan; Yen-Chun Chen 001; Yuwei Fang; Siqi Sun; Yu Cheng 001; Jingjing Liu 001 (ACL/IJCNLP (Findings), 2021)

On Orthogonality Constraints for Transformers. - Aston Zhang; Alvin Chan; Yi Tay; Jie Fu 001; Shuohang Wang; Shuai Zhang 007; Huajie Shao; Shuochao Yao; Roy Ka-Wei Lee (ACL/IJCNLP (2), 2021)

UC2: Universal Cross-Lingual Cross-Modal Vision-and-Language Pre-Training. - Mingyang Zhou 004; Luowei Zhou; Shuohang Wang; Yu Cheng 001; Linjie Li; Zhou Yu 005; Jingjing Liu 001 (CVPR, 2021)

Want To Reduce Labeling Cost? GPT-3 Can Help. - Shuohang Wang; Yang Liu 124; Yichong Xu; Chenguang Zhu 001; Michael Zeng 001 (EMNLP (Findings), 2021)

NOAHQA: Numerical Reasoning with Interpretable Graph Question Answering Dataset. - Qiyuan Zhang; Lei Wang 185; Sicheng Yu; Shuohang Wang; Yang Wang 015; Jing Jiang 001; Ee-Peng Lim (EMNLP (Findings), 2021)

InfoBERT: Improving Robustness of Language Models from An Information Theoretic Perspective. - Boxin Wang; Shuohang Wang; Yu Cheng 001; Zhe Gan; Ruoxi Jia 001; Bo Li 026; Jingjing Liu 001 (ICLR, 2021)

LightningDOT: Pre-training Visual-Semantic Embeddings for Real-Time Image-Text Retrieval. - Siqi Sun; Yen-Chun Chen 001; Linjie Li; Shuohang Wang; Yuwei Fang; Jingjing Liu 001 (NAACL-HLT, 2021)

The Elastic Lottery Ticket Hypothesis. - Xiaohan Chen; Yu Cheng 001; Shuohang Wang; Zhe Gan; Jingjing Liu 001; Zhangyang Wang (NeurIPS, 2021)

Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models. - Boxin Wang; Chejian Xu; Shuohang Wang; Zhe Gan; Yu Cheng 001; Jianfeng Gao 001; Ahmed Hassan Awadallah; Bo Li 026 (NeurIPS Datasets and Benchmarks, 2021)

Playing Lottery Tickets with Vision and Language. - Zhe Gan; Yen-Chun Chen 001; Linjie Li; Tianlong Chen 001; Yu Cheng 001; Shuohang Wang; Jingjing Liu 001 (CoRR, 2021)

MLP Architectures for Vision-and-Language Modeling: An Empirical Study. - Yixin Nie; Linjie Li; Zhe Gan; Shuohang Wang; Chenguang Zhu 001; Michael Zeng 001; Zicheng Liu 001; Mohit Bansal; Lijuan Wang (CoRR, 2021)

Playing Lottery Tickets with Vision and Language. - Zhe Gan; Yen-Chun Chen 001; Linjie Li; Tianlong Chen 001; Yu Cheng 001; Shuohang Wang; Jingjing Liu 001; Lijuan Wang; Zicheng Liu 001 (AAAI, 2022)

Dict-BERT: Enhancing Language Model Pre-training with Dictionary. - Wenhao Yu 002; Chenguang Zhu 001; Yuwei Fang; Donghan Yu; Shuohang Wang; Yichong Xu; Michael Zeng 001; Meng Jiang 001 (ACL (Findings), 2022)

Leveraging Knowledge in Multilingual Commonsense Reasoning. - Yuwei Fang; Shuohang Wang; Yichong Xu; Ruochen Xu; Siqi Sun; Chenguang Zhu 001; Michael Zeng 001 (ACL (Findings), 2022)

Training Data is More Valuable than You Think: A Simple and Effective Method by Retrieving from Training Data. - Shuohang Wang; Yichong Xu; Yuwei Fang; Yang Liu 124; Siqi Sun; Ruochen Xu; Chenguang Zhu 001; Michael Zeng 001 (ACL (1), 2022)

KG-FiD: Infusing Knowledge Graph in Fusion-in-Decoder for Open-Domain Question Answering. - Donghan Yu; Chenguang Zhu 001; Yuwei Fang; Wenhao Yu 002; Shuohang Wang; Yichong Xu; Xiang Ren 001; Yiming Yang; Michael Zeng 001 (ACL (1), 2022)

An Empirical Study of Training End-to-End Vision-and-Language Transformers. - Zi-Yi Dou; Yichong Xu; Zhe Gan; Jianfeng Wang; Shuohang Wang; Lijuan Wang; Chenguang Zhu 001; Pengchuan Zhang; Lu Yuan; Nanyun Peng 001; Zicheng Liu 001; Michael Zeng 001 (CVPR, 2022)

CLIP-Event: Connecting Text and Images with Event Structures. - Manling Li; Ruochen Xu; Shuohang Wang; Luowei Zhou; Xudong Lin 003; Chenguang Zhu 001; Michael Zeng 001; Heng Ji 001; Shih-Fu Chang (CVPR, 2022)

AdaPrompt: Adaptive Model Training for Prompt-based NLP. - Yulong Chen 001; Yang Liu 124; Li Dong; Shuohang Wang; Chenguang Zhu 001; Michael Zeng 001; Yue Zhang 004 (EMNLP (Findings), 2022)

Task Compass: Scaling Multi-task Pre-training with Task Prefix. - Zhuosheng Zhang 001; Shuohang Wang; Yichong Xu; Yuwei Fang; Wenhao Yu 002; Yang Liu 124; Hai Zhao 001; Chenguang Zhu 001; Michael Zeng 001 (EMNLP (Findings), 2022)

Retrieval Augmentation for Commonsense Reasoning: A Unified Approach. - Wenhao Yu 002; Chenguang Zhu 001; Zhihan Zhang 001; Shuohang Wang; Zhuosheng Zhang 001; Yuwei Fang; Meng Jiang 001 (EMNLP, 2022)

Empowering Language Models with Knowledge Graph Reasoning for Open-Domain Question Answering. - Ziniu Hu; Yichong Xu; Wenhao Yu 002; Shuohang Wang; Ziyi Yang; Chenguang Zhu 001; Kai-Wei Chang; Yizhou Sun (EMNLP, 2022)

ParaTag: A Dataset of Paraphrase Tagging for Fine-Grained Labels, NLG Evaluation, and Data Augmentation. - Shuohang Wang; Ruochen Xu; Yang Liu 124; Chenguang Zhu 001; Michael Zeng 001 (EMNLP, 2022)

Human Parity on CommonsenseQA: Augmenting Self-Attention with External Attention. - Yichong Xu; Chenguang Zhu 001; Shuohang Wang; Siqi Sun; Hao Cheng 002; Xiaodong Liu 003; Jianfeng Gao 001; Pengcheng He; Michael Zeng 001; Xuedong Huang 001 (IJCAI, 2022)

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners. - Zhenhailong Wang; Manling Li; Ruochen Xu; Luowei Zhou; Jie Lei 003; Xudong Lin 003; Shuohang Wang; Ziyi Yang; Chenguang Zhu 001; Derek Hoiem; Shih-Fu Chang; Mohit Bansal; et al. (NeurIPS, 2022)

Empowering Language Models with Knowledge Graph Reasoning for Question Answering. - Ziniu Hu; Yichong Xu; Wenhao Yu 002; Shuohang Wang; Ziyi Yang; Chenguang Zhu 001; Kai-Wei Chang; Yizhou Sun (CoRR, 2022)

APOLLO: A Simple Approach for Adaptive Pretraining of Language Models for Logical Reasoning. - Soumya Sanyal 001; Yichong Xu; Shuohang Wang; Ziyi Yang; Reid Pryzant; Wenhao Yu 002; Chenguang Zhu 001; Xiang Ren 001 (ACL (1), 2023)

In-Context Demonstration Selection with Cross Entropy Difference. - Dan Iter; Reid Pryzant; Ruochen Xu; Shuohang Wang; Yang Liu; Yichong Xu; Chenguang Zhu 001 (EMNLP (Findings), 2023)

G-Eval: NLG Evaluation using Gpt-4 with Better Human Alignment. - Yang Liu; Dan Iter; Yichong Xu; Shuohang Wang; Ruochen Xu; Chenguang Zhu (EMNLP, 2023)

The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions. - Siru Ouyang; Shuohang Wang; Yang Liu; Ming Zhong 005; Yizhu Jiao; Dan Iter; Reid Pryzant; Chenguang Zhu 001; Heng Ji 001; Jiawei Han 001 (EMNLP, 2023)

LMGQS: A Large-scale Dataset for Query-focused Summarization. - Ruochen Xu; Song Wang 012; Yang Liu 124; Shuohang Wang; Yichong Xu; Dan Iter; Pengcheng He; Chenguang Zhu 001; Michael Zeng 001 (EMNLP (Findings), 2023)

InheritSumm: A General, Versatile and Compact Summarizer by Distilling from GPT. - Yichong Xu; Ruochen Xu; Dan Iter; Yang Liu 124; Shuohang Wang; Chenguang Zhu 001; Michael Zeng 001 (EMNLP (Findings), 2023)

Auto-Instruct: Automatic Instruction Generation and Ranking for Black-Box Language Models. - Zhihan Zhang 001; Shuohang Wang; Wenhao Yu 002; Yichong Xu; Dan Iter; Qingkai Zeng 001; Yang Liu 124; Chenguang Zhu 001; Meng Jiang 001 (EMNLP (Findings), 2023)

Generate rather than Retrieve: Large Language Models are Strong Context Generators. - Wenhao Yu 002; Dan Iter; Shuohang Wang; Yichong Xu; Mingxuan Ju; Soumya Sanyal 001; Chenguang Zhu 001; Michael Zeng 001; Meng Jiang 001 (ICLR, 2023)

Prompting GPT-3 To Be Reliable. - Chenglei Si; Zhe Gan; Zhengyuan Yang; Shuohang Wang; Jianfeng Wang; Jordan L. Boyd-Graber; Lijuan Wang (ICLR, 2023)

Sparse Modular Activation for Efficient Sequence Modeling. - Liliang Ren; Yang Liu; Shuohang Wang; Yichong Xu; Chenguang Zhu; ChengXiang Zhai (NeurIPS, 2023)

G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment. - Yang Liu 124; Dan Iter; Yichong Xu; Shuohang Wang; Ruochen Xu; Chenguang Zhu 001 (CoRR, 2023)

LMGQS: A Large-scale Dataset for Query-focused Summarization. - Ruochen Xu; Song Wang 012; Yang Liu 124; Shuohang Wang; Yichong Xu; Dan Iter; Chenguang Zhu 001; Michael Zeng 001 (CoRR, 2023)

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents. - Simeng Sun; Yang Liu 124; Shuohang Wang; Chenguang Zhu 001; Mohit Iyyer (CoRR, 2023)

The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions. - Siru Ouyang; Shuohang Wang; Yang Liu 124; Ming Zhong 005; Yizhu Jiao; Dan Iter; Reid Pryzant; Chenguang Zhu 001; Heng Ji 001; Jiawei Han 001 (CoRR, 2023)

Small Models are Valuable Plug-ins for Large Language Models. - Canwen Xu; Yichong Xu; Shuohang Wang; Yang Liu 124; Chenguang Zhu 001; Julian J. McAuley (ACL (Findings), 2024)

PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents. - Simeng Sun; Yang Liu 124; Shuohang Wang; Dan Iter; Chenguang Zhu 001; Mohit Iyyer (EACL (1), 2024)

SciAgent: Tool-augmented Language Models for Scientific Reasoning. - Yubo Ma; Zhibin Gou; Junheng Hao; Ruochen Xu; Shuohang Wang; Liangming Pan; Yujiu Yang; Yixin Cao 002; Aixin Sun (EMNLP, 2024)

Temperature-Centric Investigation of Speculative Decoding with Knowledge Distillation. - Siru Ouyang; Shuohang Wang; Minhao Jiang; Ming Zhong 005; Donghan Yu; Jiawei Han 001; Yelong Shen (EMNLP (Findings), 2024)

SciAgent: Tool-augmented Language Models for Scientific Reasoning. - Yubo Ma; Zhibin Gou; Junheng Hao; Ruochen Xu; Shuohang Wang; Liangming Pan; Yujiu Yang; Yixin Cao 002; Aixin Sun; Hany Hassan Awadalla; Weizhu Chen (CoRR, 2024)

Self-Exploring Language Models: Active Preference Elicitation for Online Alignment. - Shenao Zhang; Donghan Yu; Hiteshi Sharma; Ziyi Yang; Shuohang Wang; Hany Hassan; Zhaoran Wang 001 (CoRR, 2024)

Cost-Effective Proxy Reward Model Construction with On-Policy and Active Learning. - Yifang Chen 001; Shuohang Wang; Ziyi Yang; Hiteshi Sharma; Nikos Karampatziakis; Donghan Yu; Kevin G. Jamieson; Simon Shaolei Du; Yelong Shen (CoRR, 2024)

GRIN: GRadient-INformed MoE. - Liyuan Liu; Young Jin Kim 001; Shuohang Wang; Chen Liang 006; Yelong Shen; Hao Cheng 002; Xiaodong Liu 003; Masahiro Tanaka; Xiaoxia Wu; Wenxiang Hu; Vishrav Chaudhary; Zeqi Lin; et al. (CoRR, 2024)

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy. - Rongzhi Zhang; Kuang Wang; Liyuan Liu; Shuohang Wang; Hao Cheng; Chao Zhang; Yelong Shen (CoRR, 2024)

Mojito: Motion Trajectory and Intensity Control for Video Generation. - Xuehai He; Shuohang Wang; Jianwei Yang; Xiaoxia Wu; Yiping Wang; Kuan Wang; Zheng Zhan 004; Olatunji Ruwase; Yelong Shen; Xin Eric Wang (CoRR, 2024)

Multi-LoRA Composition for Image Generation. - Ming Zhong 005; Yelong Shen; Shuohang Wang; Yadong Lu; Yizhu Jiao; Siru Ouyang; Donghan Yu; Jiawei Han 001; Weizhu Chen (Trans. Mach. Learn. Res., 2024)

Knowledge-augmented Methods for Natural Language Processing - Meng Jiang 001; Bill Yuchen Lin; Shuohang Wang; Yichong Xu; Wenhao Yu 002; Chenguang Zhu 001 (Springer, 2024)

Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generation. - Yiping Wang; Xuehai He; Kuan Wang; Luyao Ma; Jianwei Yang; Shuohang Wang; Simon Shaolei Du; Yelong Shen (CVPR, 2025)

Self-Exploring Language Models: Active Preference Elicitation for Online Alignment. - Shenao Zhang; Donghan Yu; Hiteshi Sharma; Han Zhong 001; Zhihan Liu; Ziyi Yang; Shuohang Wang; Hany Hassan Awadalla; Zhaoran Wang 001 (Trans. Mach. Learn. Res., 2025)

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs. - Abdelrahman Abouelenin; Atabak Ashfaq; Adam Atkinson; Hany Awadalla; Nguyen Bach; Jianmin Bao; Alon Benhaim; Martin Cai; Vishrav Chaudhary; Congcong Chen; Dong Chen 003; Dongdong Chen 001; et al. (CoRR, 2025)

Reinforcement Learning for Reasoning in Large Language Models with One Training Example. - Yiping Wang; Qing Yang; Zhiyuan Zeng; Liliang Ren; Lucas Liu; Baolin Peng; Hao Cheng 002; Xuehai He; Kuan Wang; Jianfeng Gao 001; Weizhu Chen; Shuohang Wang; et al. (CoRR, 2025)

Phi-4-Mini-Reasoning: Exploring the Limits of Small Reasoning Language Models in Math. - Haoran Xu; Baolin Peng; Hany Awadalla; Dongdong Chen 001; Yen-Chun Chen 001; Mei Gao; Young Jin Kim 001; Yunsheng Li; Liliang Ren; Yelong Shen; Shuohang Wang; Weijian Xu; et al. (CoRR, 2025)

Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space. - Zhen Zhang; Xuehai He; Weixiang Yan; Ao Shen; Chenyang Zhao; Shuohang Wang; Yelong Shen; Xin Eric Wang (CoRR, 2025)

Routing Mamba: Scaling State Space Models with Mixture-of-Experts Projection. - Zheng Zhan 004; Liliang Ren; Shuohang Wang; Liyuan Liu; Yang Liu; Yeyun Gong; Yanzhi Wang; Yelong Shen (CoRR, 2025)

Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation. - Liliang Ren; Congcong Chen; Haoran Xu; Young Jin Kim 001; Adam Atkinson; Zheng Zhan 004; Jiankai Sun; Baolin Peng; Liyuan Liu; Shuohang Wang; Hao Cheng 002; Jianfeng Gao 001; et al. (CoRR, 2025)