Comparison of Different Methods for Handling Linkage Disequilibrium in Genetic-Association Analyses via Simulation. - Yongke Wang; Wenhui Wang 003; Yihui Luan (BMEI, 2009)

Usefulness and limitations of dK random graph models to predict interactions and functional homogeneity in biological networks under a pseudo-likelihood parameter estimation approach. - Wenhui Wang 003; Juan Nunez-Iglesias; Yihui Luan; Fengzhu Sun (BMC Bioinform., 2009)

Rare variant discovery and calling by sequencing pooled samples with overlaps. - Wenhui Wang 003; Xiaolin Yin; Yoon Soo Pyon; Matthew Hayes; Jing Li 002 (Bioinform., 2013)

Drug repositioning by integrating target information through a heterogeneous network model. - Wenhui Wang 003; Sen Yang; Xiang Zhang 001; Jing Li 002 (Bioinform., 2014)

Network tuned multiple rank aggregation and applications to gene ranking. - Wenhui Wang 003; Xianghong Jasmine Zhou; Zhenqiu Liu; Fengzhu Sun (BMC Bioinform., 2015)

Graph-based Dependency Parsing with Bidirectional LSTM. - Wenhui Wang 003; Baobao Chang (ACL (1), 2016)

Improved Graph-Based Dependency Parsing via Hierarchical LSTM Networks. - Wenhui Wang 003; Baobao Chang (CCL, 2016)

Gated Self-Matching Networks for Reading Comprehension and Question Answering. - Wenhui Wang 003; Nan Yang 002; Furu Wei; Baobao Chang; Ming Zhou 001 (ACL (1), 2017)

Improved Dependency Parsing using Implicit Word Connections Learned from Unlabeled Data. - Wenhui Wang 003; Baobao Chang; Mairgup Mansur (EMNLP, 2018)

Multiway Attention Networks for Modeling Sentence Pairs. - Chuanqi Tan; Furu Wei; Wenhui Wang 003; Weifeng Lv; Ming Zhou 001 (IJCAI, 2018)

Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension. - Hangbo Bao; Li Dong 004; Furu Wei; Wenhui Wang 003; Nan Yang 002; Lei Cui 001; Songhao Piao; Ming Zhou 001 (MRQA@EMNLP, 2019)

Learning to Ask Unanswerable Questions for Machine Reading Comprehension. - Haichao Zhu; Li Dong 004; Furu Wei; Wenhui Wang 003; Bing Qin 001; Ting Liu 001 (ACL (1), 2019)

Unified Language Model Pre-training for Natural Language Understanding and Generation. - Li Dong 004; Nan Yang 002; Wenhui Wang 003; Furu Wei; Xiaodong Liu 003; Yu Wang 009; Jianfeng Gao 001; Ming Zhou 001; Hsiao-Wuen Hon (NeurIPS, 2019)

Cross-Lingual Natural Language Generation via Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Wenhui Wang 003; Xian-Ling Mao; Heyan Huang (AAAI, 2020)

Harvesting and Refining Question-Answer Pairs for Unsupervised QA. - Zhongli Li; Wenhui Wang 003; Li Dong 004; Furu Wei; Ke Xu 001 (ACL, 2020)

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. - Hangbo Bao; Li Dong 004; Furu Wei; Wenhui Wang 003; Nan Yang 002; Xiaodong Liu 003; Yu Wang 009; Jianfeng Gao 001; Songhao Piao; Ming Zhou 001; Hsiao-Wuen Hon (ICML, 2020)

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. - Wenhui Wang 003; Furu Wei; Li Dong 004; Hangbo Bao; Nan Yang 002; Ming Zhou 001 (NeurIPS, 2020)

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. - Wenhui Wang 003; Hangbo Bao; Shaohan Huang; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. - Yunzhi Yao; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Consistency Regularization for Cross-Lingual Fine-Tuning. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (ACL/IJCNLP (1), 2021)

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Nan Yang 002; Saksham Singhal; Wenhui Wang 003; Xia Song; Xian-Ling Mao; Heyan Huang; Ming Zhou 001 (NAACL-HLT, 2021)

s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning. - Hangbo Bao; Li Dong 004; Wenhui Wang 003; Nan Yang 002; Furu Wei (CoRR, 2021)

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Furu Wei (CoRR, 2021)

Distilled Dual-Encoder Model for Vision-Language Understanding. - Zekun Wang 001; Wenhui Wang 003; Haichao Zhu; Ming Liu 004; Bing Qin 001; Furu Wei (EMNLP, 2022)

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. - Hangbo Bao; Wenhui Wang 003; Li Dong 004; Qiang Liu; Owais Khan Mohammed; Kriti Aggarwal; Subhojit Som; Songhao Piao; Furu Wei (NeurIPS, 2022)

Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models. - Dongkuan Xu; Subhabrata Mukherjee; Xiaodong Liu 003; Debadeepta Dey; Wenhui Wang 003; Xiang Zhang 001; Ahmed Hassan Awadallah; Jianfeng Gao 001 (NeurIPS, 2022)

AutoDistil: Few-shot Task-agnostic Neural Architecture Search for Distilling Large Language Models. - Dongkuan Xu; Subhabrata Mukherjee; Xiaodong Liu 003; Debadeepta Dey; Wenhui Wang 003; Xiang Zhang 001; Ahmed Hassan Awadallah; Jianfeng Gao 001 (CoRR, 2022)

VL-BEiT: Generative Vision-Language Pretraining. - Hangbo Bao; Wenhui Wang 003; Li Dong 004; Furu Wei (CoRR, 2022)

Language Models are General-Purpose Interfaces. - Yaru Hao; Haoyu Song 002; Li Dong 004; Shaohan Huang; Zewen Chi; Wenhui Wang 003; Shuming Ma; Furu Wei (CoRR, 2022)

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CoRR, 2022)

Foundation Transformers. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (CoRR, 2022)

TorchScale: Transformers at Scale. - Shuming Ma; Hongyu Wang 009; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Li Dong 004; Alon Benhaim; Barun Patra; Vishrav Chaudhary; Xia Song; Furu Wei (CoRR, 2022)

Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CVPR, 2023)

Magneto: A Foundation Transformer. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (ICML, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

Kosmos-2: Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Furu Wei (CoRR, 2023)

LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens. - Jiayu Ding; Shuming Ma; Li Dong 004; Xingxing Zhang 002; Shaohan Huang; Wenhui Wang 003; Nanning Zheng 001; Furu Wei (CoRR, 2023)

Kosmos-2.5: A Multimodal Literate Model. - Tengchao Lv; Yupan Huang; Jingye Chen; Lei Cui 001; Shuming Ma; Yaoyao Chang; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Weiyao Luo; Shaoxiang Wu; Guoxin Wang; et al. (CoRR, 2023)

When an Image is Worth 1, 024 x 1, 024 Words: A Case Study in Computational Pathology. - Wenhui Wang 003; Shuming Ma; Hanwen Xu; Naoto Usuyama; Jiayu Ding; Hoifung Poon; Furu Wei (CoRR, 2023)

Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Qixiang Ye; Furu Wei (ICLR, 2024)

KOSMOS-E : Learning to Follow Instruction for Robotic Grasping. - Zhi Wang; Xun Wu; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Shuming Ma; Furu Wei (IROS, 2024)

You Only Cache Once: Decoder-Decoder Architectures for Language Models. - Yutao Sun; Li Dong 004; Yi Zhu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Quanlu Zhang; Jianyong Wang 001; Furu Wei (NeurIPS, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Li Dong 004; Furu Wei (NeurIPS, 2024)

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. - Shuming Ma; Hongyu Wang 009; Lingxiao Ma; Lei Wang 222; Wenhui Wang 003; Shaohan Huang; Li Dong 004; Ruiping Wang; Jilong Xue; Furu Wei (CoRR, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Furu Wei (CoRR, 2024)

RedStone: Curating General, Code, Math, and QA Data for Large Language Models. - Yaoyao Chang; Lei Cui 001; Li Dong 004; Shaohan Huang; Yangyu Huang; Yupan Huang; Scarlett Li; Tengchao Lv; Shuming Ma; Qinzheng Sun; Wenhui Wang 003; Furu Wei; et al. (CoRR, 2024)

Multimodal Latent Language Modeling with Next-Token Diffusion. - Yutao Sun; Hangbo Bao; Wenhui Wang 003; Zhiliang Peng; Li Dong 004; Shaohan Huang; Jianyong Wang 001; Furu Wei (CoRR, 2024)

Fine-tuning pretrained transformer encoders for sequence-to-sequence learning. - Hangbo Bao; Li Dong 004; Wenhui Wang 003; Nan Yang 002; Songhao Piao; Furu Wei (Int. J. Mach. Learn. Cybern., 2024)