An Application of FIPA-ACL Based Agent Communication in Mobile-GPS System. - Furu Wei; Min Peng 002; Wei Zhang; Yanxiang He (ICWN, 2005)

A Novel Feature-based Approach to Chinese Entity Relation Extraction. - Wenjie Li 002; Peng Zhang 002; Furu Wei; Yuexian Hou; Qin Lu 001 (ACL (2), 2008)

PNR2: Ranking Sentences with Positive and Negative Reinforcement for Query-Oriented Update Summarization. - Wenjie Li 002; Furu Wei; Qin Lu 001; Yanxiang He (COLING, 2008)

A Cluster-Sensitive Graph Model for Query-Oriented Multi-document Summarization. - Furu Wei; Wenjie Li 002; Qin Lu 001; Yanxiang He (ECIR, 2008)

A Query-Sensitive Graph-Based Sentence Ranking Algorithm for Query-Oriented Multi-document Summarization. - Furu Wei; Yanxiang He; Wenjie Li 002; Qin Lu 001 (ISIP, 2008)

Exploiting the Role of Position Feature in Chinese Relation Extraction. - Peng Zhang 002; Wenjie Li 002; Furu Wei; Qin Lu 001; Yuexian Hou (LREC, 2008)

Exploiting the Role of Named Entities in Query-Oriented Document Summarization. - Wenjie Li 002; Furu Wei; Ouyang You; Qin Lu 001; Yanxiang He (PRICAI, 2008)

Query-sensitive mutual reinforcement chain and its application in query-oriented multi-document summarization. - Furu Wei; Wenjie Li 002; Qin Lu 001; Yanxiang He (SIGIR, 2008)

PolyU at TAC 2008. - Wenjie Li 002; Ouyang You; Yi Hu; Furu Wei (TAC, 2008)

Co-Feedback Ranking for Query-Focused Summarization. - Furu Wei; Wenjie Li 002; Yanxiang He (ACL/IJCNLP (2), 2009)

HyperSum: hypergraph based semi-supervised sentence ranking for query-oriented summarization. - Wei Wang 013; Furu Wei; Wenjie Li 002; Sujian Li (CIKM, 2009)

iRANK: an interactive ranking framework and its application in query-focused summarization. - Furu Wei; Wenjie Li 002; Wei Wang 013; Yanxiang He (CIKM, 2009)

Learning Similarity Functions in Graph-Based Document Summarization. - Ouyang You; Wenjie Li 002; Furu Wei; Qin Lu 001 (ICCPOL, 2009)

Query-Oriented Summarization Based on Neighborhood Graph Model. - Furu Wei; Yanxiang He; Wenjie Li 002; Lei Huang (ICCPOL, 2009)

Applying two-level reinforcement ranking in query-oriented multidocument summarization. - Furu Wei; Wenjie Li 002; Qin Lu 001; Yanxiang He (J. Assoc. Inf. Sci. Technol., 2009)

Constrained Coclustering for Textual Documents. - Yangqiu Song; Shimei Pan; Shixia Liu; Furu Wei; Michelle X. Zhou; Weihong Qian (AAAI, 2010)

Towards Building an Integrated Information Platform for Eco-city. - Xiaoxun Zhang; Ethan Zhang; Bin Song; Furu Wei (ICEBE, 2010)

VisWorks text and network visual analytics: VAST 2010 Mini Challenge 1 award: "Effective interactive visualization of document contents". - Lei Shi; Weihong Qian; Furu Wei; Li Tan (IEEE VAST, 2010)

Understanding text corpora with multiple facets. - Lei Shi 002; Furu Wei; Shixia Liu; Li Tan; Xiaoxiao Lian; Michelle X. Zhou (IEEE VAST, 2010)

Modeling Document Summarization as Multi-objective Optimization. - Lei Huang; Yanxiang He; Furu Wei; Wenjie Li 002 (IITSI, 2010)

TIARA: a visual exploratory text analytic system. - Furu Wei; Shixia Liu; Yangqiu Song; Shimei Pan; Michelle X. Zhou; Weihong Qian; Lei Shi 002; Li Tan; Qiang Zhang (KDD, 2010)

Context-Preserving, Dynamic Word Cloud Visualization. - Weiwei Cui 001; Yingcai Wu; Shixia Liu; Furu Wei; Michelle X. Zhou; Huamin Qu (IEEE Computer Graphics and Applications, 2010)

iRANK: A rank-learn-combine framework for unsupervised ensemble ranking. - Furu Wei; Wenjie Li 002; Shixia Liu (J. Assoc. Inf. Sci. Technol., 2010)

A document-sensitive graph model for multi-document summarization. - Furu Wei; Wenjie Li 002; Qin Lu 001; Yanxiang He (Knowl. Inf. Syst., 2010)

OpinionSeer: Interactive Visualization of Hotel Customer Feedback. - Yingcai Wu; Furu Wei; Shixia Liu; Norman Au; Weiwei Cui 001; Hong Zhou 004; Huamin Qu (IEEE Trans. Vis. Comput. Graph., 2010)

Recognizing Named Entities in Tweets. - Xiaohua Liu; Shaodian Zhang; Furu Wei; Ming Zhou 001 (ACL, 2011)

Topic sentiment analysis in twitter: a graph-based hashtag sentiment classification approach. - Xiaolong Wang; Furu Wei; Xiaohua Liu; Ming Zhou 001; Ming Zhang 004 (CIKM, 2011)

QuickView: advanced search of tweets. - Xiaohua Liu; Long Jiang; Furu Wei; Ming Zhou 001 (SIGIR, 2011)

Semantic-Preserving Word Clouds by Seam Carving. - Yingcai Wu; Thomas Provan; Furu Wei; Shixia Liu; Kwan-Liu Ma (Comput. Graph. Forum, 2011)

Document-Aware Graph Models for Query-Oriented Multi-document Summarization. - Furu Wei; Wenjie Li 002; Yanxiang He (Multimedia Analysis, Processing and Communications, 2011)

Collective Nominal Semantic Role Labeling for Tweets. - Xiaohua Liu; Zhongyang Fu; Furu Wei; Ming Zhou 001 (AAAI, 2012)

Exacting Social Events for Tweets Using a Factor Graph. - Xiaohua Liu; Xiangyang Zhou; Zhongyang Fu; Furu Wei; Ming Zhou 001 (AAAI, 2012)

QuickView: NLP-based Tweet Search. - Xiaohua Liu; Furu Wei; Ming Zhou 001 (ACL (System Demonstrations), 2012)

Joint Inference of Named Entity Recognition and Normalization for Tweets. - Xiaohua Liu; Ming Zhou 001; Xiangyang Zhou; Zhongyang Fu; Furu Wei (ACL (1), 2012)

Cross-Lingual Mixture Model for Sentiment Classification. - Xinfan Meng; Furu Wei; Xiaohua Liu; Ming Zhou 001; Ge Xu; Houfeng Wang (ACL (1), 2012)

Breaking news on twitter. - Mengdie Hu; Shixia Liu; Furu Wei; Yingcai Wu; John T. Stasko; Kwan-Liu Ma (CHI, 2012)

Graph-based collective classification for tweets. - Yajuan Duan; Furu Wei; Ming Zhou 001; Heung-Yeung Shum (CIKM, 2012)

Twitter Topic Summarization by Ranking Tweets using Social Influence and Content Quality. - Yajuan Duan; Zhimin Chen; Furu Wei; Ming Zhou 001; Heung-Yeung Shum (COLING, 2012)

Graph-Based Multi-Tweet Summarization using Social Signals. - Xiaohua Liu; Yitong Li; Furu Wei; Ming Zhou 001 (COLING, 2012)

Lost in Translations? Building Sentiment Lexicons using Context Based Machine Translation. - Xinfan Meng; Furu Wei; Ge Xu; Longkai Zhang; Xiaohua Liu; Ming Zhou 001; Houfeng Wang (COLING (Posters), 2012)

Entity-centric topic-oriented opinion summarization in twitter. - Xinfan Meng; Furu Wei; Xiaohua Liu; Ming Zhou 001; Sujian Li; Houfeng Wang (KDD, 2012)

The Automated Acquisition of Suggestions from Tweets. - Li Dong 004; Furu Wei; Yajuan Duan; Xiaohua Liu; Ming Zhou 001; Ke Xu 001 (AAAI, 2013)

Co-Training Based Bilingual Sentiment Lexicon Learning. - Dehong Gao; Furu Wei; Wenjie Li 002; Xiaohua Liu; Ming Zhou 001 (AAAI (Late-Breaking Developments), 2013)

Entity Linking for Tweets. - Xiaohua Liu; Yitong Li; Haocheng Wu; Ming Zhou 001; Furu Wei; Yi Lu (ACL (1), 2013)

Exploring hypergraph-based semi-supervised ranking for query-oriented summarization. - Wei Wang 013; Sujian Li; Jiwei Li; Wenjie Li 002; Furu Wei (Inf. Sci., 2013)

Named entity recognition for tweets. - Xiaohua Liu; Furu Wei; Shaodian Zhang; Ming Zhou 001 (ACM Trans. Intell. Syst. Technol., 2013)

Constrained Text Coclustering with Supervised and Unsupervised Constraints. - Yangqiu Song; Shimei Pan; Shixia Liu; Furu Wei; Michelle X. Zhou; Weihong Qian (IEEE Trans. Knowl. Data Eng., 2013)

Adaptive Multi-Compositionality for Recursive Neural Models with Applications to Sentiment Analysis. - Li Dong 004; Furu Wei; Ming Zhou 001; Ke Xu 001 (AAAI, 2014)

Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification. - Li Dong 004; Furu Wei; Chuanqi Tan; Duyu Tang; Ming Zhou 001; Ke Xu 001 (ACL (2), 2014)

Learning Sentiment-Specific Word Embedding for Twitter Sentiment Classification. - Duyu Tang; Furu Wei; Nan Yang 002; Ming Zhou 001; Ting Liu 001; Bing Qin 001 (ACL (1), 2014)

SocialTransfer: Transferring Social Knowledge for Cold-Start Cowdsourcing. - Zhou Zhao 001; James Cheng; Furu Wei; Ming Zhou 001; Wilfred Ng; Yingjun Wu (CIKM, 2014)

Building Large-Scale Twitter-Specific Sentiment Lexicon : A Representation Learning Approach. - Duyu Tang; Furu Wei; Bing Qin 001; Ming Zhou 001; Ting Liu 001 (COLING, 2014)

A Joint Segmentation and Classification Framework for Sentiment Analysis. - Duyu Tang; Furu Wei; Bing Qin 001; Li Dong 004; Ting Liu 001; Ming Zhou 001 (EMNLP, 2014)

Answer Extraction with Multiple Extraction Engines for Web-Based Question Answering. - Hong Sun; Furu Wei; Ming Zhou 001 (NLPCC, 2014)

Coooolll: A Deep Learning System for Twitter Sentiment Classification. - Duyu Tang; Furu Wei; Bing Qin 001; Ting Liu 001; Ming Zhou 001 (SemEval@COLING, 2014)

Ranking with Recursive Neural Networks and Its Application to Multi-Document Summarization. - Ziqiang Cao; Furu Wei; Li Dong 004; Sujian Li; Ming Zhou 001 (AAAI, 2015)

Learning Summary Prior Representation for Extractive Summarization. - Ziqiang Cao; Furu Wei; Sujian Li; Wenjie Li 002; Ming Zhou 001; Houfeng Wang (ACL (2), 2015)

Question Answering over Freebase with Multi-Column Convolutional Neural Networks. - Li Dong 004; Furu Wei; Ming Zhou 001; Ke Xu 001 (ACL (1), 2015)

A Dependency-Based Neural Network for Relation Classification. - Yang Liu 124; Furu Wei; Sujian Li; Heng Ji 001; Ming Zhou 001; Houfeng Wang (ACL (2), 2015)

Cold-Start Expert Finding in Community Question Answering via Graph Regularization. - Zhou Zhao 001; Furu Wei; Ming Zhou 001; Wilfred Ng (DASFAA (1), 2015)

Crowd-Selection Query Processing in Crowdsourcing Databases: A Task-Driven Approach. - Zhou Zhao 001; Furu Wei; Ming Zhou 001; Weikeng Chen; Wilfred Ng (EDBT, 2015)

A Hybrid Neural Model for Type Classification of Entity Mentions. - Li Dong 004; Furu Wei; Hong Sun; Ming Zhou 001; Ke Xu 001 (IJCAI, 2015)

Splusplus: A Feature-Rich Two-stage Classifier for Sentiment Analysis of Tweets. - Li Dong 004; Furu Wei; Yichun Yin; Ming Zhou 001; Ke Xu 001 (SemEval@NAACL-HLT, 2015)

A Statistical Parsing Framework for Sentiment Classification. - Li Dong 004; Furu Wei; Shujie Liu 001; Ming Zhou 001; Ke Xu 001 (Comput. Linguistics, 2015)

Cross-lingual Sentiment Lexicon Learning With Bilingual Word Graph Label Propagation. - Dehong Gao; Furu Wei; Wenjie Li 002; Xiaohua Liu; Ming Zhou 001 (Comput. Linguistics, 2015)

Multi-Document Summarization via Discriminative Summary Reranking. - Xiaojun Wan 001; Ziqiang Cao; Furu Wei; Sujian Li; Ming Zhou 001 (CoRR, 2015)

A Joint Segmentation and Classification Framework for Sentence Level Sentiment Classification. - Duyu Tang; Bing Qin 001; Furu Wei; Li Dong 004; Ting Liu 001; Ming Zhou 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2015)

TGSum: Build Tweet Guided Multi-Document Summarization Dataset. - Ziqiang Cao; Chengyao Chen; Wenjie Li 002; Sujian Li; Furu Wei; Ming Zhou 001 (AAAI, 2016)

AttSum: Joint Learning of Focusing and Summarization with Neural Attention. - Ziqiang Cao; Wenjie Li 002; Sujian Li; Furu Wei; Yanran Li (COLING, 2016)

A Redundancy-Aware Sentence Regression Framework for Extractive Summarization. - Pengjie Ren; Furu Wei; Zhumin Chen; Jun Ma 001; Ming Zhou 001 (COLING, 2016)

Solving and Generating Chinese Character Riddles. - Chuanqi Tan; Furu Wei; Li Dong 004; Weifeng Lv; Ming Zhou 001 (EMNLP, 2016)

Unsupervised Word and Dependency Path Embeddings for Aspect Term Extraction. - Yichun Yin; Furu Wei; Li Dong 004; Kaimeng Xu; Ming Zhang 004; Ming Zhou 001 (IJCAI, 2016)

AttSum: Joint Learning of Focusing and Summarization with Neural Attention. - Ziqiang Cao; Wenjie Li 002; Sujian Li; Furu Wei (CoRR, 2016)

Adaptive Multi-Compositionality for Recursive Neural Network Models. - Li Dong 004; Furu Wei; Ke Xu 001; Shixia Liu; Ming Zhou 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2016)

Relation Classification Via Modeling Augmented Dependency Paths. - Yang Liu 124; Sujian Li; Furu Wei; Heng Ji 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2016)

Sentiment Embeddings with Applications to Sentiment Analysis. - Duyu Tang; Furu Wei; Bing Qin 001; Nan Yang 002; Ting Liu 001; Ming Zhou 001 (IEEE Trans. Knowl. Data Eng., 2016)

An Uncertainty-Aware Approach for Exploratory Microblog Retrieval. - Mengchen Liu; Shixia Liu; Xizhou Zhu; Qinying Liao; Furu Wei; Shimei Pan (IEEE Trans. Vis. Comput. Graph., 2016)

Improving Multi-Document Summarization via Text Classification. - Ziqiang Cao; Wenjie Li 002; Sujian Li; Furu Wei (AAAI, 2017)

SuperAgent: A Customer Service Chatbot for E-commerce Websites. - Lei Cui 001; Shaohan Huang; Furu Wei; Chuanqi Tan; Chaoqun Duan; Ming Zhou 001 (ACL (System Demonstrations), 2017)

Gated Self-Matching Networks for Reading Comprehension and Question Answering. - Wenhui Wang 003; Nan Yang 002; Furu Wei; Baobao Chang; Ming Zhou 001 (ACL (1), 2017)

Selective Encoding for Abstractive Sentence Summarization. - Qingyu Zhou; Nan Yang 002; Furu Wei; Ming Zhou 001 (ACL (1), 2017)

Learning to Generate Product Reviews from Attributes. - Li Dong 004; Shaohan Huang; Furu Wei; Mirella Lapata; Ming Zhou 001; Ke Xu 001 (EACL (1), 2017)

Entity Linking for Queries by Searching Wikipedia Sentences. - Chuanqi Tan; Furu Wei; Pengjie Ren; Weifeng Lv; Ming Zhou 001 (EMNLP, 2017)

Neural Question Generation from Text: A Preliminary Study. - Qingyu Zhou; Nan Yang 002; Furu Wei; Chuanqi Tan; Hangbo Bao; Ming Zhou 001 (NLPCC, 2017)

Leveraging Contextual Sentence Relations for Extractive Summarization Using a Neural Attention Model. - Pengjie Ren; Zhumin Chen; Zhaochun Ren; Furu Wei; Jun Ma 001; Maarten de Rijke (SIGIR, 2017)

S-Net: From Answer Extraction to Answer Generation for Machine Reading Comprehension. - Chuanqi Tan; Furu Wei; Nan Yang 002; Weifeng Lv; Ming Zhou 001 (CoRR, 2017)

Faithful to the Original: Fact Aware Neural Abstractive Summarization. - Ziqiang Cao; Furu Wei; Wenjie Li 002; Sujian Li (AAAI, 2018)

S-Net: From Answer Extraction to Answer Synthesis for Machine Reading Comprehension. - Chuanqi Tan; Furu Wei; Nan Yang 002; Bowen Du 001; Weifeng Lv; Ming Zhou 001 (AAAI, 2018)

Sequential Copying Networks. - Qingyu Zhou; Nan Yang 002; Furu Wei; Ming Zhou 001 (AAAI, 2018)

Hierarchical Attention Flow for Multiple-Choice Reading Comprehension. - Haichao Zhu; Furu Wei; Bing Qin 001; Ting Liu 001 (AAAI, 2018)

Neural Open Information Extraction. - Lei Cui 001; Furu Wei; Ming Zhou 001 (ACL (2), 2018)

Retrieve, Rerank and Rewrite: Soft Template Based Neural Summarization. - Ziqiang Cao; Wenjie Li 002; Sujian Li; Furu Wei (ACL (1), 2018)

Neural Document Summarization by Jointly Learning to Score and Select Sentences. - Qingyu Zhou; Nan Yang 002; Furu Wei; Shaohan Huang; Ming Zhou 001; Tiejun Zhao (ACL (1), 2018)

Fluency Boost Learning and Inference for Neural Grammatical Error Correction. - Tao Ge 001; Furu Wei; Ming Zhou 001 (ACL (1), 2018)

Fine-grained Coordinated Cross-lingual Text Stream Alignment for Endless Language Knowledge Acquisition. - Tao Ge 001; Qing Dou; Heng Ji 001; Lei Cui 001; Baobao Chang; Zhifang Sui; Furu Wei; Ming Zhou 001 (EMNLP, 2018)

Attention-Guided Answer Distillation for Machine Reading Comprehension. - Minghao Hu; Yuxing Peng 001; Furu Wei; Zhen Huang 006; Dongsheng Li 001; Nan Yang 002; Ming Zhou 001 (EMNLP, 2018)

Neural Latent Extractive Document Summarization. - Xingxing Zhang 002; Mirella Lapata; Furu Wei; Ming Zhou 001 (EMNLP, 2018)

Attention-Fused Deep Matching Network for Natural Language Inference. - Chaoqun Duan; Lei Cui 001; Xinchi Chen; Furu Wei; Conghui Zhu; Tiejun Zhao (IJCAI, 2018)

Reinforced Mnemonic Reader for Machine Reading Comprehension. - Minghao Hu; Yuxing Peng 001; Zhen Huang 006; Xipeng Qiu; Furu Wei; Ming Zhou 001 (IJCAI, 2018)

Multiway Attention Networks for Modeling Sentence Pairs. - Chuanqi Tan; Furu Wei; Wenhui Wang 003; Weifeng Lv; Ming Zhou 001 (IJCAI, 2018)

XiaoIce Band: A Melody and Arrangement Generation Framework for Pop Music. - Hongyuan Zhu; Qi Liu 003; Nicholas Jing Yuan; Chuan Qin 002; Jiawei Li; Kun Zhang 015; Guang Zhou; Furu Wei; Yuanchun Xu; Enhong Chen (KDD, 2018)

EventWiki: A Knowledge Base of Major Events. - Tao Ge 001; Lei Cui 001; Baobao Chang; Zhifang Sui; Furu Wei; Ming Zhou 001 (LREC, 2018)

SeRI: A Dataset for Sub-event Relation Inference from an Encyclopedia. - Tao Ge 001; Lei Cui 001; Baobao Chang; Zhifang Sui; Furu Wei; Ming Zhou 001 (NLPCC (2), 2018)

I Know There Is No Answer: Modeling Answer Validation for Machine Reading Comprehension. - Chuanqi Tan; Furu Wei; Qingyu Zhou; Nan Yang 002; Weifeng Lv; Ming Zhou 001 (NLPCC (1), 2018)

Improv Chat: Second Response Generation for Chatbot. - Furu Wei (CoRR, 2018)

Response Generation by Context-aware Prototype Editing. - Yu Wu 012; Furu Wei; Shaohan Huang; Zhoujun Li 001; Ming Zhou 001 (CoRR, 2018)

Dictionary-Guided Editing Networks for Paraphrase Generation. - Shaohan Huang; Yu Wu 012; Furu Wei; Ming Zhou 001 (CoRR, 2018)

Reaching Human-level Performance in Automatic Grammatical Error Correction: An Empirical Study. - Tao Ge 001; Furu Wei; Ming Zhou 001 (CoRR, 2018)

Read + Verify: Machine Reading Comprehension with Unanswerable Questions. - Minghao Hu; Furu Wei; Yuxing Peng 001; Zhen Huang 006; Nan Yang 002; Ming Zhou 001 (CoRR, 2018)

Retrieval-Enhanced Adversarial Training for Neural Response Generation. - Qingfu Zhu; Lei Cui 001; Weinan Zhang 003; Furu Wei; Yining Chen; Ting Liu 001 (CoRR, 2018)

Unsupervised Machine Commenting with Neural Variational Topic Model. - Shuming Ma; Lei Cui 001; Furu Wei; Xu Sun 001 (CoRR, 2018)

Text Morphing. - Shaohan Huang; Yu Wu 012; Furu Wei; Ming Zhou 001 (CoRR, 2018)

Context-Aware Answer Sentence Selection With Hierarchical Gated Recurrent Neural Networks. - Chuanqi Tan; Furu Wei; Qingyu Zhou; Nan Yang 002; Bowen Du 001; Weifeng Lv; Ming Zhou 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2018)

Sentence Relations for Extractive Summarization with Deep Neural Networks. - Pengjie Ren; Zhumin Chen; Zhaochun Ren; Furu Wei; Liqiang Nie; Jun Ma 001; Maarten de Rijke (ACM Trans. Inf. Syst., 2018)

Response Generation by Context-Aware Prototype Editing. - Yu Wu 012; Furu Wei; Shaohan Huang; Yunli Wang; Zhoujun Li 001; Ming Zhou 001 (AAAI, 2019)

Read + Verify: Machine Reading Comprehension with Unanswerable Questions. - Minghao Hu; Furu Wei; Yuxing Peng 001; Zhen Huang 006; Nan Yang 002; Dongsheng Li 001 (AAAI, 2019)

Dictionary-Guided Editing Networks for Paraphrase Generation. - Shaohan Huang; Yu Wu 012; Furu Wei; Zhongzhi Luan (AAAI, 2019)

LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts. - Shuming Ma; Lei Cui 001; Damai Dai; Furu Wei; Xu Sun 001 (AAAI, 2019)

Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension. - Hangbo Bao; Li Dong 004; Furu Wei; Wenhui Wang 003; Nan Yang 002; Lei Cui 001; Songhao Piao; Ming Zhou 001 (MRQA@EMNLP, 2019)

Automatic Grammatical Error Correction for Sequence-to-sequence Text Generation: An Empirical Study. - Tao Ge 001; Xingxing Zhang 002; Furu Wei; Ming Zhou 001 (ACL (1), 2019)

HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization. - Xingxing Zhang 002; Furu Wei; Ming Zhou 001 (ACL (1), 2019)

BERT-based Lexical Substitution. - Wangchunshu Zhou; Tao Ge 001; Ke Xu 001; Furu Wei; Ming Zhou 001 (ACL (1), 2019)

Retrieval-Enhanced Adversarial Training for Neural Response Generation. - Qingfu Zhu; Lei Cui 001; Weinan Zhang 003; Furu Wei; Ting Liu 001 (ACL (1), 2019)

Learning to Ask Unanswerable Questions for Machine Reading Comprehension. - Haichao Zhu; Li Dong 004; Furu Wei; Wenhui Wang 003; Bing Qin 001; Ting Liu 001 (ACL (1), 2019)

Visualizing and Understanding the Effectiveness of BERT. - Yaru Hao; Li Dong 004; Furu Wei; Ke Xu 001 (EMNLP/IJCNLP (1), 2019)

Video Dialog via Progressive Inference and Cross-Transformer. - Weike Jin; Zhou Zhao 001; Mao Gu; Jun Xiao 001; Furu Wei; Yueting Zhuang (EMNLP/IJCNLP (1), 2019)

Unified Language Model Pre-training for Natural Language Understanding and Generation. - Li Dong 004; Nan Yang 002; Wenhui Wang 003; Furu Wei; Xiaodong Liu 003; Yu Wang 009; Jianfeng Gao 001; Ming Zhou 001; Hsiao-Wuen Hon (NeurIPS, 2019)

Neural Melody Composition from Lyrics. - Hangbo Bao; Shaohan Huang; Furu Wei; Lei Cui 001; Yu Wu 012; Chuanqi Tan; Songhao Piao; Ming Zhou 001 (NLPCC (1), 2019)

Document-Based Question Answering Improves Query-Focused Multi-document Summarization. - Weikang Li; Xingxing Zhang 002; Yunfang Wu; Furu Wei; Ming Zhou 001 (NLPCC (2), 2019)

Formality Style Transfer with Hybrid Textual Annotations. - Ruochen Xu; Tao Ge 001; Furu Wei (CoRR, 2019)

Sequence-to-sequence Pre-training with Data Augmentation for Sentence Rewriting. - Yi Zhang 050; Tao Ge 001; Furu Wei; Ming Zhou 001; Xu Sun 001 (CoRR, 2019)

Cross-Lingual Natural Language Generation via Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Wenhui Wang 003; Xian-Ling Mao; Heyan Huang (AAAI, 2020)

Fact-Aware Sentence Split and Rephrase with Permutation Invariant Training. - Yinuo Guo; Tao Ge 001; Furu Wei (AAAI, 2020)

Harvesting and Refining Question-Answer Pairs for Unsupervised QA. - Zhongli Li; Wenhui Wang 003; Li Dong 004; Furu Wei; Ke Xu 001 (ACL, 2020)

Unsupervised Fine-tuning for Text Clustering. - Shaohan Huang; Furu Wei; Lei Cui 001; Xingxing Zhang 002; Ming Zhou 001 (COLING, 2020)

DocBank: A Benchmark Dataset for Document Layout Analysis. - Minghao Li 004; Yiheng Xu; Lei Cui 001; Shaohan Huang; Furu Wei; Zhoujun Li 001; Ming Zhou 001 (COLING, 2020)

At Which Level Should We Extract? An Empirical Analysis on Extractive Document Summarization. - Qingyu Zhou; Furu Wei; Ming Zhou 001 (COLING, 2020)

Multimodal Matching Transformer for Live Commenting. - Chaoqun Duan; Lei Cui 001; Shuming Ma; Furu Wei; Conghui Zhu; Tiejun Zhao (ECAI, 2020)

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. - Xiujun Li; Xi Yin 006; Chunyuan Li; Pengchuan Zhang; Xiaowei Hu 006; Lei Zhang 001; Lijuan Wang; Houdong Hu; Li Dong 004; Furu Wei; Yejin Choi 001; Jianfeng Gao 001 (ECCV (30), 2020)

Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction. - Mengyun Chen; Tao Ge 001; Xingxing Zhang 002; Furu Wei; Ming Zhou 001 (EMNLP (1), 2020)

Language Generation with Multi-Hop Reasoning on Commonsense Knowledge Graph. - Haozhe Ji; Pei Ke; Shaohan Huang; Furu Wei; Xiaoyan Zhu 001; Minlie Huang (EMNLP (1), 2020)

BERT-of-Theseus: Compressing BERT by Progressive Module Replacing. - Canwen Xu; Wangchunshu Zhou; Tao Ge 001; Furu Wei; Ming Zhou 001 (EMNLP (1), 2020)

Unsupervised Extractive Summarization by Pre-training Hierarchical Transformers. - Shusheng Xu; Xingxing Zhang 002; Yi Wu 013; Furu Wei; Ming Zhou 001 (EMNLP (Findings), 2020)

Improving Grammatical Error Correction with Machine Translation Pairs. - Wangchunshu Zhou; Tao Ge 001; Chang Mu; Ke Xu 001; Furu Wei; Ming Zhou 001 (EMNLP (Findings), 2020)

Scheduled DropHead: A Regularization Method for Transformer Models. - Wangchunshu Zhou; Tao Ge 001; Furu Wei; Ming Zhou 001; Ke Xu 001 (EMNLP (Findings), 2020)

Pre-training for Abstractive Document Summarization by Reinstating Source Text. - Yanyan Zou; Xingxing Zhang 002; Wei Lu 011; Furu Wei; Ming Zhou 001 (EMNLP (1), 2020)

VL-BERT: Pre-training of Generic Visual-Linguistic Representations. - Weijie Su 002; Xizhou Zhu; Yue Cao; Bin Li 025; Lewei Lu; Furu Wei; Jifeng Dai (ICLR, 2020)

Self-Adversarial Learning with Comparative Discrimination for Text Generation. - Wangchunshu Zhou; Tao Ge 001; Ke Xu 001; Furu Wei; Ming Zhou 001 (ICLR, 2020)

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. - Hangbo Bao; Li Dong 004; Furu Wei; Wenhui Wang 003; Nan Yang 002; Xiaodong Liu 003; Yu Wang 009; Jianfeng Gao 001; Songhao Piao; Ming Zhou 001; Hsiao-Wuen Hon (ICML, 2020)

Can Monolingual Pretrained Models Help Cross-Lingual Classification? - Zewen Chi; Li Dong 004; Furu Wei; Xianling Mao; Heyan Huang (AACL/IJCNLP, 2020)

Investigating Learning Dynamics of BERT Fine-Tuning. - Yaru Hao; Li Dong 004; Furu Wei; Ke Xu 001 (AACL/IJCNLP, 2020)

Generating Commonsense Explanation by Extracting Bridge Concepts from Reasoning Paths. - Haozhe Ji; Pei Ke; Shaohan Huang; Furu Wei; Minlie Huang (AACL/IJCNLP, 2020)

UnihanLM: Coarse-to-Fine Chinese-Japanese Language Model Pretraining with the Unihan Database. - Canwen Xu; Tao Ge 001; Chenliang Li; Furu Wei (AACL/IJCNLP, 2020)

LayoutLM: Pre-training of Text and Layout for Document Image Understanding. - Yiheng Xu; Minghao Li 004; Lei Cui 001; Shaohan Huang; Furu Wei; Ming Zhou 001 (KDD, 2020)

TableBank: Table Benchmark for Image-based Table Detection and Recognition. - Minghao Li 004; Lei Cui 001; Shaohan Huang; Furu Wei; Ming Zhou 001; Zhoujun Li 001 (LREC, 2020)

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. - Wenhui Wang 003; Furu Wei; Li Dong 004; Hangbo Bao; Nan Yang 002; Ming Zhou 001 (NeurIPS, 2020)

BERT Loses Patience: Fast and Robust Inference with Early Exit. - Wangchunshu Zhou; Canwen Xu; Tao Ge 001; Julian J. McAuley; Ke Xu 001; Furu Wei (NeurIPS, 2020)

STEP: Sequence-to-Sequence Transformer Pre-training for Document Summarization. - Yanyan Zou; Xingxing Zhang 002; Wei Lu 011; Furu Wei; Ming Zhou 001 (CoRR, 2020)

Learning to Summarize Passages: Mining Passage-Summary Pairs from Wikipedia Revision Histories. - Qingyu Zhou; Furu Wei; Ming Zhou 001 (CoRR, 2020)

At Which Level Should We Extract? An Empirical Study on Extractive Document Summarization. - Qingyu Zhou; Furu Wei; Ming Zhou 001 (CoRR, 2020)

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. - Shuming Ma; Jian Yang 030; Haoyang Huang; Zewen Chi; Li Dong 004; Dongdong Zhang 001; Hany Hassan Awadalla; Alexandre Muzio; Akiko Eriguchi; Saksham Singhal; Xia Song; Arul Menezes; et al. (CoRR, 2020)

A Joint Sentence Scoring and Selection Framework for Neural Extractive Document Summarization. - Qingyu Zhou; Nan Yang 002; Furu Wei; Shaohan Huang; Ming Zhou 001; Tiejun Zhao (IEEE ACM Trans. Audio Speech Lang. Process., 2020)

Self-Attention Attribution: Interpreting Information Interactions Inside Transformer. - Yaru Hao; Li Dong 004; Furu Wei; Ke Xu 001 (AAAI, 2021)

Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. - Zewen Chi; Li Dong 004; Bo Zheng 010; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL/IJCNLP (1), 2021)

Learning to Sample Replacements for ELECTRA Pre-Training. - Yaru Hao; Li Dong 004; Hangbo Bao; Ke Xu 001; Furu Wei (ACL/IJCNLP (Findings), 2021)

SemFace: Pre-training Encoder and Decoder with a Semantic Interface for Neural Machine Translation. - Shuo Ren; Long Zhou; Shujie Liu 001; Furu Wei; Ming Zhou 001; Shuai Ma 001 (ACL/IJCNLP (1), 2021)

Instantaneous Grammatical Error Correction with Shallow Aggressive Decoding. - Xin Sun 013; Tao Ge 001; Furu Wei; Houfeng Wang (ACL/IJCNLP (1), 2021)

Grammar-Based Patches Generation for Automated Program Repair. - Yu Tang; Long Zhou; Ambrosio Blanco; Shujie Liu 001; Furu Wei; Ming Zhou 001; Muyun Yang (ACL/IJCNLP (Findings), 2021)

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. - Wenhui Wang 003; Hangbo Bao; Shaohan Huang; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

LayoutLMv2: Multi-modal Pre-training for Visually-rich Document Understanding. - Yang Xu 049; Yiheng Xu; Tengchao Lv; Lei Cui 001; Furu Wei; Guoxin Wang; Yijuan Lu; Dinei A. F. Florêncio; Cha Zhang; Wanxiang Che; Min Zhang 005; Lidong Zhou (ACL/IJCNLP (1), 2021)

xMoCo: Cross Momentum Contrastive Learning for Open-Domain Question Answering. - Nan Yang 002; Furu Wei; Binxing Jiao; Daxing Jiang; Linjun Yang (ACL/IJCNLP (1), 2021)

Multilingual Agreement for Multilingual Neural Machine Translation. - Jian Yang 030; Yuwei Yin; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Zhoujun Li 001; Furu Wei (ACL/IJCNLP (2), 2021)

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. - Yunzhi Yao; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Memory-Efficient Differentiable Transformer Architecture Search. - Yuekai Zhao; Li Dong 004; Yelong Shen; Zhihua Zhang; Furu Wei; Weizhu Chen (ACL/IJCNLP (Findings), 2021)

Consistency Regularization for Cross-Lingual Fine-Tuning. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (ACL/IJCNLP (1), 2021)

Jointly Learning to Repair Code and Generate Commit Message. - Jiaqi Bai; Long Zhou; Ambrosio Blanco; Shujie Liu 001; Furu Wei; Ming Zhou 001; Zhoujun Li 001 (EMNLP (1), 2021)

Zero-Shot Cross-Lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders. - Guanhua Chen 001; Shuming Ma; Yun Chen 007; Li Dong 004; Dongdong Zhang 001; Jia Pan 001; Wenping Wang 001; Furu Wei (EMNLP (1), 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Saksham Singhal; Xian-Ling Mao; Heyan Huang; Xia Song; Furu Wei (EMNLP (1), 2021)

LayoutReader: Pre-training of Text and Layout for Reading Order Detection. - Zilong Wang 002; Yiheng Xu; Lei Cui 001; Jingbo Shang; Furu Wei (EMNLP (1), 2021)

Beyond Preserved Accuracy: Evaluating Loyalty and Robustness of BERT Compression. - Canwen Xu; Wangchunshu Zhou; Tao Ge 001; Ke Xu 001; Julian J. McAuley; Furu Wei (EMNLP (1), 2021)

Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (EMNLP (1), 2021)

Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting. - Wangchunshu Zhou; Tao Ge 001; Canwen Xu; Ke Xu 001; Furu Wei (EMNLP (1), 2021)

UniSpeech: Unified Speech Representation Learning with Labeled and Unlabeled Data. - Chengyi Wang 002; Yu Wu 012; Yao Qian; Ken'ichi Kumatani; Shujie Liu 001; Furu Wei; Michael Zeng 001; Xuedong Huang 001 (ICML, 2021)

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Nan Yang 002; Saksham Singhal; Wenhui Wang 003; Xia Song; Xian-Ling Mao; Heyan Huang; Ming Zhou 001 (NAACL-HLT, 2021)

Blow the Dog Whistle: A Chinese Dataset for Cant Understanding with Common Sense and World Knowledge. - Canwen Xu; Wangchunshu Zhou; Tao Ge 001; Ke Xu 001; Julian J. McAuley; Furu Wei (NAACL-HLT, 2021)

Learning to Select Relevant Knowledge for Neural Machine Translation. - Jian Yang 030; Juncheng Wan; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Yong Yu 001; Zhoujun Li 001; Furu Wei (NLPCC (1), 2021)

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. - Jian Yang 030; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Li Dong 004; Shaohan Huang; Alexandre Muzio; Saksham Singhal; Hany Hassan; Xia Song; Furu Wei (WMT@EMNLP, 2021)

Improving Sequence-to-Sequence Pre-training via Sequence Span Rewriting. - Wangchunshu Zhou; Tao Ge 001; Ke Xu 001; Furu Wei (CoRR, 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (CoRR, 2021)

Knowledge Neurons in Pretrained Transformers. - Damai Dai; Li Dong 004; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2021)

LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding. - Yiheng Xu; Tengchao Lv; Lei Cui 001; Guoxin Wang; Yijuan Lu; Dinei Florêncio; Cha Zhang; Furu Wei (CoRR, 2021)

VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarization. - Tengchao Lv; Lei Cui 001; Momcilo Vasilijevic; Furu Wei (CoRR, 2021)

BEiT: BERT Pre-Training of Image Transformers. - Hangbo Bao; Li Dong 004; Furu Wei (CoRR, 2021)

DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. - Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Alexandre Muzio; Saksham Singhal; Hany Hassan Awadalla; Xia Song; Furu Wei (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2021)

TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models. - Minghao Li 004; Tengchao Lv; Lei Cui 001; Yijuan Lu; Dinei A. F. Florêncio; Cha Zhang; Zhoujun Li 001; Furu Wei (CoRR, 2021)

SpeechT5: Unified-Modal Encoder-Decoder Pre-training for Spoken Language Processing. - Junyi Ao; Rui Wang 073; Long Zhou; Shujie Liu 001; Shuo Ren; Yu Wu 012; Tom Ko; Qing Li 001; Yu Zhang 006; Zhihua Wei 001; Yao Qian; Jinyu Li 001; et al. (CoRR, 2021)

Towards Making the Most of Multilingual Pretraining for Zero-Shot Neural Machine Translation. - Guanhua Chen 001; Shuming Ma; Yun Chen 007; Dongdong Zhang 001; Jia Pan 001; Wenping Wang 001; Furu Wei (CoRR, 2021)

Improving Non-autoregressive Generation with Mixup Training. - Ting Jiang; Shaohan Huang; Zihan Zhang; Deqing Wang; Fuzhen Zhuang; Furu Wei; Haizhen Huang; Liangjie Zhang; Qi Zhang 066 (CoRR, 2021)

s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning. - Hangbo Bao; Li Dong 004; Wenhui Wang 003; Nan Yang 002; Furu Wei (CoRR, 2021)

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing. - Sanyuan Chen; Chengyi Wang 002; Zhengyang Chen; Yu Wu 012; Shujie Liu 001; Zhuo Chen 006; Jinyu Li 001; Naoyuki Kanda; Takuya Yoshioka; Xiong Xiao; Jian Wu 027; Long Zhou; et al. (CoRR, 2021)

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Furu Wei (CoRR, 2021)

Document AI: Benchmarks, Models and Applications. - Lei Cui 001; Yiheng Xu; Tengchao Lv; Furu Wei (CoRR, 2021)

Sequence Level Contrastive Learning for Text Summarization. - Shusheng Xu; Xingxing Zhang 002; Yi Wu 013; Furu Wei (AAAI, 2022)

CLIP Models are Few-Shot Learners: Empirical Studies on VQA and Visual Entailment. - Haoyu Song 002; Li Dong 004; Weinan Zhang 003; Ting Liu 001; Furu Wei (ACL (1), 2022)

SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing. - Junyi Ao; Rui Wang 073; Long Zhou; Chengyi Wang 002; Shuo Ren; Yu Wu 012; Shujie Liu 001; Tom Ko; Qing Li 001; Yu Zhang 006; Zhihua Wei 001; Yao Qian; et al. (ACL (1), 2022)

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. - Tianyu Chen; Hangbo Bao; Shaohan Huang; Li Dong 004; Binxing Jiao; Daxin Jiang; Haoyi Zhou; Jianxin Li 002; Furu Wei (ACL (Findings), 2022)

Towards Making the Most of Cross-Lingual Transfer for Zero-Shot Neural Machine Translation. - Guanhua Chen 001; Shuming Ma; Yun Chen 007; Dongdong Zhang 001; Jia Pan 001; Wenping Wang 001; Furu Wei (ACL (1), 2022)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Bo Zheng 010; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL (1), 2022)

StableMoE: Stable Routing Strategy for Mixture of Experts. - Damai Dai; Li Dong 004; Shuming Ma; Bo Zheng 010; Zhifang Sui; Baobao Chang; Furu Wei (ACL (1), 2022)

Knowledge Neurons in Pretrained Transformers. - Damai Dai; Li Dong 004; Yaru Hao; Zhifang Sui; Baobao Chang; Furu Wei (ACL (1), 2022)

Neural Label Search for Zero-Shot Multi-Lingual Extractive Summarization. - Ruipeng Jia; Xingxing Zhang 002; Yanan Cao 001; Zheng Lin 001; Shi Wang 002; Furu Wei (ACL (1), 2022)

MarkupLM: Pre-training of Text and Markup Language for Visually Rich Document Understanding. - Junlong Li; Yiheng Xu; Lei Cui 001; Furu Wei (ACL (1), 2022)

Controllable Natural Language Generation with Contrastive Prefixes. - Jing Qian; Li Dong 004; Yelong Shen; Furu Wei; Weizhu Chen (ACL (Findings), 2022)

XFUND: A Benchmark Dataset for Multilingual Visually Rich Form Understanding. - Yiheng Xu; Tengchao Lv; Lei Cui 001; Guoxin Wang; Yijuan Lu; Dinei A. F. Florêncio; Cha Zhang; Furu Wei (ACL (Findings), 2022)

Attention Temperature Matters in Abstractive Summarization Distillation. - Shengqiang Zhang; Xingxing Zhang 002; Hangbo Bao; Furu Wei (ACL (1), 2022)

Swin Transformer V2: Scaling Up Capacity and Resolution. - Ze Liu; Han Hu 001; Yutong Lin; Zhuliang Yao; Zhenda Xie; Yixuan Wei; Jia Ning; Yue Cao 001; Zheng Zhang 022; Li Dong 004; Furu Wei; Baining Guo (CVPR, 2022)

XDoc: Unified Pre-training for Cross-Format Document Understanding. - Jingye Chen; Tengchao Lv; Lei Cui 001; Cha Zhang; Furu Wei (EMNLP (Findings), 2022)

Snapshot-Guided Domain Adaptation for ELECTRA. - Daixuan Cheng; Shaohan Huang; Jianfeng Liu; Yuefeng Zhan; Hao Sun 015; Furu Wei; Denvy Deng; Qi Zhang 066 (EMNLP (Findings), 2022)

EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation. - Tao Ge 001; Si-Qing Chen; Furu Wei (EMNLP, 2022)

Zero-shot Cross-lingual Transfer of Prompt-based Tuning with a Unified Multilingual Prompt. - Lianzhe Huang; Shuming Ma; Dongdong Zhang 001; Furu Wei; Houfeng Wang (EMNLP, 2022)

PromptBERT: Improving BERT Sentence Embeddings with Prompts. - Ting Jiang; Jian Jiao 007; Shaohan Huang; Zihan Zhang; Deqing Wang; Fuzhen Zhuang; Furu Wei; Haizhen Huang; Denvy Deng; Qi Zhang 066 (EMNLP, 2022)

Distilled Dual-Encoder Model for Vision-Language Understanding. - Zekun Wang 001; Wenhui Wang 003; Haichao Zhu; Ming Liu 004; Bing Qin 001; Furu Wei (EMNLP, 2022)

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. - Jian Yang 030; Shaohan Huang; Shuming Ma; Yuwei Yin; Li Dong 004; Dongdong Zhang 001; Hongcheng Guo; Zhoujun Li 001; Furu Wei (EMNLP (Findings), 2022)

SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training. - Ziqiang Zhang; Long Zhou; Junyi Ao; Shujie Liu 001; Lirong Dai 001; Jinyu Li 001; Furu Wei (EMNLP, 2022)

Unispeech-Sat: Universal Speech Representation Learning With Speaker Aware Pre-Training. - Sanyuan Chen; Yu Wu 012; Chengyi Wang 002; Zhengyang Chen; Zhuo Chen 006; Shujie Liu 001; Jian Wu 027; Yao Qian; Furu Wei; Jinyu Li 001; Xiangzhan Yu (ICASSP, 2022)

BEiT: BERT Pre-Training of Image Transformers. - Hangbo Bao; Li Dong 004; Songhao Piao; Furu Wei (ICLR, 2022)

A Unified Strategy for Multilingual Grammatical Error Correction with Pre-trained Cross-Lingual Language Model. - Xin Sun 013; Tao Ge 001; Shuming Ma; Jingjing Li 007; Furu Wei; Houfeng Wang (IJCAI, 2022)

High-resource Language-specific Training for Multilingual Neural Machine Translation. - Jian Yang 030; Yuwei Yin; Shuming Ma; Dongdong Zhang 001; Zhoujun Li 001; Furu Wei (IJCAI, 2022)

UM4: Unified Multilingual Multiple Teacher-Student Model for Zero-Resource Neural Machine Translation. - Jian Yang 030; Yuwei Yin; Shuming Ma; Dongdong Zhang 001; Shuangzhi Wu; Hongcheng Guo; Zhoujun Li 001; Furu Wei (IJCAI, 2022)

Plug and Play Knowledge Distillation for kNN-LM with External Logits. - Xuyang Jin; Tao Ge 001; Furu Wei (AACL/IJCNLP (2), 2022)

Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data. - Junyi Ao; Ziqiang Zhang; Long Zhou; Shujie Liu 001; Haizhou Li 001; Tom Ko; Lirong Dai 001; Jinyu Li 001; Yao Qian; Furu Wei (INTERSPEECH, 2022)

Why does Self-Supervised Learning for Speech Recognition Benefit Speaker Recognition? - Sanyuan Chen; Yu Wu 012; Chengyi Wang 002; Shujie Liu 001; Zhuo Chen 006; Peidong Wang; Gang Liu 001; Jinyu Li 001; Jian Wu 027; Xiangzhan Yu; Furu Wei (INTERSPEECH, 2022)

Speech Pre-training with Acoustic Piece. - Shuo Ren; Shujie Liu 001; Yu Wu 012; Long Zhou; Furu Wei (INTERSPEECH, 2022)

Supervision-Guided Codebooks for Masked Prediction in Speech Pre-training. - Chengyi Wang 002; Yiming Wang; Yu Wu 012; Sanyuan Chen; Jinyu Li 001; Shujie Liu 001; Furu Wei (INTERSPEECH, 2022)

Separating Long-Form Speech with Group-wise Permutation Invariant Training. - Wangyou Zhang; Zhuo Chen 006; Naoyuki Kanda; Shujie Liu 001; Jinyu Li 001; Sefik Emre Eskimez; Takuya Yoshioka; Xiong Xiao; Zhong Meng; Yanmin Qian; Furu Wei (INTERSPEECH, 2022)

LayoutLMv3: Pre-training for Document AI with Unified Text and Image Masking. - Yupan Huang; Tengchao Lv; Lei Cui 001; Yutong Lu; Furu Wei (ACM Multimedia, 2022)

DiT: Self-supervised Pre-training for Document Image Transformer. - Junlong Li; Yiheng Xu; Tengchao Lv; Lei Cui 001; Cha Zhang; Furu Wei (ACM Multimedia, 2022)

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. - Hangbo Bao; Wenhui Wang 003; Li Dong 004; Qiang Liu; Owais Khan Mohammed; Kriti Aggarwal; Subhojit Som; Songhao Piao; Furu Wei (NeurIPS, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

Kformer: Knowledge Injection in Transformer Feed-Forward Layers. - Yunzhi Yao; Shaohan Huang; Li Dong 004; Furu Wei; Huajun Chen; Ningyu Zhang 001 (NLPCC (1), 2022)

SMDT: Selective Memory-Augmented Neural Document Translation. - Xu Zhang; Jian Yang 030; Haoyang Huang; Shuming Ma; Dongdong Zhang 001; Jinlong Li; Furu Wei (CoRR, 2022)

Phrase-level Adversarial Example Generation for Neural Machine Translation. - Juncheng Wan; Jian Yang 030; Shuming Ma; Dongdong Zhang 001; Weinan Zhang 001; Yong Yu 001; Furu Wei (CoRR, 2022)

PromptBERT: Improving BERT Sentence Embeddings with Prompts. - Ting Jiang; Shaohan Huang; Zihan Zhang; Deqing Wang; Fuzhen Zhuang; Furu Wei; Haizhen Huang; Liangjie Zhang; Qi Zhang 066 (CoRR, 2022)

EdgeFormer: A Parameter-Efficient Transformer for On-Device Seq2seq Generation. - Tao Ge 001; Furu Wei (CoRR, 2022)

A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models. - Da Yin; Li Dong 004; Hao Cheng 002; Xiaodong Liu 003; Kai-Wei Chang; Furu Wei; Jianfeng Gao 001 (CoRR, 2022)

DeepNet: Scaling Transformers to 1, 000 Layers. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Furu Wei (CoRR, 2022)

Lossless Speedup of Autoregressive Translation with Generalized Aggressive Decoding. - Heming Xia; Tao Ge 001; Furu Wei; Zhifang Sui (CoRR, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Prototypical Calibration for Few-shot Learning of Language Models. - Zhixiong Han; Yaru Hao; Li Dong 004; Furu Wei (CoRR, 2022)

Lossless Acceleration for Seq2seq Generation with Aggressive Decoding. - Tao Ge 001; Heming Xia; Xin Sun 013; Si-Qing Chen; Furu Wei (CoRR, 2022)

Task-Specific Expert Pruning for Sparse Mixture-of-Experts. - Tianyu Chen; Shaohan Huang; Yuan Xie; Binxing Jiao; Daxin Jiang; Haoyi Zhou; Jianxin Li 002; Furu Wei (CoRR, 2022)

VL-BEiT: Generative Vision-Language Pretraining. - Hangbo Bao; Wenhui Wang 003; Li Dong 004; Furu Wei (CoRR, 2022)

The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Task. - Ziqiang Zhang; Junyi Ao; Long Zhou; Shujie Liu 001; Furu Wei; Jinyu Li 001 (CoRR, 2022)

Language Models are General-Purpose Interfaces. - Yaru Hao; Haoyu Song 002; Li Dong 004; Shaohan Huang; Zewen Chi; Wenhui Wang 003; Shuming Ma; Furu Wei (CoRR, 2022)

HLT-MT: High-resource Language-specific Training for Multilingual Neural Machine Translation. - Jian Yang 030; Yuwei Yin; Shuming Ma; Dongdong Zhang 001; Zhoujun Li 001; Furu Wei (CoRR, 2022)

GTrans: Grouping and Fusing Transformer Layers for Neural Machine Translation. - Jian Yang 030; Yuwei Yin; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Furu Wei; Zhoujun Li 001 (CoRR, 2022)

Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval. - Zehan Li; Nan Yang 002; Liang Wang 046; Furu Wei (CoRR, 2022)

BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers. - Zhiliang Peng; Li Dong 004; Hangbo Bao; Qixiang Ye; Furu Wei (CoRR, 2022)

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CoRR, 2022)

Towards Multilingual Transitivity and Bidirectional Multilingual Agreement for Multilingual Document-level Machine Translation. - Hongyuan Lu; Haoyang Huang; Shuming Ma; Dongdong Zhang 001; Furu Wei; Wai Lam (CoRR, 2022)

Foundation Transformers. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (CoRR, 2022)

LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translation. - Hongcheng Guo; Jiaheng Liu; Haoyang Huang; Jian Yang 030; Zhoujun Li 001; Dongdong Zhang 001; Furu Wei (CoRR, 2022)

Latent Prompt Tuning for Text Summarization. - Yubo Zhang; Xingxing Zhang 002; Xun Wang 012; Si-qing Chen; Furu Wei (CoRR, 2022)

TorchScale: Transformers at Scale. - Shuming Ma; Hongyu Wang 009; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Li Dong 004; Alon Benhaim; Barun Patra; Vishrav Chaudhary; Xia Song; Furu Wei (CoRR, 2022)

Extensible Prompts for Language Models. - Tao Ge 001; Jing Hu 001; Li Dong 004; Shaoguang Mao; Yan Xia 005; Xun Wang 012; Si-Qing Chen; Furu Wei (CoRR, 2022)

Text Embeddings by Weakly-Supervised Contrastive Pre-training. - Liang Wang 046; Nan Yang 002; Xiaolong Huang; Binxing Jiao; Linjun Yang; Daxin Jiang; Rangan Majumder; Furu Wei (CoRR, 2022)

Momentum Calibration for Text Generation. - Xingxing Zhang 002; Yiran Liu; Xun Wang 012; Pengcheng He; Yang Yu; Si-Qing Chen; Wayne Xiong; Furu Wei (CoRR, 2022)

Structured Prompting: Scaling In-Context Learning to 1, 000 Examples. - Yaru Hao; Yutao Sun; Li Dong 004; Zhixiong Han; Yuxian Gu; Furu Wei (CoRR, 2022)

TRIP: Triangular Document-level Pre-training for Multilingual Language Models. - Hongyuan Lu; Haoyang Huang; Shuming Ma; Dongdong Zhang 001; Wai Lam; Furu Wei (CoRR, 2022)

BEATs: Audio Pre-Training with Acoustic Tokenizers. - Sanyuan Chen; Yu Wu 012; Chengyi Wang 002; Shujie Liu 001; Daniel Tompkins; Zhuo Chen 006; Furu Wei (CoRR, 2022)

Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite. - Xun Wang 012; Tao Ge 001; Allen Mao; Yuki Li; Furu Wei; Si-Qing Chen (CoRR, 2022)

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. - Damai Dai; Yutao Sun; Li Dong 004; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2022)

WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing. - Sanyuan Chen; Chengyi Wang 002; Zhengyang Chen; Yu Wu 012; Shujie Liu 001; Zhuo Chen 006; Jinyu Li 001; Naoyuki Kanda; Takuya Yoshioka; Xiong Xiao; Jian Wu 027; Long Zhou; et al. (IEEE J. Sel. Top. Signal Process., 2022)

Transforming Wikipedia Into Augmented Data for Query-Focused Summarization. - Haichao Zhu; Li Dong 004; Furu Wei; Bing Qin 001; Ting Liu 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2022)

TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models. - Minghao Li 004; Tengchao Lv; Jingye Chen; Lei Cui 001; Yijuan Lu; Dinei A. F. Florêncio; Cha Zhang; Zhoujun Li 001; Furu Wei (AAAI, 2023)

MoEC: Mixture of Expert Clusters. - Yuan Xie; Shaohan Huang; Tianyu Chen; Furu Wei (AAAI, 2023)

Multiview Identifiers Enhanced Generative Retrieval. - Yongqi Li 001; Nan Yang 002; Liang Wang 046; Furu Wei; Wenjie Li 002 (ACL (1), 2023)

Pre-training Language Model as a Multi-perspective Course Learner. - Beiduo Chen; Shaohan Huang; Zihan Zhang; Wu Guo; Zhenhua Ling; Haizhen Huang; Furu Wei; Weiwei Deng; Qi Zhang 066 (ACL (Findings), 2023)

On the Off-Target Problem of Zero-Shot Multilingual Neural Machine Translation. - Liang Chen 024; Shuming Ma; Dongdong Zhang 001; Furu Wei; Baobao Chang (ACL (Findings), 2023)

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. - Damai Dai; Yutao Sun; Li Dong 004; Yaru Hao; Shuming Ma; Zhifang Sui; Furu Wei (ACL (Findings), 2023)

Pre-Training to Learn in Context. - Yuxian Gu; Li Dong 004; Furu Wei; Minlie Huang (ACL (1), 2023)

Dual-Alignment Pre-training for Cross-lingual Sentence Embedding. - Ziheng Li; Shaohan Huang; Zihan Zhang; Zhi-Hong Deng 001; Qiang Lou; Haizhen Huang; Jian Jiao 007; Furu Wei; Weiwei Deng; Qi Zhang 066 (ACL (1), 2023)

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. - Barun Patra; Saksham Singhal; Shaohan Huang; Zewen Chi; Li Dong 004; Furu Wei; Vishrav Chaudhary; Xia Song (ACL (1), 2023)

A Length-Extrapolatable Transformer. - Yutao Sun; Li Dong 004; Barun Patra; Shuming Ma; Shaohan Huang; Alon Benhaim; Vishrav Chaudhary; Xia Song; Furu Wei (ACL (1), 2023)

SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval. - Liang Wang 046; Nan Yang 002; Xiaolong Huang; Binxing Jiao; Linjun Yang; Daxin Jiang; Rangan Majumder; Furu Wei (ACL (1), 2023)

GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. - Jian Yang 030; Shuming Ma; Li Dong 004; Shaohan Huang; Haoyang Huang; Yuwei Yin; Dongdong Zhang 001; Liqun Yang; Furu Wei; Zhoujun Li 001 (ACL (1), 2023)

Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CVPR, 2023)

Non-Contrastive Learning Meets Language-Image Pre-Training. - Jinghao Zhou; Li Dong 004; Zhe Gan; Lijuan Wang; Furu Wei (CVPR, 2023)

HanoiT: Enhancing Context-aware Translation via Selective Context. - Jian Yang 030; Yuwei Yin; Shuming Ma; Liqun Yang; Hongcheng Guo; Haoyang Huang; Dongdong Zhang 001; Yutao Zeng; Zhoujun Li 001; Furu Wei (DASFAA (3), 2023)

UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. - Daixuan Cheng; Shaohan Huang; Junyu Bi; Yuefeng Zhan; Jianfeng Liu; Yujing Wang; Hao Sun 015; Furu Wei; Weiwei Deng; Qi Zhang 066 (EMNLP, 2023)

Syllogistic Reasoning for Legal Judgment Analysis. - Wentao Deng; Jiahuan Pei; Keyi Kong; Zhe Chen; Furu Wei; Yujun Li; Zhaochun Ren; Zhumin Chen; Pengjie Ren (EMNLP, 2023)

Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting. - Haoyang Huang; Tianyi Tang; Dongdong Zhang 001; Xin Zhao 018; Ting Song; Yan Xia 005; Furu Wei (EMNLP (Findings), 2023)

Tuna: Instruction Tuning using Feedback from Large Language Models. - Haoran Li; Yiran Liu; Xingxing Zhang 002; Wei Lu 011; Furu Wei (EMNLP (Findings), 2023)

TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets. - Hongyuan Lu; Haoyang Huang; Shuming Ma; Dongdong Zhang 001; Wai Lam; Zhaochuan Gao; Anthony Aue; Arul Menezes; Furu Wei (EMNLP (Findings), 2023)

Democratizing Reasoning Ability: Tailored Learning from Large Language Model. - Zhaoyang Wang; Shaohan Huang; Yuxuan Liu 011; Jiahai Wang; Minghui Song; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (EMNLP, 2023)

Query2doc: Query Expansion with Large Language Models. - Liang Wang 046; Nan Yang 002; Furu Wei (EMNLP, 2023)

Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation. - Heming Xia; Tao Ge 001; Peiyi Wang; Si-Qing Chen; Furu Wei; Zhifang Sui (EMNLP (Findings), 2023)

Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation. - Kun Wei; Long Zhou; Ziqiang Zhang; Liping Chen; Shujie Liu 001; Lei He 005; Jinyu Li 001; Furu Wei (ICASSP, 2023)

Corrupted Image Modeling for Self-Supervised Visual Pre-Training. - Yuxin Fang; Li Dong 004; Hangbo Bao; Xinggang Wang; Furu Wei (ICLR, 2023)

Prototypical Calibration for Few-shot Learning of Language Models. - Zhixiong Han; Yaru Hao; Li Dong 004; Yutao Sun; Furu Wei (ICLR, 2023)

Visually-Augmented Language Modeling. - Weizhi Wang; Li Dong 004; Hao Cheng 002; Haoyu Song 002; Xiaodong Liu 003; Xifeng Yan; Jianfeng Gao 001; Furu Wei (ICLR, 2023)

Are More Layers Beneficial to Graph Transformers? - Haiteng Zhao; Shuming Ma; Dongdong Zhang 001; Zhi-Hong Deng 001; Furu Wei (ICLR, 2023)

BEATs: Audio Pre-Training with Acoustic Tokenizers. - Sanyuan Chen; Yu Wu 012; Chengyi Wang 002; Shujie Liu 001; Daniel Tompkins; Zhuo Chen 006; Wanxiang Che; Xiangzhan Yu; Furu Wei (ICML, 2023)

Magneto: A Foundation Transformer. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (ICML, 2023)

Extensible Prompts for Language Models on Zero-shot Language Style Customization. - Tao Ge 001; Jing Hu 001; Li Dong 004; Shaoguang Mao; Yan Xia 005; Xun Wang 012; Si-Qing Chen; Furu Wei (NeurIPS, 2023)

TextDiffuser: Diffusion Models as Text Painters. - Jingye Chen; Yupan Huang; Tengchao Lv; Lei Cui 001; Qifeng Chen; Furu Wei (NeurIPS, 2023)

On the Pareto Front of Multilingual Neural Machine Translation. - Liang Chen 024; Shuming Ma; Dongdong Zhang 001; Furu Wei; Baobao Chang (NeurIPS, 2023)

Optimizing Prompts for Text-to-Image Generation. - Yaru Hao; Zewen Chi; Li Dong 004; Furu Wei (NeurIPS, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

Augmenting Language Models with Long-Term Memory. - Weizhi Wang; Li Dong 004; Hao Cheng 002; Xiaodong Liu 003; Xifeng Yan; Jianfeng Gao 001; Furu Wei (NeurIPS, 2023)

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers. - Chengyi Wang 002; Sanyuan Chen; Yu Wu 012; Ziqiang Zhang; Long Zhou; Shujie Liu 001; Zhuo Chen 006; Yanqing Liu; Huaming Wang; Jinyu Li 001; Lei He 005; Sheng Zhao; et al. (CoRR, 2023)

Semiparametric Language Models Are Scalable Continual Learners. - Guangyue Peng; Tao Ge 001; Si-Qing Chen; Furu Wei; Houfeng Wang (CoRR, 2023)

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling. - Ziqiang Zhang; Long Zhou; Chengyi Wang 002; Sanyuan Chen; Yu Wu 012; Shujie Liu 001; Zhuo Chen 006; Yanqing Liu; Huaming Wang; Jinyu Li 001; Lei He 005; Sheng Zhao; et al. (CoRR, 2023)

UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. - Daixuan Cheng; Shaohan Huang; Junyu Bi; Yuefeng Zhan; Jianfeng Liu; Yujing Wang; Hao Sun 015; Furu Wei; Denvy Deng; Qi Zhang 066 (CoRR, 2023)

Inference with Reference: Lossless Acceleration of Large Language Models. - Nan Yang 002; Tao Ge 001; Liang Wang 046; Binxing Jiao; Daxin Jiang; Linjun Yang; Rangan Majumder; Furu Wei (CoRR, 2023)

Chain-of-Dictionary Prompting Elicits Translation in Large Language Models. - Hongyuan Lu; Haoyang Huang; Dongdong Zhang 001; Haoran Yang; Wai Lam; Furu Wei (CoRR, 2023)

One-stop Training of Multiple Capacity Models. - Lan Jiang; Haoyang Huang; Dongdong Zhang; Rui Jiang; Furu Wei (CoRR, 2023)

Not All Metrics Are Guilty: Improving NLG Evaluation with LLM Paraphrasing. - Tianyi Tang; Hongyuan Lu; Yuchen Eleanor Jiang; Haoyang Huang; Dongdong Zhang 001; Wayne Xin Zhao; Furu Wei (CoRR, 2023)

VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation. - Tianrui Wang; Long Zhou; Ziqiang Zhang; Yu Wu 012; Shujie Liu 001; Yashesh Gaur; Zhuo Chen 006; Jinyu Li 001; Furu Wei (CoRR, 2023)

Knowledge Distillation of Large Language Models. - Yuxian Gu; Li Dong 004; Furu Wei; Minlie Huang (CoRR, 2023)

Kosmos-2: Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Furu Wei (CoRR, 2023)

LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens. - Jiayu Ding; Shuming Ma; Li Dong 004; Xingxing Zhang 002; Shaohan Huang; Wenhui Wang 003; Nanning Zheng 001; Furu Wei (CoRR, 2023)

Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration. - Zhenhailong Wang; Shaoguang Mao; Wenshan Wu; Tao Ge 001; Furu Wei; Heng Ji 001 (CoRR, 2023)

In-context Autoencoder for Context Compression in a Large Language Model. - Tao Ge 001; Jing Hu 001; Xun Wang 012; Si-Qing Chen; Furu Wei (CoRR, 2023)

Retentive Network: A Successor to Transformer for Large Language Models. - Yutao Sun; Li Dong 004; Shaohan Huang; Shuming Ma; Yuqing Xia; Jilong Xue; Jianyong Wang 001; Furu Wei (CoRR, 2023)

WavMark: Watermarking for Audio Generation. - Guangyu Chen; Yu Wu 012; Shujie Liu 001; Tao Liu 001; Xiaoyong Du 001; Furu Wei (CoRR, 2023)

Large Language Model for Science: A Study on P vs. NP. - Qingxiu Dong; Li Dong 004; Ke Xu 001; Guangyan Zhou; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2023)

Kosmos-2.5: A Multimodal Literate Model. - Tengchao Lv; Yupan Huang; Jingye Chen; Lei Cui 001; Shuming Ma; Yaoyao Chang; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Weiyao Luo; Shaoxiang Wu; Guoxin Wang; et al. (CoRR, 2023)

EIPE-text: Evaluation-Guided Iterative Plan Extraction for Long-Form Narrative Text Generation. - Wang You; Wenshan Wu; Yaobo Liang; Shaoguang Mao; Chenfei Wu; Maosong Cao; Yuzhe Cai; Yiduo Guo; Yan Xia 005; Furu Wei; Nan Duan (CoRR, 2023)

BitNet: Scaling 1-bit Transformers for Large Language Models. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Huaijie Wang; Lingxiao Ma; Fan Yang 024; Ruiping Wang; Yi Wu 013; Furu Wei (CoRR, 2023)

ALYMPICS: Language Agents Meet Game Theory. - Shaoguang Mao; Yuzhe Cai; Yan Xia 005; Wenshan Wu; Xun Wang 012; Fengyi Wang; Tao Ge 001; Furu Wei (CoRR, 2023)

Auto-ICL: In-Context Learning without Human Supervision. - Jinghan Yang; Shuming Ma; Furu Wei (CoRR, 2023)

When an Image is Worth 1, 024 x 1, 024 Words: A Case Study in Computational Pathology. - Wenhui Wang 003; Shuming Ma; Hanwen Xu; Naoto Usuyama; Jiayu Ding; Hoifung Poon; Furu Wei (CoRR, 2023)

GTrans: Grouping and Fusing Transformer Layers for Neural Machine Translation. - Jian Yang 030; Yuwei Yin; Liqun Yang; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Furu Wei; Zhoujun Li 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2023)

A Unified View of Masked Image Modeling. - Zhiliang Peng; Li Dong 004; Hangbo Bao; Furu Wei; Qixiang Ye (Trans. Mach. Learn. Res., 2023)

Generative retrieval for conversational question answering. - Yongqi Li 001; Nan Yang 002; Liang Wang 046; Furu Wei; Wenjie Li 002 (Inf. Process. Manag., 2023)

Large Search Model: Redefining Search Stack in the Era of LLMs. - Liang Wang 046; Nan Yang 002; Xiaolong Huang; Linjun Yang; Rangan Majumder; Furu Wei (SIGIR Forum, 2023)

Learning to Rank in Generative Retrieval. - Yongqi Li 001; Nan Yang 002; Liang Wang 046; Furu Wei; Wenjie Li 002 (AAAI, 2024)

Text Diffusion with Reinforced Conditioning. - Yuxuan Liu 011; Tianchi Yang; Shaohan Huang; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (AAAI, 2024)

SCALE: Synergized Collaboration of Asymmetric Language Translation Engines. - Xin Cheng 002; Xun Wang 012; Tao Ge 001; Si-Qing Chen; Furu Wei; Dongyan Zhao 001; Rui Yan 001 (ACL (Findings), 2024)

Se²: Sequential Example Selection for In-Context Learning. - Haoyu Liu; Jianfeng Liu; Shaohan Huang; Yuefeng Zhan; Hao Sun 015; Weiwei Deng; Furu Wei; Qi Zhang 066 (ACL (Findings), 2024)

HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition. - Yuxuan Liu 011; Tianchi Yang; Shaohan Huang; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (ACL (1), 2024)

ResLoRA: Identity Residual Mapping in Low-Rank Adaption. - Shuhua Shi; Shaohan Huang; Minghui Song; Zhoujun Li; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (ACL (Findings), 2024)

Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models. - Tianyi Tang; Wenyang Luo; Haoyang Huang; Dongdong Zhang 001; Xiaolei Wang 005; Xin Zhao 018; Furu Wei; Ji-Rong Wen (ACL (1), 2024)

Improving Text Embeddings with Large Language Models. - Liang Wang 046; Nan Yang 002; Xiaolong Huang; Linjun Yang; Rangan Majumder; Furu Wei (ACL (1), 2024)

Respond in my Language: Mitigating Language Inconsistency in Response Generation based on Large Language Models. - Liang Zhang; Qin Jin; Haoyang Huang; Dongdong Zhang; Furu Wei (ACL (1), 2024)

Calibrating LLM-Based Evaluator. - Yuxuan Liu 011; Tianchi Yang; Shaohan Huang; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066 (LREC/COLING, 2024)

Revamping Multilingual Agreement Bidirectionally via Switched Back-translation for Multilingual Neural Machine Translation. - Hongyuan Lu; Haoyang Huang; Dongdong Zhang 001; Furu Wei; Wai Lam (EACL (Findings), 2024)

Learning to Retrieve In-Context Examples for Large Language Models. - Liang Wang 046; Nan Yang 002; Furu Wei (EACL (1), 2024)

Language Models as Inductive Reasoners. - Zonglin Yang 001; Li Dong 004; Xinya Du; Hao Cheng 002; Erik Cambria; Xiaodong Liu 003; Jianfeng Gao 001; Furu Wei (EACL (1), 2024)

TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering. - Jingye Chen; Yupan Huang; Tengchao Lv; Lei Cui 001; Qifeng Chen; Furu Wei (ECCV (5), 2024)

Instruction Pre-Training: Language Models are Supervised Multitask Learners. - Daixuan Cheng; Yuxian Gu; Shaohan Huang; Junyu Bi; Minlie Huang; Furu Wei (EMNLP, 2024)

WavLLM: Towards Robust and Adaptive Speech Large Language Model. - Shujie Hu; Long Zhou; Shujie Liu 001; Sanyuan Chen; Lingwei Meng; Hongkun Hao; Jing Pan; Xunying Liu; Jinyu Li 001; Sunit Sivasankaran; Linquan Liu; Furu Wei (EMNLP (Findings), 2024)

Chain-of-Dictionary Prompting Elicits Translation in Large Language Models. - Hongyuan Lu; Haoran Yang; Haoyang Huang; Dongdong Zhang; Wai Lam; Furu Wei (EMNLP, 2024)

LongEmbed: Extending Embedding Models for Long Context Retrieval. - Dawei Zhu; Liang Wang 046; Nan Yang 002; Yifan Song 002; Wenhao Wu; Furu Wei; Sujian Li (EMNLP, 2024)

In-context Autoencoder for Context Compression in a Large Language Model. - Tao Ge 001; Jing Hu 001; Lei Wang; Xun Wang 012; Si-Qing Chen; Furu Wei (ICLR, 2024)

Adapting Large Language Models via Reading Comprehension. - Daixuan Cheng; Shaohan Huang; Furu Wei (ICLR, 2024)

MiniLLM: Knowledge Distillation of Large Language Models. - Yuxian Gu; Li Dong 004; Furu Wei; Minlie Huang (ICLR, 2024)

Kosmos-G: Generating Images in Context with Multimodal Large Language Models. - Xichen Pan; Li Dong 004; Shaohan Huang; Zhiliang Peng; Wenhu Chen; Furu Wei (ICLR, 2024)

Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Qixiang Ye; Furu Wei (ICLR, 2024)

Mixture of LoRA Experts. - Xun Wu; Shaohan Huang; Furu Wei (ICLR, 2024)

PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training. - Dawei Zhu; Nan Yang 002; Liang Wang 046; Yifan Song 002; Wenhao Wu; Furu Wei; Sujian Li (ICLR, 2024)

MathScale: Scaling Instruction Tuning for Mathematical Reasoning. - Zhengyang Tang; Xingxing Zhang 002; Benyou Wang; Furu Wei (ICML, 2024)

KOSMOS-E : Learning to Follow Instruction for Robotic Grasping. - Zhi Wang; Xun Wu; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Shuming Ma; Furu Wei (IROS, 2024)

Low-code LLM: Graphical User Interface over Large Language Models. - Yuzhe Cai; Shaoguang Mao; Wenshan Wu; Zehua Wang; Yaobo Liang; Tao Ge 001; Chenfei Wu; Wang You; Ting Song; Yan Xia 005; Nan Duan; Furu Wei (NAACL (Demonstrations), 2024)

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References. - Tianyi Tang; Hongyuan Lu; Yuchen Jiang; Haoyang Huang; Dongdong Zhang 001; Wayne Xin Zhao; Tom Kocmi; Furu Wei (NAACL-HLT, 2024)

Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration. - Zhenhailong Wang; Shaoguang Mao; Wenshan Wu; Tao Ge 001; Furu Wei; Heng Ji 001 (NAACL-HLT, 2024)

xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token. - Xin Cheng 002; Xun Wang 012; Xingxing Zhang 002; Tao Ge 001; Si-Qing Chen; Furu Wei; Huishuai Zhang; Dongyan Zhao 001 (NeurIPS, 2024)

You Only Cache Once: Decoder-Decoder Architectures for Language Models. - Yutao Sun; Li Dong 004; Yi Zhu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Quanlu Zhang; Jianyong Wang 001; Furu Wei (NeurIPS, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Li Dong 004; Furu Wei (NeurIPS, 2024)

Multimodal Large Language Models Make Text-to-Image Generative Models Align Better. - Xun Wu; Shaohan Huang; Guolong Wang 001; Jing Xiong; Furu Wei (NeurIPS, 2024)

Boosting Text-to-Video Generative Model with MLLMs Feedback. - Xun Wu; Shaohan Huang; Guolong Wang 001; Jing Xiong; Furu Wei (NeurIPS, 2024)

Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models. - Wenshan Wu; Shaoguang Mao; Yadong Zhang; Yan Xia 005; Li Dong 004; Lei Cui 001; Furu Wei (NeurIPS, 2024)

Fine-Tuning LLaMA for Multi-Stage Text Retrieval. - Xueguang Ma; Liang Wang 046; Nan Yang 002; Furu Wei; Jimmy Lin (SIGIR, 2024)

Improving Domain Adaptation through Extended-Text Reading Comprehension. - Ting Jiang; Shaohan Huang; Shengyue Luo; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066; Deqing Wang; Fuzhen Zhuang (CoRR, 2024)

K-Level Reasoning with Large Language Models. - Yadong Zhang; Shaoguang Mao; Tao Ge 001; Xun Wang 012; Yan Xia 005; Man Lan; Furu Wei (CoRR, 2024)

Multilingual E5 Text Embeddings: A Technical Report. - Liang Wang 046; Nan Yang 002; Xiaolong Huang; Linjun Yang; Rangan Majumder; Furu Wei (CoRR, 2024)

Se2: Sequential Example Selection for In-Context Learning. - Haoyu Liu; Jianfeng Liu; Shaohan Huang; Yuefeng Zhan; Hao Sun 015; Weiwei Deng; Furu Wei; Qi Zhang 066 (CoRR, 2024)

Towards Optimal Learning of Language Models. - Yuxian Gu; Li Dong 004; Yaru Hao; Qingxiu Dong; Minlie Huang; Furu Wei (CoRR, 2024)

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. - Shuming Ma; Hongyu Wang 009; Lingxiao Ma; Lei Wang 222; Wenhui Wang 003; Shaohan Huang; Li Dong 004; Ruiping Wang; Jilong Xue; Furu Wei (CoRR, 2024)

WavLLM: Towards Robust and Adaptive Speech Large Language Model. - Shujie Hu; Long Zhou; Shujie Liu 001; Sanyuan Chen; Hongkun Hao; Jing Pan; Xunying Liu; Jinyu Li 001; Sunit Sivasankaran; Linquan Liu; Furu Wei (CoRR, 2024)

LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models. - Yadong Zhang; Shaoguang Mao; Tao Ge 001; Xun Wang 012; Adrian de Wynter; Yan Xia 005; Wenshan Wu; Ting Song; Man Lan; Furu Wei (CoRR, 2024)

Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models. - Wenshan Wu; Shaoguang Mao; Yadong Zhang; Yan Xia 005; Li Dong 004; Lei Cui 001; Furu Wei (CoRR, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Furu Wei (CoRR, 2024)

Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation. - Xun Wu; Shaohan Huang; Furu Wei (CoRR, 2024)

Semi-Parametric Retrieval via Binary Token Index. - Jiawei Zhou 003; Li Dong 004; Furu Wei; Lei Chen 002 (CoRR, 2024)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning. - Ting Jiang; Shaohan Huang; Shengyue Luo; Zihan Zhang; Haizhen Huang; Furu Wei; Weiwei Deng; Feng Sun 008; Qi Zhang 066; Deqing Wang; Fuzhen Zhuang (CoRR, 2024)

VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers. - Sanyuan Chen; Shujie Liu 001; Long Zhou; Yanqing Liu; Xu Tan 003; Jinyu Li 001; Sheng Zhao; Yao Qian; Furu Wei (CoRR, 2024)

VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment. - Bing Han 008; Long Zhou; Shujie Liu 001; Sanyuan Chen; Lingwei Meng; Yanming Qian; Yanqing Liu; Sheng Zhao; Jinyu Li 001; Furu Wei (CoRR, 2024)

Meta Reasoning for Large Language Models. - Peizhong Gao; Ao Xie; Shaoguang Mao; Wenshan Wu; Yan Xia 005; Haipeng Mi; Furu Wei (CoRR, 2024)

Direct Preference Knowledge Distillation for Large Language Models. - Yixing Li; Yuxian Gu; Li Dong 004; Dequan Wang; Yu Cheng; Furu Wei (CoRR, 2024)

Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoning. - Yadong Zhang; Shaoguang Mao; Wenshan Wu; Yan Xia 005; Tao Ge 001; Man Lan; Furu Wei (CoRR, 2024)

Q-Sparse: All Large Language Models can be Fully Sparsely-Activated. - Hongyu Wang 009; Shuming Ma; Ruiping Wang; Furu Wei (CoRR, 2024)

Scaling Optimal LR Across Token Horizon. - Johan Bjorck; Alon Benhaim; Vishrav Chaudhary; Furu Wei; Xia Song (CoRR, 2024)

One Language, Many Gaps: Evaluating Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks. - Fangru Lin; Shaoguang Mao; Emanuele La Malfa; Valentin Hofmann; Adrian de Wynter; Jing Yao; Si-Qing Chen; Michael J. Wooldridge; Furu Wei (CoRR, 2024)

1-bit AI Infra: Part 1.1, Fast and Lossless BitNet b1.58 Inference on CPUs. - Jinheng Wang; Hansong Zhou; Ting Song; Shaoguang Mao; Shuming Ma; Hongyu Wang; Yan Xia 005; Furu Wei (CoRR, 2024)

ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Contrastive Framework. - Hengyuan Zhang; Chenming Shang; Sizhe Wang; Dongdong Zhang; Feng Yao; Renliang Sun; Yiyao Yu; Yujiu Yang; Furu Wei (CoRR, 2024)

Textual Aesthetics in Large Language Models. - Lingjie Jiang; Shaohan Huang; Xun Wu; Furu Wei (CoRR, 2024)

BitNet a4.8: 4-bit Activations for 1-bit LLMs. - Hongyu Wang; Shuming Ma; Furu Wei (CoRR, 2024)

MH-MoE: Multi-Head Mixture-of-Experts. - Shaohan Huang; Xun Wu; Shuming Ma; Furu Wei (CoRR, 2024)

RedStone: Curating General, Code, Math, and QA Data for Large Language Models. - Yaoyao Chang; Lei Cui 001; Li Dong 004; Shaohan Huang; Yangyu Huang; Yupan Huang; Scarlett Li; Tengchao Lv; Shuming Ma; Qinzheng Sun; Wenhui Wang 003; Furu Wei; et al. (CoRR, 2024)

Multimodal Latent Language Modeling with Next-Token Diffusion. - Yutao Sun; Hangbo Bao; Wenhui Wang 003; Zhiliang Peng; Li Dong 004; Shaohan Huang; Jianyong Wang 001; Furu Wei (CoRR, 2024)

MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark. - Qihao Zhao; Yangyu Huang; Tengchao Lv; Lei Cui 001; Qinzheng Sun; Shaoguang Mao; Xingxing Zhang 002; Ying Xin; Qiufeng Yin; Scarlett Li; Furu Wei (CoRR, 2024)

Bootstrap Your Own Context Length. - Liang Wang 046; Nan Yang 002; Xingxing Zhang; Xiaolong Huang; Furu Wei (CoRR, 2024)

VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation. - Tianrui Wang; Long Zhou; Ziqiang Zhang; Yu Wu 012; Shujie Liu 001; Yashesh Gaur; Zhuo Chen 006; Jinyu Li 001; Furu Wei (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data. - Ziqiang Zhang; Sanyuan Chen; Long Zhou; Yu Wu 012; Shuo Ren; Shujie Liu 001; Zhuoyuan Yao; Xun Gong 005; Li-Rong Dai 001; Jinyu Li 001; Furu Wei (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

VatLM: Visual-Audio-Text Pre-Training With Unified Masked Prediction for Speech Representation Learning. - Qiushi Zhu; Long Zhou; Ziqiang Zhang; Shujie Liu 001; Binxing Jiao; Jie Zhang 042; Li-Rong Dai 001; Daxin Jiang; Jinyu Li 001; Furu Wei (IEEE Trans. Multim., 2024)

Fine-tuning pretrained transformer encoders for sequence-to-sequence learning. - Hangbo Bao; Li Dong 004; Wenhui Wang 003; Nan Yang 002; Songhao Piao; Furu Wei (Int. J. Mach. Learn. Cybern., 2024)

Generic-to-Specific Distillation of Masked Autoencoders. - Wei Huang; Zhiliang Peng; Li Dong 004; Furu Wei; Qixiang Ye; Jianbin Jiao (IEEE Trans. Circuits Syst. Video Technol., 2024)

DeepNet: Scaling Transformers to 1,000 Layers. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Furu Wei (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

mmE5: Improving Multimodal Multilingual Embeddings via High-quality Synthetic Data. - Haonan Chen 005; Liang Wang 046; Nan Yang 002; Yutao Zhu 001; Ziliang Zhao; Furu Wei; Zhicheng Dou (ACL (Findings), 2025)

Context-DPO: Aligning Language Models for Context-Faithfulness. - Baolong Bi; Shaohan Huang; Yiwei Wang 001; Tianchi Yang; Zihan Zhang; Haizhen Huang; Lingrui Mei; Junfeng Fang; Zehao Li; Furu Wei; Weiwei Deng; Feng Sun 008; et al. (ACL (Findings), 2025)

Assessing Dialect Fairness and Robustness of Large Language Models in Reasoning Tasks. - Fangru Lin; Shaoguang Mao; Emanuele La Malfa; Valentin Hofmann; Adrian de Wynter; Xun Wang 012; Si-Qing Chen; Michael J. Wooldridge; Janet B. Pierrehumbert; Furu Wei (ACL (1), 2025)

GeAR: Generation Augmented Retrieval. - Haoyu Liu; Shaohan Huang; Jianfeng Liu; Yuefeng Zhan; Hao Sun 015; Weiwei Deng; Feng Sun 008; Furu Wei; Qi Zhang 066 (ACL (Findings), 2025)

Autoregressive Speech Synthesis without Vector Quantization. - Lingwei Meng; Long Zhou; Shujie Liu 001; Sanyuan Chen; Bing Han 008; Shujie Hu; Yanqing Liu; Jinyu Li 001; Sheng Zhao; Xixin Wu; Helen M. Meng; Furu Wei (ACL (1), 2025)

Bitnet.cpp: Efficient Edge Inference for Ternary LLMs. - Jinheng Wang; Hansong Zhou; Ting Song; Shijie Cao; Yan Xia 005; Ting Cao; Jianyu Wei; Shuming Ma; Hongyu Wang; Furu Wei (ACL (1), 2025)

Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective. - Yiyao Yu; Yuxiang Zhang; Dongdong Zhang 001; Xiao Liang; Hengyuan Zhang; Xingxing Zhang 002; Mahmoud Khademi; Hany Hassan Awadalla; Junjie Wang; Yujiu Yang; Furu Wei (ACL (1), 2025)

ShifCon: Enhancing Non-Dominant Language Capabilities with a Shift-based Multilingual Contrastive Framework. - Hengyuan Zhang; Chenming Shang; Sizhe Wang; Dongdong Zhang; Yiyao Yu; Feng Yao; Renliang Sun; Yujiu Yang; Furu Wei (ACL (1), 2025)

MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmark. - Qihao Zhao; Yangyu Huang; Tengchao Lv; Lei Cui 001; Qinzheng Sun; Shaoguang Mao; Xin Zhang; Ying Xin; Qiufeng Yin; Scarlett Li; Furu Wei (ACL (1), 2025)

ALYMPICS: LLM Agents Meet Game Theory. - Shaoguang Mao; Yuzhe Cai; Yan Xia 005; Wenshan Wu; Xun Wang 012; Fengyi Wang; Qiang Guan; Tao Ge 001; Furu Wei (COLING, 2025)

PEACE: Empowering Geologic Map Holistic Understanding with MLLMs. - Yangyu Huang; Tianyi Gao; Haoran Xu; Qihao Zhao; Yang Song; Zhipeng Gui; Tengchao Lv; Hao Chen; Lei Cui 001; Scarlett Li; Furu Wei (CVPR, 2025)

Boosting Large Language Model for Speech Synthesis: An Empirical Study. - Hongkun Hao; Long Zhou; Shujie Liu 001; Jinyu Li 001; Shujie Hu; Rui Wang 073; Furu Wei (ICASSP, 2025)

Semi-Parametric Retrieval via Binary Bag-of-Tokens Index. - Jiawei Zhou 003; Li Dong 004; Furu Wei; Lei Chen 002 (ICLR, 2025)

Scaling Optimal LR Across Token Horizons. - Johan Bjorck; Alon Benhaim; Vishrav Chaudhary; Furu Wei; Xia Song (ICLR, 2025)

Self-Boosting Large Language Models with Synthetic Preference Data. - Qingxiu Dong; Li Dong 004; Xingxing Zhang 002; Zhifang Sui; Furu Wei (ICLR, 2025)

Data Selection via Optimal Control for Language Models. - Yuxian Gu; Li Dong 004; Hongning Wang; Yaru Hao; Qingxiu Dong; Furu Wei; Minlie Huang (ICLR, 2025)

Preference Optimization for Reasoning with Pseudo Feedback. - Fangkai Jiao; Geyang Guo; Xingxing Zhang; Nancy F. Chen; Shafiq Joty; Furu Wei (ICLR, 2025)

ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generation. - Zongyi Li; Shujie Hu; Shujie Liu 001; Long Zhou; Jeongsoo Choi; Lingwei Meng; Xun Guo; Jinyu Li 001; Hefei Ling; Furu Wei (ICLR, 2025)

Generative Representational Instruction Tuning. - Niklas Muennighoff; Hongjin Su; Liang Wang 046; Nan Yang 002; Furu Wei; Tao Yu 009; Amanpreet Singh; Douwe Kiela (ICLR, 2025)

Differential Transformer. - Tianzhu Ye; Li Dong 004; Yuqing Xia; Yutao Sun; Yi Zhu; Gao Huang 001; Furu Wei (ICLR, 2025)

Little Giants: Synthesizing High-Quality Embedding Data at Scale. - Haonan Chen 005; Liang Wang 046; Nan Yang 002; Yutao Zhu 001; Ziliang Zhao; Furu Wei; Zhicheng Dou (NAACL (Long Papers), 2025)

K-Level Reasoning: Establishing Higher Order Beliefs in Large Language Models for Strategic Reasoning. - Yadong Zhang; Shaoguang Mao; Tao Ge 001; Xun Wang 012; Yan Xia 005; Man Lan; Furu Wei (NAACL (Long Papers), 2025)

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models. - Haoran Li; Qingxiu Dong; Zhengyang Tang; Chaojun Wang; Xingxing Zhang 002; Haoyang Huang; Shaohan Huang; Xiaolong Huang; Zeqiang Huang; Dongdong Zhang 001; Yuxian Gu; Xin Cheng 002; et al. (Trans. Mach. Learn. Res., 2025)

Imagine while Reasoning in Space: Multimodal Visualization-of-Thought. - Chengzu Li; Wenshan Wu; Huanyu Zhang; Yan Xia 005; Shaoguang Mao; Li Dong 004; Ivan Vulic; Furu Wei (CoRR, 2025)

Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective. - Yiyao Yu; Yuxiang Zhang; Dongdong Zhang; Xiao Liang; Hengyuan Zhang; Xingxing Zhang; Ziyi Yang; Mahmoud Khademi; Hany Awadalla; Junjie Wang 011; Yujiu Yang; Furu Wei (CoRR, 2025)

Chain-of-Retrieval Augmented Generation. - Liang Wang 046; Haonan Chen 005; Nan Yang 002; Xiaolong Huang; Zhicheng Dou; Furu Wei (CoRR, 2025)

Examining False Positives under Inference Scaling for Mathematical Reasoning. - Yu Wang; Nan Yang; Liang Wang; Furu Wei (CoRR, 2025)

Next Block Prediction: Video Generation via Semi-Autoregressive Modeling. - Shuhuai Ren; Shuming Ma; Xu Sun 001; Furu Wei (CoRR, 2025)

WildLong: Synthesizing Realistic Long-Context Instruction Data at Scale. - Jiaxi Li 001; Xingxing Zhang 002; Xun Wang 012; Xiaolong Huang; Li Dong 004; Liang Wang; Si-Qing Chen; Wei Lu 011; Furu Wei (CoRR, 2025)

Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning. - Wenkai Yang; Shuming Ma; Yankai Lin; Furu Wei (CoRR, 2025)

Scaling Laws of Synthetic Data for Language Models. - Zeyu Qin; Qingxiu Dong; Xingxing Zhang 002; Li Dong 004; Xiaolong Huang; Ziyi Yang; Mahmoud Khademi; Dongdong Zhang 001; Hany Hassan Awadalla; Yi R. Fung 001; Weizhu Chen; Minhao Cheng; et al. (CoRR, 2025)

Model as a Game: On Numerical and Spatial Consistency for Generative Games. - Jingye Chen; Yuzhong Zhao; Yupan Huang; Lei Cui 001; Li Dong 004; Tengchao Lv; Qifeng Chen; Furu Wei (CoRR, 2025)

BitNet b1.58 2B4T Technical Report. - Shuming Ma; Hongyu Wang; Shaohan Huang; Xingxing Zhang 002; Ying Hu; Ting Song; Yan Xia 005; Furu Wei (CoRR, 2025)

A Call for New Recipes to Enhance Spatial Reasoning in MLLMs. - Huanyu Zhang; Chengzu Li; Wenshan Wu; Shaoguang Mao; Yan Xia 005; Ivan Vulic; Zhang Zhang 001; Liang Wang 001; Tieniu Tan; Furu Wei (CoRR, 2025)

BitNet v2: Native 4-bit Activations with Hadamard Transformation for 1-bit LLMs. - Hongyu Wang 009; Shuming Ma; Furu Wei (CoRR, 2025)

Efficient RL Training for Reasoning Models via Length-Aware Optimization. - Danlong Yuan; Tian Xie; Shaohan Huang; Zhuocheng Gong; Huishuai Zhang; Chong Luo; Furu Wei; Dongyan Zhao 001 (CoRR, 2025)

Think Only When You Need with Large Hybrid-Reasoning Models. - Lingjie Jiang; Xun Wu; Shaohan Huang; Qingxiu Dong; Zewen Chi; Li Dong 004; Xingxing Zhang 002; Tengchao Lv; Lei Cui 001; Furu Wei (CoRR, 2025)

Reward Reasoning Model. - Jiaxin Guo; Zewen Chi; Li Dong 004; Qingxiu Dong; Xun Wu; Shaohan Huang; Furu Wei (CoRR, 2025)

On-Policy RL with Optimal Reward Baseline. - Yaru Hao; Li Dong 004; Xun Wu; Shaohan Huang; Zewen Chi; Furu Wei (CoRR, 2025)

Rectified Sparse Attention. - Yutao Sun; Tianzhu Ye; Li Dong 004; Yuqing Xia; Jian Chen; Yizhao Gao 002; Shijie Cao; Jianyong Wang 001; Furu Wei (CoRR, 2025)

Reinforcement Pre-Training. - Qingxiu Dong; Li Dong 004; Yao Tang; Tianzhu Ye; Yutao Sun; Zhifang Sui; Furu Wei (CoRR, 2025)

Reasoning with Exploration: An Entropy Perspective. - Daixuan Cheng; Shaohan Huang; Xuekai Zhu; Bo Dai 026; Wayne Xin Zhao; Zhenliang Zhang; Furu Wei (CoRR, 2025)

MoCa: Modality-aware Continual Pre-training Makes Better Bidirectional Multimodal Embeddings. - Haonan Chen 005; Hong Liu; Yuping Luo; Liang Wang 046; Nan Yang 002; Furu Wei; Zhicheng Dou (CoRR, 2025)

Geometric-Mean Policy Optimization. - Yuzhong Zhao; Yue Liu; Junpeng Liu; Jingye Chen; Xun Wu; Yaru Hao; Tengchao Lv; Shaohan Huang; Lei Cui 001; Qixiang Ye; Fang Wan 001; Furu Wei (CoRR, 2025)

VisCodex: Unified Multimodal Code Generation via Merging Vision and Coding Models. - Lingjie Jiang; Shaohan Huang; Xun Wu; Yixia Li; Dongdong Zhang; Furu Wei (CoRR, 2025)