Performance of Local Information Based Link Prediction: A Sampling Perspective - Jichang Zhao; Xu Feng; Li Dong 004; Xiao Liang 004; Ke Xu 001 (CoRR, 2011)

MoodLens: an emoticon-based sentiment analysis system for chinese tweets. - Jichang Zhao; Li Dong 004; Junjie Wu 002; Ke Xu 001 (KDD, 2012)

Modeling collective human mobility: Understanding exponential law of intra-urban movement - Xiao Liang 004; Jichang Zhao; Li Dong 004; Ke Xu 001 (CoRR, 2012)

The Automated Acquisition of Suggestions from Tweets. - Li Dong 004; Furu Wei; Yajuan Duan; Xiaohua Liu; Ming Zhou 001; Ke Xu 001 (AAAI, 2013)

Unraveling the origin of exponential law in intra-urban human mobility - Xiao Liang 004; Jichang Zhao; Li Dong 004; Ke Xu 001 (CoRR, 2013)

Adaptive Multi-Compositionality for Recursive Neural Models with Applications to Sentiment Analysis. - Li Dong 004; Furu Wei; Ming Zhou 001; Ke Xu 001 (AAAI, 2014)

Adaptive Recursive Neural Network for Target-dependent Twitter Sentiment Classification. - Li Dong 004; Furu Wei; Chuanqi Tan; Duyu Tang; Ming Zhou 001; Ke Xu 001 (ACL (2), 2014)

A Joint Segmentation and Classification Framework for Sentiment Analysis. - Duyu Tang; Furu Wei; Bing Qin 001; Li Dong 004; Ting Liu 001; Ming Zhou 001 (EMNLP, 2014)

Ranking with Recursive Neural Networks and Its Application to Multi-Document Summarization. - Ziqiang Cao; Furu Wei; Li Dong 004; Sujian Li; Ming Zhou 001 (AAAI, 2015)

Question Answering over Freebase with Multi-Column Convolutional Neural Networks. - Li Dong 004; Furu Wei; Ming Zhou 001; Ke Xu 001 (ACL (1), 2015)

A Hybrid Neural Model for Type Classification of Entity Mentions. - Li Dong 004; Furu Wei; Hong Sun; Ming Zhou 001; Ke Xu 001 (IJCAI, 2015)

Splusplus: A Feature-Rich Two-stage Classifier for Sentiment Analysis of Tweets. - Li Dong 004; Furu Wei; Yichun Yin; Ming Zhou 001; Ke Xu 001 (SemEval@NAACL-HLT, 2015)

A Statistical Parsing Framework for Sentiment Classification. - Li Dong 004; Furu Wei; Shujie Liu 001; Ming Zhou 001; Ke Xu 001 (Comput. Linguistics, 2015)

A Joint Segmentation and Classification Framework for Sentence Level Sentiment Classification. - Duyu Tang; Bing Qin 001; Furu Wei; Li Dong 004; Ting Liu 001; Ming Zhou 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2015)

Language to Logical Form with Neural Attention. - Li Dong 004; Mirella Lapata (ACL (1), 2016)

Long Short-Term Memory-Networks for Machine Reading. - Jianpeng Cheng 001; Li Dong 004; Mirella Lapata (EMNLP, 2016)

Solving and Generating Chinese Character Riddles. - Chuanqi Tan; Furu Wei; Li Dong 004; Weifeng Lv; Ming Zhou 001 (EMNLP, 2016)

Unsupervised Word and Dependency Path Embeddings for Aspect Term Extraction. - Yichun Yin; Furu Wei; Li Dong 004; Kaimeng Xu; Ming Zhang 004; Ming Zhou 001 (IJCAI, 2016)

Adaptive Multi-Compositionality for Recursive Neural Network Models. - Li Dong 004; Furu Wei; Ke Xu 001; Shixia Liu; Ming Zhou 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2016)

Learning to Generate Product Reviews from Attributes. - Li Dong 004; Shaohan Huang; Furu Wei; Mirella Lapata; Ming Zhou 001; Ke Xu 001 (EACL (1), 2017)

Learning to Paraphrase for Question Answering. - Li Dong 004; Jonathan Mallinson; Siva Reddy; Mirella Lapata (EMNLP, 2017)

Proactive Resource Management in LTE-U Systems: A Deep Learning Perspective. - Ursula Challita; Li Dong 004; Walid Saad (CoRR, 2017)

Coarse-to-Fine Decoding for Neural Semantic Parsing. - Li Dong 004; Mirella Lapata (ACL (1), 2018)

Confidence Modeling for Neural Semantic Parsing. - Li Dong 004; Chris Quirk; Mirella Lapata (ACL (1), 2018)

Proactive Resource Management for LTE in Unlicensed Spectrum: A Deep Learning Perspective. - Ursula Challita; Li Dong 004; Walid Saad (IEEE Trans. Wirel. Commun., 2018)

Data-to-Text Generation with Content Selection and Planning. - Ratish Puduppully; Li Dong 004; Mirella Lapata (AAAI, 2019)

Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension. - Hangbo Bao; Li Dong 004; Furu Wei; Wenhui Wang 003; Nan Yang 002; Lei Cui 001; Songhao Piao; Ming Zhou 001 (MRQA@EMNLP, 2019)

Data-to-text Generation with Entity Modeling. - Ratish Puduppully; Li Dong 004; Mirella Lapata (ACL (1), 2019)

Learning to Ask Unanswerable Questions for Machine Reading Comprehension. - Haichao Zhu; Li Dong 004; Furu Wei; Wenhui Wang 003; Bing Qin 001; Ting Liu 001 (ACL (1), 2019)

Visualizing and Understanding the Effectiveness of BERT. - Yaru Hao; Li Dong 004; Furu Wei; Ke Xu 001 (EMNLP/IJCNLP (1), 2019)

Unified Language Model Pre-training for Natural Language Understanding and Generation. - Li Dong 004; Nan Yang 002; Wenhui Wang 003; Furu Wei; Xiaodong Liu 003; Yu Wang 009; Jianfeng Gao 001; Ming Zhou 001; Hsiao-Wuen Hon (NeurIPS, 2019)

Multitask learning for biomedical named entity recognition with cross-sharing structure. - Xi Wang; Jiagao Lyu; Li Dong 004; Ke Xu 001 (BMC Bioinform., 2019)

Cross-Lingual Natural Language Generation via Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Wenhui Wang 003; Xian-Ling Mao; Heyan Huang (AAAI, 2020)

Harvesting and Refining Question-Answer Pairs for Unsupervised QA. - Zhongli Li; Wenhui Wang 003; Li Dong 004; Furu Wei; Ke Xu 001 (ACL, 2020)

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks. - Xiujun Li; Xi Yin 006; Chunyuan Li; Pengchuan Zhang; Xiaowei Hu 006; Lei Zhang 001; Lijuan Wang; Houdong Hu; Li Dong 004; Furu Wei; Yejin Choi 001; Jianfeng Gao 001 (ECCV (30), 2020)

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training. - Hangbo Bao; Li Dong 004; Furu Wei; Wenhui Wang 003; Nan Yang 002; Xiaodong Liu 003; Yu Wang 009; Jianfeng Gao 001; Songhao Piao; Ming Zhou 001; Hsiao-Wuen Hon (ICML, 2020)

Can Monolingual Pretrained Models Help Cross-Lingual Classification? - Zewen Chi; Li Dong 004; Furu Wei; Xianling Mao; Heyan Huang (AACL/IJCNLP, 2020)

Investigating Learning Dynamics of BERT Fine-Tuning. - Yaru Hao; Li Dong 004; Furu Wei; Ke Xu 001 (AACL/IJCNLP, 2020)

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers. - Wenhui Wang 003; Furu Wei; Li Dong 004; Hangbo Bao; Nan Yang 002; Ming Zhou 001 (NeurIPS, 2020)

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. - Shuming Ma; Jian Yang 030; Haoyang Huang; Zewen Chi; Li Dong 004; Dongdong Zhang 001; Hany Hassan Awadalla; Alexandre Muzio; Akiko Eriguchi; Saksham Singhal; Xia Song; Arul Menezes; et al. (CoRR, 2020)

Self-Attention Attribution: Interpreting Information Interactions Inside Transformer. - Yaru Hao; Li Dong 004; Furu Wei; Ke Xu 001 (AAAI, 2021)

Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. - Zewen Chi; Li Dong 004; Bo Zheng 010; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL/IJCNLP (1), 2021)

Learning to Sample Replacements for ELECTRA Pre-Training. - Yaru Hao; Li Dong 004; Hangbo Bao; Ke Xu 001; Furu Wei (ACL/IJCNLP (Findings), 2021)

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers. - Wenhui Wang 003; Hangbo Bao; Shaohan Huang; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Adapt-and-Distill: Developing Small, Fast and Effective Pretrained Language Models for Domains. - Yunzhi Yao; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Furu Wei (ACL/IJCNLP (Findings), 2021)

Memory-Efficient Differentiable Transformer Architecture Search. - Yuekai Zhao; Li Dong 004; Yelong Shen; Zhihua Zhang; Furu Wei; Weizhu Chen (ACL/IJCNLP (Findings), 2021)

Consistency Regularization for Cross-Lingual Fine-Tuning. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (ACL/IJCNLP (1), 2021)

Zero-Shot Cross-Lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders. - Guanhua Chen 001; Shuming Ma; Yun Chen 007; Li Dong 004; Dongdong Zhang 001; Jia Pan 001; Wenping Wang 001; Furu Wei (EMNLP (1), 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Saksham Singhal; Xian-Ling Mao; Heyan Huang; Xia Song; Furu Wei (EMNLP (1), 2021)

Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (EMNLP (1), 2021)

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Nan Yang 002; Saksham Singhal; Wenhui Wang 003; Xia Song; Xian-Ling Mao; Heyan Huang; Ming Zhou 001 (NAACL-HLT, 2021)

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. - Jian Yang 030; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Li Dong 004; Shaohan Huang; Alexandre Muzio; Saksham Singhal; Hany Hassan; Xia Song; Furu Wei (WMT@EMNLP, 2021)

Learning natural language interfaces with neural models. - Li Dong 004 (AI Matters, 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (CoRR, 2021)

Knowledge Neurons in Pretrained Transformers. - Damai Dai; Li Dong 004; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2021)

BEiT: BERT Pre-Training of Image Transformers. - Hangbo Bao; Li Dong 004; Furu Wei (CoRR, 2021)

DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. - Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Alexandre Muzio; Saksham Singhal; Hany Hassan Awadalla; Xia Song; Furu Wei (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2021)

s2s-ft: Fine-Tuning Pretrained Transformer Encoders for Sequence-to-Sequence Learning. - Hangbo Bao; Li Dong 004; Wenhui Wang 003; Nan Yang 002; Furu Wei (CoRR, 2021)

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Furu Wei (CoRR, 2021)

CLIP Models are Few-Shot Learners: Empirical Studies on VQA and Visual Entailment. - Haoyu Song 002; Li Dong 004; Weinan Zhang 003; Ting Liu 001; Furu Wei (ACL (1), 2022)

THE-X: Privacy-Preserving Transformer Inference with Homomorphic Encryption. - Tianyu Chen; Hangbo Bao; Shaohan Huang; Li Dong 004; Binxing Jiao; Daxin Jiang; Haoyi Zhou; Jianxin Li 002; Furu Wei (ACL (Findings), 2022)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Bo Zheng 010; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL (1), 2022)

StableMoE: Stable Routing Strategy for Mixture of Experts. - Damai Dai; Li Dong 004; Shuming Ma; Bo Zheng 010; Zhifang Sui; Baobao Chang; Furu Wei (ACL (1), 2022)

Knowledge Neurons in Pretrained Transformers. - Damai Dai; Li Dong 004; Yaru Hao; Zhifang Sui; Baobao Chang; Furu Wei (ACL (1), 2022)

Controllable Natural Language Generation with Contrastive Prefixes. - Jing Qian; Li Dong 004; Yelong Shen; Furu Wei; Weizhu Chen (ACL (Findings), 2022)

Swin Transformer V2: Scaling Up Capacity and Resolution. - Ze Liu; Han Hu 001; Yutong Lin; Zhuliang Yao; Zhenda Xie; Yixuan Wei; Jia Ning; Yue Cao 001; Zheng Zhang 022; Li Dong 004; Furu Wei; Baining Guo (CVPR, 2022)

CROP: Zero-shot Cross-lingual Named Entity Recognition with Multilingual Labeled Sequence Translation. - Jian Yang 030; Shaohan Huang; Shuming Ma; Yuwei Yin; Li Dong 004; Dongdong Zhang 001; Hongcheng Guo; Zhoujun Li 001; Furu Wei (EMNLP (Findings), 2022)

BEiT: BERT Pre-Training of Image Transformers. - Hangbo Bao; Li Dong 004; Songhao Piao; Furu Wei (ICLR, 2022)

VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts. - Hangbo Bao; Wenhui Wang 003; Li Dong 004; Qiang Liu; Owais Khan Mohammed; Kriti Aggarwal; Subhojit Som; Songhao Piao; Furu Wei (NeurIPS, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

Kformer: Knowledge Injection in Transformer Feed-Forward Layers. - Yunzhi Yao; Shaohan Huang; Li Dong 004; Furu Wei; Huajun Chen; Ningyu Zhang 001 (NLPCC (1), 2022)

A Survey of Knowledge-Intensive NLP with Pre-Trained Language Models. - Da Yin; Li Dong 004; Hao Cheng 002; Xiaodong Liu 003; Kai-Wei Chang; Furu Wei; Jianfeng Gao 001 (CoRR, 2022)

DeepNet: Scaling Transformers to 1, 000 Layers. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Furu Wei (CoRR, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Prototypical Calibration for Few-shot Learning of Language Models. - Zhixiong Han; Yaru Hao; Li Dong 004; Furu Wei (CoRR, 2022)

VL-BEiT: Generative Vision-Language Pretraining. - Hangbo Bao; Wenhui Wang 003; Li Dong 004; Furu Wei (CoRR, 2022)

Language Models are General-Purpose Interfaces. - Yaru Hao; Haoyu Song 002; Li Dong 004; Shaohan Huang; Zewen Chi; Wenhui Wang 003; Shuming Ma; Furu Wei (CoRR, 2022)

BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers. - Zhiliang Peng; Li Dong 004; Hangbo Bao; Qixiang Ye; Furu Wei (CoRR, 2022)

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CoRR, 2022)

Foundation Transformers. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (CoRR, 2022)

TorchScale: Transformers at Scale. - Shuming Ma; Hongyu Wang 009; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Li Dong 004; Alon Benhaim; Barun Patra; Vishrav Chaudhary; Xia Song; Furu Wei (CoRR, 2022)

Extensible Prompts for Language Models. - Tao Ge 001; Jing Hu 001; Li Dong 004; Shaoguang Mao; Yan Xia 005; Xun Wang 012; Si-Qing Chen; Furu Wei (CoRR, 2022)

Structured Prompting: Scaling In-Context Learning to 1, 000 Examples. - Yaru Hao; Yutao Sun; Li Dong 004; Zhixiong Han; Yuxian Gu; Furu Wei (CoRR, 2022)

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. - Damai Dai; Yutao Sun; Li Dong 004; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2022)

Transforming Wikipedia Into Augmented Data for Query-Focused Summarization. - Haichao Zhu; Li Dong 004; Furu Wei; Bing Qin 001; Ting Liu 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2022)

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. - Damai Dai; Yutao Sun; Li Dong 004; Yaru Hao; Shuming Ma; Zhifang Sui; Furu Wei (ACL (Findings), 2023)

Pre-Training to Learn in Context. - Yuxian Gu; Li Dong 004; Furu Wei; Minlie Huang (ACL (1), 2023)

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. - Barun Patra; Saksham Singhal; Shaohan Huang; Zewen Chi; Li Dong 004; Furu Wei; Vishrav Chaudhary; Xia Song (ACL (1), 2023)

A Length-Extrapolatable Transformer. - Yutao Sun; Li Dong 004; Barun Patra; Shuming Ma; Shaohan Huang; Alon Benhaim; Vishrav Chaudhary; Xia Song; Furu Wei (ACL (1), 2023)

GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. - Jian Yang 030; Shuming Ma; Li Dong 004; Shaohan Huang; Haoyang Huang; Yuwei Yin; Dongdong Zhang 001; Liqun Yang; Furu Wei; Zhoujun Li 001 (ACL (1), 2023)

Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CVPR, 2023)

Non-Contrastive Learning Meets Language-Image Pre-Training. - Jinghao Zhou; Li Dong 004; Zhe Gan; Lijuan Wang; Furu Wei (CVPR, 2023)

Corrupted Image Modeling for Self-Supervised Visual Pre-Training. - Yuxin Fang; Li Dong 004; Hangbo Bao; Xinggang Wang; Furu Wei (ICLR, 2023)

Prototypical Calibration for Few-shot Learning of Language Models. - Zhixiong Han; Yaru Hao; Li Dong 004; Yutao Sun; Furu Wei (ICLR, 2023)

Visually-Augmented Language Modeling. - Weizhi Wang; Li Dong 004; Hao Cheng 002; Haoyu Song 002; Xiaodong Liu 003; Xifeng Yan; Jianfeng Gao 001; Furu Wei (ICLR, 2023)

Magneto: A Foundation Transformer. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (ICML, 2023)

Extensible Prompts for Language Models on Zero-shot Language Style Customization. - Tao Ge 001; Jing Hu 001; Li Dong 004; Shaoguang Mao; Yan Xia 005; Xun Wang 012; Si-Qing Chen; Furu Wei (NeurIPS, 2023)

Optimizing Prompts for Text-to-Image Generation. - Yaru Hao; Zewen Chi; Li Dong 004; Furu Wei (NeurIPS, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

Augmenting Language Models with Long-Term Memory. - Weizhi Wang; Li Dong 004; Hao Cheng 002; Xiaodong Liu 003; Xifeng Yan; Jianfeng Gao 001; Furu Wei (NeurIPS, 2023)

Knowledge Distillation of Large Language Models. - Yuxian Gu; Li Dong 004; Furu Wei; Minlie Huang (CoRR, 2023)

Kosmos-2: Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Furu Wei (CoRR, 2023)

LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens. - Jiayu Ding; Shuming Ma; Li Dong 004; Xingxing Zhang 002; Shaohan Huang; Wenhui Wang 003; Nanning Zheng 001; Furu Wei (CoRR, 2023)

Retentive Network: A Successor to Transformer for Large Language Models. - Yutao Sun; Li Dong 004; Shaohan Huang; Shuming Ma; Yuqing Xia; Jilong Xue; Jianyong Wang 001; Furu Wei (CoRR, 2023)

Large Language Model for Science: A Study on P vs. NP. - Qingxiu Dong; Li Dong 004; Ke Xu 001; Guangyan Zhou; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2023)

Kosmos-2.5: A Multimodal Literate Model. - Tengchao Lv; Yupan Huang; Jingye Chen; Lei Cui 001; Shuming Ma; Yaoyao Chang; Shaohan Huang; Wenhui Wang 003; Li Dong 004; Weiyao Luo; Shaoxiang Wu; Guoxin Wang; et al. (CoRR, 2023)

BitNet: Scaling 1-bit Transformers for Large Language Models. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Huaijie Wang; Lingxiao Ma; Fan Yang 024; Ruiping Wang; Yi Wu 013; Furu Wei (CoRR, 2023)

A Unified View of Masked Image Modeling. - Zhiliang Peng; Li Dong 004; Hangbo Bao; Furu Wei; Qixiang Ye (Trans. Mach. Learn. Res., 2023)

Language Models as Inductive Reasoners. - Zonglin Yang 001; Li Dong 004; Xinya Du; Hao Cheng 002; Erik Cambria; Xiaodong Liu 003; Jianfeng Gao 001; Furu Wei (EACL (1), 2024)

MiniLLM: Knowledge Distillation of Large Language Models. - Yuxian Gu; Li Dong 004; Furu Wei; Minlie Huang (ICLR, 2024)

Kosmos-G: Generating Images in Context with Multimodal Large Language Models. - Xichen Pan; Li Dong 004; Shaohan Huang; Zhiliang Peng; Wenhu Chen; Furu Wei (ICLR, 2024)

Grounding Multimodal Large Language Models to the World. - Zhiliang Peng; Wenhui Wang 003; Li Dong 004; Yaru Hao; Shaohan Huang; Shuming Ma; Qixiang Ye; Furu Wei (ICLR, 2024)

KOSMOS-E : Learning to Follow Instruction for Robotic Grasping. - Zhi Wang; Xun Wu; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Shuming Ma; Furu Wei (IROS, 2024)

You Only Cache Once: Decoder-Decoder Architectures for Language Models. - Yutao Sun; Li Dong 004; Yi Zhu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Quanlu Zhang; Jianyong Wang 001; Furu Wei (NeurIPS, 2024)

Multi-Head Mixture-of-Experts. - Xun Wu; Shaohan Huang; Wenhui Wang 003; Shuming Ma; Li Dong 004; Furu Wei (NeurIPS, 2024)

Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models. - Wenshan Wu; Shaoguang Mao; Yadong Zhang; Yan Xia 005; Li Dong 004; Lei Cui 001; Furu Wei (NeurIPS, 2024)

Towards Optimal Learning of Language Models. - Yuxian Gu; Li Dong 004; Yaru Hao; Qingxiu Dong; Minlie Huang; Furu Wei (CoRR, 2024)

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. - Shuming Ma; Hongyu Wang 009; Lingxiao Ma; Lei Wang 222; Wenhui Wang 003; Shaohan Huang; Li Dong 004; Ruiping Wang; Jilong Xue; Furu Wei (CoRR, 2024)

Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models. - Wenshan Wu; Shaoguang Mao; Yadong Zhang; Yan Xia 005; Li Dong 004; Lei Cui 001; Furu Wei (CoRR, 2024)

Semi-Parametric Retrieval via Binary Token Index. - Jiawei Zhou 003; Li Dong 004; Furu Wei; Lei Chen 002 (CoRR, 2024)

Direct Preference Knowledge Distillation for Large Language Models. - Yixing Li; Yuxian Gu; Li Dong 004; Dequan Wang; Yu Cheng; Furu Wei (CoRR, 2024)

RedStone: Curating General, Code, Math, and QA Data for Large Language Models. - Yaoyao Chang; Lei Cui 001; Li Dong 004; Shaohan Huang; Yangyu Huang; Yupan Huang; Scarlett Li; Tengchao Lv; Shuming Ma; Qinzheng Sun; Wenhui Wang 003; Furu Wei; et al. (CoRR, 2024)

Multimodal Latent Language Modeling with Next-Token Diffusion. - Yutao Sun; Hangbo Bao; Wenhui Wang 003; Zhiliang Peng; Li Dong 004; Shaohan Huang; Jianyong Wang 001; Furu Wei (CoRR, 2024)

Fine-tuning pretrained transformer encoders for sequence-to-sequence learning. - Hangbo Bao; Li Dong 004; Wenhui Wang 003; Nan Yang 002; Songhao Piao; Furu Wei (Int. J. Mach. Learn. Cybern., 2024)

Generic-to-Specific Distillation of Masked Autoencoders. - Wei Huang; Zhiliang Peng; Li Dong 004; Furu Wei; Qixiang Ye; Jianbin Jiao (IEEE Trans. Circuits Syst. Video Technol., 2024)

DeepNet: Scaling Transformers to 1,000 Layers. - Hongyu Wang 009; Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Furu Wei (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

Semi-Parametric Retrieval via Binary Bag-of-Tokens Index. - Jiawei Zhou 003; Li Dong 004; Furu Wei; Lei Chen 002 (ICLR, 2025)

Self-Boosting Large Language Models with Synthetic Preference Data. - Qingxiu Dong; Li Dong 004; Xingxing Zhang 002; Zhifang Sui; Furu Wei (ICLR, 2025)

Data Selection via Optimal Control for Language Models. - Yuxian Gu; Li Dong 004; Hongning Wang; Yaru Hao; Qingxiu Dong; Furu Wei; Minlie Huang (ICLR, 2025)

Differential Transformer. - Tianzhu Ye; Li Dong 004; Yuqing Xia; Yutao Sun; Yi Zhu; Gao Huang 001; Furu Wei (ICLR, 2025)

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models. - Haoran Li; Qingxiu Dong; Zhengyang Tang; Chaojun Wang; Xingxing Zhang 002; Haoyang Huang; Shaohan Huang; Xiaolong Huang; Zeqiang Huang; Dongdong Zhang 001; Yuxian Gu; Xin Cheng 002; et al. (Trans. Mach. Learn. Res., 2025)

Imagine while Reasoning in Space: Multimodal Visualization-of-Thought. - Chengzu Li; Wenshan Wu; Huanyu Zhang; Yan Xia 005; Shaoguang Mao; Li Dong 004; Ivan Vulic; Furu Wei (CoRR, 2025)

WildLong: Synthesizing Realistic Long-Context Instruction Data at Scale. - Jiaxi Li 001; Xingxing Zhang 002; Xun Wang 012; Xiaolong Huang; Li Dong 004; Liang Wang; Si-Qing Chen; Wei Lu 011; Furu Wei (CoRR, 2025)

Scaling Laws of Synthetic Data for Language Models. - Zeyu Qin; Qingxiu Dong; Xingxing Zhang 002; Li Dong 004; Xiaolong Huang; Ziyi Yang; Mahmoud Khademi; Dongdong Zhang 001; Hany Hassan Awadalla; Yi R. Fung 001; Weizhu Chen; Minhao Cheng; et al. (CoRR, 2025)

Model as a Game: On Numerical and Spatial Consistency for Generative Games. - Jingye Chen; Yuzhong Zhao; Yupan Huang; Lei Cui 001; Li Dong 004; Tengchao Lv; Qifeng Chen; Furu Wei (CoRR, 2025)

Think Only When You Need with Large Hybrid-Reasoning Models. - Lingjie Jiang; Xun Wu; Shaohan Huang; Qingxiu Dong; Zewen Chi; Li Dong 004; Xingxing Zhang 002; Tengchao Lv; Lei Cui 001; Furu Wei (CoRR, 2025)

Reward Reasoning Model. - Jiaxin Guo; Zewen Chi; Li Dong 004; Qingxiu Dong; Xun Wu; Shaohan Huang; Furu Wei (CoRR, 2025)

On-Policy RL with Optimal Reward Baseline. - Yaru Hao; Li Dong 004; Xun Wu; Shaohan Huang; Zewen Chi; Furu Wei (CoRR, 2025)

Rectified Sparse Attention. - Yutao Sun; Tianzhu Ye; Li Dong 004; Yuqing Xia; Jian Chen; Yizhao Gao 002; Shijie Cao; Jianyong Wang 001; Furu Wei (CoRR, 2025)

Reinforcement Pre-Training. - Qingxiu Dong; Li Dong 004; Yao Tang; Tianzhu Ye; Yutao Sun; Zhifang Sui; Furu Wei (CoRR, 2025)

SeerAttention-R: Sparse Attention Adaptation for Long Reasoning. - Yizhao Gao 002; Shuming Guo; Shijie Cao; Yuqing Xia; Yu Cheng; Lei Wang 222; Lingxiao Ma; Yutao Sun; Tianzhu Ye; Li Dong 004; Hayden Kwok-Hay So; Yu Hua; et al. (CoRR, 2025)