FISF: Better User Experience using Smaller Bandwidth for Panoramic Virtual Reality Video. - Lun Wang 001; Damai Dai; Jie Jiang 008; Tong Yang 003; Xiaoke Jiang; Zekun Cai; Yang Li; Xiaoming Li 001 (CoRR, 2017)

Live Video Comment Generation Based on Surrounding Frames and Live Comments. - Damai Dai (CoRR, 2018)

Sememe Prediction: Learning Semantic Knowledge from Unstructured Textual Wiki Descriptions. - Wei Li 101; Xuancheng Ren; Damai Dai; Yunfang Wu; Houfeng Wang; Xu Sun 001 (CoRR, 2018)

LiveBot: Generating Live Video Comments Based on Visual and Textual Contexts. - Shuming Ma; Lei Cui 001; Damai Dai; Furu Wei; Xu Sun 001 (AAAI, 2019)

Learning to Control the Fine-grained Sentiment for Story Ending Generation. - Fuli Luo; Damai Dai; Pengcheng Yang; Tianyu Liu 001; Baobao Chang; Zhifang Sui; Xu Sun 001 (ACL (1), 2019)

Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions. - Damai Dai; Hua Zheng; Fuli Luo; Pengcheng Yang; Baobao Chang; Zhifang Sui (CoRR, 2020)

Behind the Scenes: An Exploration of Trigger Biases Problem in Few-Shot Event Classification. - Peiyi Wang; Runxin Xu; Tianyu Liu 001; Damai Dai; Baobao Chang; Zhifang Sui (CIKM, 2021)

Leveraging Word-Formation Knowledge for Chinese Word Sense Disambiguation. - Hua Zheng; Lei Li 039; Damai Dai; Deli Chen; Tianyu Liu 001; Xu Sun 001; Yang Liu 005 (EMNLP (Findings), 2021)

Decompose, Fuse and Generate: A Formation-Informed Method for Chinese Definition Generation. - Hua Zheng; Damai Dai; Lei Li 039; Tianyu Liu 001; Zhifang Sui; Baobao Chang; Yang Liu 124 (NAACL-HLT, 2021)

Inductively Representing Out-of-Knowledge-Graph Entities by Optimal Estimation Under Translational Assumptions. - Damai Dai; Hua Zheng; Fuli Luo; Pengcheng Yang; Tianyu Liu 001; Zhifang Sui; Baobao Chang (RepL4NLP@ACL-IJCNLP, 2021)

Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension. - Damai Dai; Hua Zheng; Zhifang Sui; Baobao Chang (CoRR, 2021)

Knowledge Neurons in Pretrained Transformers. - Damai Dai; Li Dong 004; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2021)

Explicit Interaction Network for Aspect Sentiment Triplet Extraction. - Peiyi Wang; Lianzhe Huang; Tianyu Liu 001; Damai Dai; Runxin Xu; Houfeng Wang; Baobao Chang; Zhifang Sui (CoRR, 2021)

StableMoE: Stable Routing Strategy for Mixture of Experts. - Damai Dai; Li Dong 004; Shuming Ma; Bo Zheng 010; Zhifang Sui; Baobao Chang; Furu Wei (ACL (1), 2022)

Knowledge Neurons in Pretrained Transformers. - Damai Dai; Li Dong 004; Yaru Hao; Zhifang Sui; Baobao Chang; Furu Wei (ACL (1), 2022)

Hierarchical Curriculum Learning for AMR Parsing. - Peiyi Wang; Liang Chen 024; Tianyu Liu 001; Damai Dai; Yunbo Cao; Baobao Chang; Zhifang Sui (ACL (2), 2022)

Calibrating Factual Knowledge in Pretrained Language Models. - Qingxiu Dong; Damai Dai; Yifan Song; Jingjing Xu 001; Zhifang Sui; Lei Li 005 (EMNLP (Findings), 2022)

Robust Fine-tuning via Perturbation and Interpolation from In-batch Instances. - Shoujie Tong; Qingxiu Dong; Damai Dai; Yifan Song 002; Tianyu Liu 001; Baobao Chang; Zhifang Sui (IJCAI, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

Plug-and-Play Module for Commonsense Reasoning in Machine Reading Comprehension. - Damai Dai; Hua Zheng; Zhifang Sui; Baobao Chang (NLPCC (2), 2022)

Mixture of Experts for Biomedical Question Answering. - Damai Dai; Wenbin Jiang 002; Jiyuan Zhang; Weihua Peng; Yajuan Lyu; Zhifang Sui; Baobao Chang; Yong Zhu 004 (CoRR, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Neural Knowledge Bank for Pretrained Transformers. - Damai Dai; Wenbin Jiang 002; Qingxiu Dong; Yajuan Lyu; Qiaoqiao She; Zhifang Sui (CoRR, 2022)

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. - Damai Dai; Yutao Sun; Li Dong 004; Yaru Hao; Zhifang Sui; Furu Wei (CoRR, 2022)

Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. - Damai Dai; Yutao Sun; Li Dong 004; Yaru Hao; Shuming Ma; Zhifang Sui; Furu Wei (ACL (Findings), 2023)

Denoising Bottleneck with Mutual Information Maximization for Video Multimodal Fusion. - Shaoxiang Wu; Damai Dai; Ziwei Qin; Tianyu Liu 001; Binghuai Lin; Yunbo Cao; Zhifang Sui (ACL (1), 2023)

Bi-Drop: Enhancing Fine-tuning Generalization via Synchronous sub-net Estimation and Optimization. - Shoujie Tong; Heming Xia; Damai Dai; Runxin Xu; Tianyu Liu; Binghuai Lin; Yunbo Cao; Zhifang Sui (EMNLP (Findings), 2023)

Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning. - Lean Wang; Lei Li 039; Damai Dai; Deli Chen; Hao Zhou 012; Fandong Meng; Jie Zhou 016; Xu Sun 001 (EMNLP, 2023)

Not All Demonstration Examples are Equally Beneficial: Reweighting Demonstration Examples for In-Context Learning. - Zhe Yang 013; Damai Dai; Peiyi Wang; Zhifang Sui (EMNLP (Findings), 2023)

Neural Knowledge Bank for Pretrained Transformers. - Damai Dai; Wenbin Jiang 002; Qingxiu Dong; Yajuan Lyu; Zhifang Sui (NLPCC (2), 2023)

Mixture-of-Experts for Biomedical Question Answering. - Damai Dai; Wenbin Jiang 002; Jiyuan Zhang; Yajuan Lyu; Zhifang Sui; Baobao Chang (NLPCC (1), 2023)

Coarse-to-Fine Entity Representations for Document-Level Relation Extraction. - Damai Dai; Jing Ren; Shuang Zeng; Baobao Chang; Zhifang Sui (NLPCC (2), 2023)

A Survey for In-context Learning. - Qingxiu Dong; Lei Li 039; Damai Dai; Ce Zheng; Zhiyong Wu 011; Baobao Chang; Xu Sun 001; Jingjing Xu 001; Lei Li 005; Zhifang Sui (CoRR, 2023)

Bi-Drop: Generalizable Fine-tuning for Pre-trained Language Models via Adaptive Subnetwork Optimization. - Shoujie Tong; Heming Xia; Damai Dai; Tianyu Liu 001; Binghuai Lin; Yunbo Cao; Zhifang Sui (CoRR, 2023)

Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations. - Peiyi Wang; Lei Li 039; Zhihong Shao; R. X. Xu; Damai Dai; Yifei Li 005; Deli Chen; Y. Wu; Zhifang Sui (CoRR, 2023)

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models. - Damai Dai; Chengqi Deng; Chenggang Zhao; R. X. Xu; Huazuo Gao; Deli Chen; Jiashi Li; Wangding Zeng; Xingkai Yu; Y. Wu; Zhenda Xie; Y. K. Li; et al. (ACL (1), 2024)

Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations. - Peiyi Wang; Lei Li 039; Zhihong Shao; Runxin Xu; Damai Dai; Yifei Li 005; Deli Chen; Yu Wu; Zhifang Sui (ACL (1), 2024)

A Survey on In-context Learning. - Qingxiu Dong; Lei Li 039; Damai Dai; Ce Zheng; Jingyuan Ma; Rui Li 094; Heming Xia; Jingjing Xu 001; Zhiyong Wu 011; Baobao Chang; Xu Sun 001; Lei Li 005; et al. (EMNLP, 2024)

Let the Expert Stick to His Last: Expert-Specialized Fine-Tuning for Sparse Architectural Large Language Models. - Zihan Wang 010; Deli Chen; Damai Dai; Runxin Xu; Zhuoshu Li; Yu Wu (EMNLP, 2024)

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism. - Xiao Bi; Deli Chen; Guanting Chen 002; Shanhuang Chen; Damai Dai; Chengqi Deng; Honghui Ding; Kai Dong 003; Qiushi Du; Zhe Fu; Huazuo Gao; Kaige Gao; et al. (CoRR, 2024)

Language Models Understand Numbers, at Least Partially. - Fangwei Zhu; Damai Dai; Zhifang Sui (CoRR, 2024)

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization. - Xiangdi Meng; Damai Dai; Weiyao Luo; Zhe Yang 013; Shaoxiang Wu; Xiaochen Wang; Peiyi Wang; Qingxiu Dong; Liang Chen 024; Zhifang Sui (CoRR, 2024)

Large Language Models Are Unconscious of Unreasonability in Math Problems. - Jingyuan Ma; Damai Dai; Zhifang Sui (CoRR, 2024)

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model. - DeepSeek-AI; Aixin Liu; Bei Feng; Bin Wang 065; Bingxuan Wang; Bo Liu 039; Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Daya Guo; Dejian Yang; et al. (CoRR, 2024)

Exploring Activation Patterns of Parameters in Language Models. - Yudong Wang 005; Damai Dai; Zhifang Sui (CoRR, 2024)

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence. - DeepSeek-AI; Qihao Zhu; Daya Guo; Zhihong Shao; Dejian Yang; Peiyi Wang; Runxin Xu; Y. Wu; Yukun Li; Huazuo Gao; Shirong Ma; Wangding Zeng; et al. (CoRR, 2024)

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts. - Lean Wang; Huazuo Gao; Chenggang Zhao; Xu Sun 001; Damai Dai (CoRR, 2024)

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding. - Zhiyu Wu; Xiaokang Chen; Zizheng Pan; Xingchao Liu; Wen Liu; Damai Dai; Huazuo Gao; Yiyang Ma; Chengyue Wu; Bingxuan Wang; Zhenda Xie; Yu Wu; et al. (CoRR, 2024)

DeepSeek-V3 Technical Report. - DeepSeek-AI; Aixin Liu; Bei Feng; Bing Xue; Bingxuan Wang; Bochao Wu; Chengda Lu; Chenggang Zhao; Chengqi Deng; Chenyu Zhang; Chong Ruan; Damai Dai; et al. (CoRR, 2024)

Exploring Activation Patterns of Parameters in Language Models. - Yudong Wang 005; Damai Dai; Zhe Yang 013; Jingyuan Ma; Zhifang Sui (AAAI, 2025)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Yuxing Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (ACL (1), 2025)

Language Models Encode the Value of Numbers Linearly. - Fangwei Zhu; Damai Dai; Zhifang Sui (COLING, 2025)

Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures. - Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Huazuo Gao; Jiashi Li; Liyue Zhang; Panpan Huang; Shangyan Zhou; Shirong Ma; Wenfeng Liang; Ying He; et al. (ISCA, 2025)

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. - DeepSeek-AI; Daya Guo; Dejian Yang; Haowei Zhang; Junxiao Song; Ruoyu Zhang; Runxin Xu; Qihao Zhu; Shirong Ma; Peiyi Wang; Xiao Bi; Xiaokang Zhang; et al. (CoRR, 2025)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Y. X. Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (CoRR, 2025)

Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures. - Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Huazuo Gao; Jiashi Li; Liyue Zhang; Panpan Huang; Shangyan Zhou; Shirong Ma; Wenfeng Liang; Ying He; et al. (CoRR, 2025)