Gradient Knowledge Distillation for Pre-trained Language Models. - Lean Wang; Lei Li 039; Xu Sun 001 (CoRR, 2022)

Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning. - Lean Wang; Lei Li 039; Damai Dai; Deli Chen; Hao Zhou 012; Fandong Meng; Jie Zhou 016; Xu Sun 001 (EMNLP, 2023)

Towards Codable Text Watermarking for Large Language Models. - Lean Wang; Wenkai Yang; Deli Chen; Hao Zhou 012; Yankai Lin; Fandong Meng; Jie Zhou 016; Xu Sun 001 (CoRR, 2023)

Towards Codable Watermarking for Injecting Multi-Bits Information to LLMs. - Lean Wang; Wenkai Yang; Deli Chen; Hao Zhou 012; Yankai Lin; Fandong Meng; Jie Zhou 016; Xu Sun 001 (ICLR, 2024)

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model. - DeepSeek-AI; Aixin Liu; Bei Feng; Bin Wang 065; Bingxuan Wang; Bo Liu 039; Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Daya Guo; Dejian Yang; et al. (CoRR, 2024)

DeCo: Decoupling Token Compression from Semantic Abstraction in Multimodal Large Language Models. - Linli Yao; Lei Li 039; Shuhuai Ren; Lean Wang; Yuanxin Liu; Xu Sun 001; Lu Hou 002 (CoRR, 2024)

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts. - Lean Wang; Huazuo Gao; Chenggang Zhao; Xu Sun 001; Damai Dai (CoRR, 2024)

DeepSeek-V3 Technical Report. - DeepSeek-AI; Aixin Liu; Bei Feng; Bing Xue; Bingxuan Wang; Bochao Wu; Chengda Lu; Chenggang Zhao; Chengqi Deng; Chenyu Zhang; Chong Ruan; Damai Dai; et al. (CoRR, 2024)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Yuxing Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (ACL (1), 2025)

Temporal Reasoning Transfer from Text to Video. - Lei Li 039; Yuanxin Liu; Linli Yao; Peiyuan Zhang; Chenxin An; Lean Wang; Xu Sun 001; Lingpeng Kong; Qi Liu 049 (ICLR, 2025)

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. - DeepSeek-AI; Daya Guo; Dejian Yang; Haowei Zhang; Junxiao Song; Ruoyu Zhang; Runxin Xu; Qihao Zhu; Shirong Ma; Peiyi Wang; Xiao Bi; Xiaokang Zhang; et al. (CoRR, 2025)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Y. X. Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (CoRR, 2025)

TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videos. - Linli Yao; Yicheng Li; Yuancheng Wei; Lei Li 039; Shuhuai Ren; Yuanxin Liu; Kun Ouyang; Lean Wang; Shicheng Li; Sida Li; Lingpeng Kong; Qi Liu 049; et al. (CoRR, 2025)