DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models. - Damai Dai; Chengqi Deng; Chenggang Zhao; R. X. Xu; Huazuo Gao; Deli Chen; Jiashi Li; Wangding Zeng; Xingkai Yu; Y. Wu; Zhenda Xie; Y. K. Li; et al. (ACL (1), 2024)

DeepSeek LLM: Scaling Open-Source Language Models with Longtermism. - Xiao Bi; Deli Chen; Guanting Chen 002; Shanhuang Chen; Damai Dai; Chengqi Deng; Honghui Ding; Kai Dong 003; Qiushi Du; Zhe Fu; Huazuo Gao; Kaige Gao; et al. (CoRR, 2024)

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model. - DeepSeek-AI; Aixin Liu; Bei Feng; Bin Wang 065; Bingxuan Wang; Bo Liu 039; Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Daya Guo; Dejian Yang; et al. (CoRR, 2024)

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence. - DeepSeek-AI; Qihao Zhu; Daya Guo; Zhihong Shao; Dejian Yang; Peiyi Wang; Runxin Xu; Y. Wu; Yukun Li; Huazuo Gao; Shirong Ma; Wangding Zeng; et al. (CoRR, 2024)

Auxiliary-Loss-Free Load Balancing Strategy for Mixture-of-Experts. - Lean Wang; Huazuo Gao; Chenggang Zhao; Xu Sun 001; Damai Dai (CoRR, 2024)

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding. - Zhiyu Wu; Xiaokang Chen; Zizheng Pan; Xingchao Liu; Wen Liu; Damai Dai; Huazuo Gao; Yiyang Ma; Chengyue Wu; Bingxuan Wang; Zhenda Xie; Yu Wu; et al. (CoRR, 2024)

DeepSeek-V3 Technical Report. - DeepSeek-AI; Aixin Liu; Bei Feng; Bing Xue; Bingxuan Wang; Bochao Wu; Chengda Lu; Chenggang Zhao; Chengqi Deng; Chenyu Zhang; Chong Ruan; Damai Dai; et al. (CoRR, 2024)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Yuxing Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (ACL (1), 2025)

Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures. - Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Huazuo Gao; Jiashi Li; Liyue Zhang; Panpan Huang; Shangyan Zhou; Shirong Ma; Wenfeng Liang; Ying He; et al. (ISCA, 2025)

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning. - DeepSeek-AI; Daya Guo; Dejian Yang; Haowei Zhang; Junxiao Song; Ruoyu Zhang; Runxin Xu; Qihao Zhu; Shirong Ma; Peiyi Wang; Xiao Bi; Xiaokang Zhang; et al. (CoRR, 2025)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Y. X. Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (CoRR, 2025)

Insights into DeepSeek-V3: Scaling Challenges and Reflections on Hardware for AI Architectures. - Chenggang Zhao; Chengqi Deng; Chong Ruan; Damai Dai; Huazuo Gao; Jiashi Li; Liyue Zhang; Panpan Huang; Shangyan Zhou; Shirong Ma; Wenfeng Liang; Ying He; et al. (CoRR, 2025)