OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models. - Shengding Hu; Ning Ding 002; Weilin Zhao; Xingtai Lv; Zhen Zhang; Zhiyuan Liu 001; Maosong Sun 001 (ACL (demo), 2023)

Parameter-efficient Weight Ensembling Facilitates Task-level Knowledge Transfer. - Xingtai Lv; Ning Ding 002; Yujia Qin; Zhiyuan Liu 001; Maosong Sun 001 (ACL (2), 2023)

Sparse Low-rank Adaptation of Pre-trained Language Models. - Ning Ding 002; Xingtai Lv; Qiaosen Wang; Yulin Chen; Bowen Zhou 002; Zhiyuan Liu 001; Maosong Sun 001 (EMNLP, 2023)

Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention. - Xingtai Lv; Ning Ding 002; Kaiyan Zhang; Ermo Hua; Ganqu Cui; Bowen Zhou 002 (EMNLP, 2024)

UltraMedical: Building Specialized Generalists in Biomedicine. - Kaiyan Zhang; Sihang Zeng; Ermo Hua; Ning Ding 002; Zhang-Ren Chen; Zhiyuan Ma 005; Haoxin Li; Ganqu Cui; Biqing Qi; Xuekai Zhu; Xingtai Lv; Jinfang Hu; et al. (NeurIPS, 2024)

Mastering Text, Code and Math Simultaneously via Fusing Highly Specialized Language Models. - Ning Ding 002; Yulin Chen; Ganqu Cui; Xingtai Lv; Weilin Zhao; Ruobing Xie; Bowen Zhou 002; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process. - Ermo Hua; Biqing Qi; Kaiyan Zhang; Yue Yu 008; Ning Ding 002; Xingtai Lv; Kai Tian; Bowen Zhou 002 (CoRR, 2024)

Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding. - Kaiyan Zhang; Jianyu Wang; Ning Ding 002; Biqing Qi; Ermo Hua; Xingtai Lv; Bowen Zhou 002 (CoRR, 2024)

Automating Exploratory Proteomics Research via Language Models. - Ning Ding 002; Shang Qu; Linhai Xie; Yifei Li; Zaoqu Liu; Kaiyan Zhang; Yibai Xiong; Yuxin Zuo; Zhangren Chen; Ermo Hua; Xingtai Lv; Youbang Sun; et al. (CoRR, 2024)

How to Synthesize Text Data without Model Collapse? - Xuekai Zhu; Daixuan Cheng; Hengli Li; Kaiyan Zhang; Ermo Hua; Xingtai Lv; Ning Ding 002; Zhouhan Lin; Zilong Zheng; Bowen Zhou 002 (CoRR, 2024)

Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization. - Ermo Hua; Che Jiang; Xingtai Lv; Kaiyan Zhang; Ning Ding 002; Youbang Sun; Biqing Qi; Yuchen Fan; Xuekai Zhu; Bowen Zhou 002 (CoRR, 2024)

Fusing Highly Specialized Language Models for Comprehensive Expertise. - Ning Ding 002; Yulin Chen; Ganqu Cui; Xingtai Lv; Weilin Zhao; Kaiyan Zhang; Ruobing Xie; Bowen Zhou 002; Zhiyuan Liu 001; Maosong Sun 001 (ACL (1), 2025)

Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process. - Ermo Hua; Biqing Qi; Kaiyan Zhang; Kai Tian; Xingtai Lv; Ning Ding 002; Bowen Zhou 002 (ACL (1), 2025)

OpenPRM: Building Open-domain Process-based Reward Models with Preference Trees. - Kaiyan Zhang; Jiayuan Zhang 001; Haoxin Li; Xuekai Zhu; Ermo Hua; Xingtai Lv; Ning Ding 002; Biqing Qi; Bowen Zhou 002 (ICLR, 2025)

Process Reinforcement through Implicit Rewards. - Ganqu Cui; Lifan Yuan; Zefan Wang; Hanbin Wang; Wendi Li; Bingxiang He; Yuchen Fan; Tianyu Yu 002; Qixin Xu; Weize Chen; Jiarui Yuan; Huayu Chen; et al. (CoRR, 2025)

Technologies on Effectiveness and Efficiency: A Survey of State Spaces Models. - Xingtai Lv; Youbang Sun; Kaiyan Zhang; Shang Qu; Xuekai Zhu; Yuchen Fan; Yi Wu; Ermo Hua; Xinwei Long; Ning Ding 002; Bowen Zhou 002 (CoRR, 2025)

Automating Exploratory Multiomics Research via Language Models. - Shang Qu; Ning Ding 002; Linhai Xie; Yifei Li; Zaoqu Liu; Kaiyan Zhang; Yibai Xiong; Yuxin Zuo; Zhangren Chen; Ermo Hua; Xingtai Lv; Youbang Sun; et al. (CoRR, 2025)