Graph Policy Network for Transferable Active Learning on Graphs. - Shengding Hu; Zheng Xiong; Meng Qu; Xingdi Yuan; Marc-Alexandre Côté; Zhiyuan Liu 001; Jian Tang 005 (NeurIPS, 2020)

Graph neural networks: A review of methods and applications. - Jie Zhou 024; Ganqu Cui; Shengding Hu; Zhengyan Zhang; Cheng Yang 002; Zhiyuan Liu 001; Lifeng Wang; Changcheng Li; Maosong Sun 001 (AI Open, 2020)

KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion. - Jie Zhou 016; Shengding Hu; Xin Lv; Cheng Yang 002; Zhiyuan Liu 001; Wei Xu 034; Jie Jiang; Juanzi Li; Maosong Sun 001 (ACL/IJCNLP (Findings), 2021)

Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification. - Shengding Hu; Ning Ding 002; Huadong Wang; Zhiyuan Liu 001; Juanzi Li; Maosong Sun 001 (CoRR, 2021)

Prototypical Verbalizer for Prompt-based Few-shot Tuning. - Ganqu Cui; Shengding Hu; Ning Ding 002; Longtao Huang; Zhiyuan Liu 001 (ACL (1), 2022)

OpenPrompt: An Open-source Framework for Prompt-learning. - Ning Ding 002; Shengding Hu; Weilin Zhao; Yulin Chen; Zhiyuan Liu 001; Haitao Zheng 002; Maosong Sun 001 (ACL (demo), 2022)

Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification. - Shengding Hu; Ning Ding 002; Huadong Wang; Zhiyuan Liu 001; Jingang Wang; Juanzi Li; Wei Wu 014; Maosong Sun 001 (ACL (1), 2022)

COPEN: Probing Conceptual Knowledge in Pre-trained Language Models. - Hao Peng 015; Xiaozhi Wang; Shengding Hu; Hailong Jin; Lei Hou 001; Juanzi Li; Zhiyuan Liu 001; Qun Liu 001 (EMNLP, 2022)

Sparse Structure Search for Delta Tuning. - Shengding Hu; Zhen Zhang; Ning Ding 002; Yadao Wang; Yasheng Wang; Zhiyuan Liu 001; Maosong Sun 001 (NeurIPS, 2022)

Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models. - Ning Ding 002; Yujia Qin; Guang Yang 046; Fuchao Wei; Zonghan Yang; Yusheng Su; Shengding Hu; Yulin Chen; Chi-Min Chan; Weize Chen; Jing Yi; Weilin Zhao; et al. (CoRR, 2022)

Sparse Structure Search for Parameter-Efficient Tuning. - Shengding Hu; Zhen Zhang; Ning Ding 002; Yadao Wang; Yasheng Wang; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2022)

Exploring Lottery Prompts for Pre-trained Language Models. - Yulin Chen; Ning Ding 002; Xiaobin Wang; Shengding Hu; Haitao Zheng 002; Zhiyuan Liu 001; Pengjun Xie (ACL (1), 2023)

OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models. - Shengding Hu; Ning Ding 002; Weilin Zhao; Xingtai Lv; Zhen Zhang; Zhiyuan Liu 001; Maosong Sun 001 (ACL (demo), 2023)

Won't Get Fooled Again: Answering Questions with False Premises. - Shengding Hu; Yifan Luo; Huadong Wang; Xingyi Cheng; Zhiyuan Liu 001; Maosong Sun 001 (ACL (1), 2023)

Enhancing Chat Language Models by Scaling High-quality Instructional Conversations. - Ning Ding 002; Yulin Chen; Bokai Xu; Yujia Qin; Shengding Hu; Zhiyuan Liu 001; Maosong Sun 001; Bowen Zhou 002 (EMNLP, 2023)

Exploring the Impact of Model Scaling on Parameter-Efficient Tuning. - Yusheng Su; Chi-Min Chan; Jiali Cheng; Yujia Qin; Yankai Lin; Shengding Hu; Zonghan Yang; Ning Ding 002; Xingzhi Sun 002; Guotong Xie; Zhiyuan Liu 001; Maosong Sun 001 (EMNLP, 2023)

Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder. - Zihao Fu; Wai Lam; Qian Yu; Anthony Man-Cho So; Shengding Hu; Zhiyuan Liu 001; Nigel Collier (CoRR, 2023)

Tool Learning with Foundation Models. - Yujia Qin; Shengding Hu; Yankai Lin; Weize Chen; Ning Ding 002; Ganqu Cui; Zheni Zeng; Yufei Huang 008; Chaojun Xiao; Chi Han; Yi Ren Fung 001; Yusheng Su; et al. (CoRR, 2023)

Enhancing Chat Language Models by Scaling High-quality Instructional Conversations. - Ning Ding 002; Yulin Chen; Bokai Xu; Yujia Qin; Zhi Zheng; Shengding Hu; Zhiyuan Liu 001; Maosong Sun 001; Bowen Zhou 002 (CoRR, 2023)

Arbitrary Few Parameters are Good Enough for Adapting Large-scale Pre-trained Language Models. - Yusheng Su; Chi-Min Chan; Jiali Cheng; Yujia Qin; Yankai Lin; Shengding Hu; Zonghan Yang; Ning Ding 002; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2023)

Unlock Predictable Scaling from Emergent Abilities. - Shengding Hu; Xin Liu; Xu Han 007; Xinrong Zhang; Chaoqun He; Weilin Zhao; Yankai Lin; Ning Ding 002; Zebin Ou; Guoyang Zeng; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2023)

Parameter-efficient fine-tuning of large-scale pre-trained language models. - Ning Ding 002; Yujia Qin; Guang Yang 046; Fuchao Wei; Zonghan Yang; Yusheng Su; Shengding Hu; Yulin Chen; Chi-Min Chan; Weize Chen; Jing Yi; Weilin Zhao; et al. (Nat. Mac. Intell., 2023)

OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems. - Chaoqun He; Renjie Luo; Yuzhuo Bai; Shengding Hu; Zhen Leng Thai; Junhao Shen; Jinyi Hu; Xu Han 007; Yujie Huang; Yuxiang Zhang; Jie Liu; Lei Qi; et al. (ACL (1), 2024)

ınftyBench: Extending Long Context Evaluation Beyond 100K Tokens. - Xinrong Zhang; Yingfa Chen; Shengding Hu; Zihang Xu; Junhao Chen; Moo Khai Hao; Xu Han 007; Zhen Leng Thai; Shuo Wang 013; Zhiyuan Liu 001; Maosong Sun 001 (ACL (1), 2024)

Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models. - Xinrong Zhang; Yingfa Chen; Shengding Hu; Xu Han 007; Zihang Xu; Yuanwei Xu; Weilin Zhao; Maosong Sun 001; Zhiyuan Liu 001 (EMNLP, 2024)

DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models. - Ranchi Zhao; Zhen Leng Thai; Yifan Zhang; Shengding Hu; Jie Zhou; Yunqi Ba; Jie Cai; Zhiyuan Liu 001; Maosong Sun 001 (EMNLP, 2024)

Predicting Emergent Abilities with Infinite Resolution Evaluation. - Shengding Hu; Xin Liu; Xu Han 007; Xinrong Zhang; Chaoqun He; Weilin Zhao; Yankai Lin; Ning Ding 002; Zebin Ou; Guoyang Zeng; Zhiyuan Liu 001; Maosong Sun 001 (ICLR, 2024)

∞Bench: Extending Long Context Evaluation Beyond 100K Tokens. - Xinrong Zhang; Yingfa Chen; Shengding Hu; Zihang Xu; Junhao Chen; Moo Khai Hao; Xu Han 007; Zhen Leng Thai; Shuo Wang 013; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

Unified View of Grokking, Double Descent and Emergent Abilities: A Perspective from Circuits Competition. - Yufei Huang 008; Shengding Hu; Xu Han 007; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies. - Shengding Hu; Yuge Tu; Xu Han 007; Chaoqun He; Ganqu Cui; Xiang Long; Zhi Zheng; Yewei Fang; Yuxiang Huang; Weilin Zhao; Xinrong Zhang; Zhen Leng Thai; et al. (CoRR, 2024)

UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs. - Chaoqun He; Renjie Luo; Shengding Hu; Yuanqian Zhao; Jie Zhou 024; Hanghao Wu; Jiajie Zhang; Xu Han 007; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

LEGENT: Open Platform for Embodied Agents. - Zhili Cheng; Zhitong Wang; Jinyi Hu; Shengding Hu; An Liu; Yuge Tu; Pengkai Li; Lei Shi; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

States Hidden in Hidden States: LLMs Emerge Discrete State Representations Implicitly. - Junhao Chen; Shengding Hu; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

MiniCPM-V: A GPT-4V Level MLLM on Your Phone. - Yuan Yao 013; Tianyu Yu 002; Ao Zhang; Chongyi Wang; Junbo Cui; Hongji Zhu; Tianchi Cai; Haoyu Li; Weilin Zhao; Zhihui He; Qianyu Chen; Huarong Zhou; et al. (CoRR, 2024)

DecorateLM: Data Engineering through Corpus Rating, Tagging, and Editing with Language Models. - Ranchi Zhao; Zhen Leng Thai; Yifan Zhang; Shengding Hu; Yunqi Ba; Jie Zhou 016; Jie Cai; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

Stuffed Mamba: State Collapse and State Capacity of RNN-Based Long-Context Modeling. - Yingfa Chen; Xinrong Zhang; Shengding Hu; Xu Han 007; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2024)

ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer. - Jinyi Hu; Shengding Hu; Yuxuan Song; Yufei Huang 008; Mingxuan Wang; Hao Zhou 012; Zhiyuan Liu 001; Wei-Ying Ma; Maosong Sun 001 (CoRR, 2024)

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models. - Chenyang Song; Xu Han 007; Zhengyan Zhang; Shengding Hu; Xiyu Shi; Kuai Li; Chen Chen; Zhiyuan Liu 001; Guangli Li; Tao Yang; Maosong Sun 001 (COLING, 2025)

A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules. - Kairong Luo; Haodong Wen; Shengding Hu; Zhenbo Sun; Zhiyuan Liu 001; Maosong Sun 001; Kaifeng Lyu; Wenguang Chen (ICLR, 2025)

Optimal RoPE extension via Bayesian Optimization for training-free length generalization. - Xinrong Zhang; Shengding Hu; Weilin Zhao; Huadong Wang; Xu Han 007; Chaoqun He; Guoyang Zeng; Zhiyuan Liu 001; Maosong Sun 001 (AI Open, 2025)

EmbodiedEval: Evaluate Multimodal LLMs as Embodied Agents. - Zhili Cheng; Yuge Tu; Ran Li; Shiqi Dai; Jinyi Hu; Shengding Hu; Jiahao Li; Yang Shi; Tianyu Yu 002; Weize Chen; Lei Shi; Maosong Sun 001 (CoRR, 2025)

Seed1.5-Thinking: Advancing Superb Reasoning Models with Reinforcement Learning. - Jiaze Chen; Tiantian Fan; Xin Liu; Lingjun Liu; Zhiqi Lin; Mingxuan Wang; Chengyi Wang; Xiangpeng Wei; Wenyuan Xu; Yufeng Yuan; Yu Yue; Lin Yan; et al. (CoRR, 2025)

Tool Learning with Foundation Models. - Yujia Qin; Shengding Hu; Yankai Lin; Weize Chen; Ning Ding 002; Ganqu Cui; Zheni Zeng; Xuanhe Zhou; Yufei Huang 008; Chaojun Xiao; Chi Han; Yi R. Fung 001; et al. (ACM Comput. Surv., 2025)