BBTv2: Towards a Gradient-Free Future with Large Language Models. - Tianxiang Sun; Zhengfu He; Hong Qian; Yunhua Zhou; Xuanjing Huang 001; Xipeng Qiu (EMNLP, 2022)

BBTv2: Pure Black-Box Optimization Can Be Comparable to Gradient Descent for Few-Shot Learning. - Tianxiang Sun; Zhengfu He; Hong Qian; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2022)

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning. - Tianxiang Sun; Zhengfu He; Qin Zhu; Xipeng Qiu; Xuanjing Huang 001 (CoRR, 2022)

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models. - Zhengfu He; Tianxiang Sun; Kuanning Wang; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2022)

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models. - Zhengfu He; Tianxiang Sun; Qiong Tang; Kuanning Wang; Xuanjing Huang 001; Xipeng Qiu (ACL (1), 2023)

Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning. - Tianxiang Sun; Zhengfu He; Qin Zhu; Xipeng Qiu; Xuanjing Huang 001 (ACL (1), 2023)

Can AI Assistants Know What They Don't Know? - Qinyuan Cheng; Tianxiang Sun; Xiangyang Liu; Wenwei Zhang; Zhangyue Yin; Shimin Li; Linyang Li; Zhengfu He; Kai Chen 026; Xipeng Qiu (ICML, 2024)

Dictionary Learning Improves Patch-Free Circuit Discovery in Mechanistic Interpretability: A Case Study on Othello-GPT. - Zhengfu He; Xuyang Ge; Qiong Tang; Tianxiang Sun; Qinyuan Cheng; Xipeng Qiu (CoRR, 2024)

Automatically Identifying Local and Global Circuits with Linear Computation Graphs. - Xuyang Ge; Fukang Zhu; Wentao Shu; Junxuan Wang; Zhengfu He; Xipeng Qiu (CoRR, 2024)

Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoders. - Zhengfu He; Wentao Shu; Xuyang Ge; Lingjie Chen; Junxuan Wang; Yunhua Zhou; Frances Liu; Qipeng Guo; Xuanjing Huang 001; Zuxuan Wu; Yu-Gang Jiang 001; Xipeng Qiu (CoRR, 2024)

MOSS: An Open Conversational Large Language Model. - Tianxiang Sun; Xiaotian Zhang; Zhengfu He; Peng Li; Qinyuan Cheng; Xiangyang Liu; Hang Yan 001; Yunfan Shao; Qiong Tang; Shiduo Zhang; Xingjian Zhao; Ke Chen; et al. (Mach. Intell. Res., 2024)

Correction to: MOSS: An Open Conversational Large Language Model. - Tianxiang Sun; Xiaotian Zhang; Zhengfu He; Peng Li; Qinyuan Cheng; Xiangyang Liu; Hang Yan 001; Yunfan Shao; Qiong Tang; Shiduo Zhang; Xingjian Zhao; Ke Chen; et al. (Mach. Intell. Res., 2024)

Towards Universality: Studying Mechanistic Similarity Across Language Model Architectures. - Junxuan Wang; Xuyang Ge; Wentao Shu; Qiong Tang; Yunhua Zhou; Zhengfu He; Xipeng Qiu (ICLR, 2025)

Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition. - Zhengfu He; Junxuan Wang; Rui Lin; Xuyang Ge; Wentao Shu; Qiong Tang; Junping Zhang; Xipeng Qiu (CoRR, 2025)