Learning Sparse Sharing Architectures for Multiple Tasks. - Tianxiang Sun; Yunfan Shao; Xiaonan Li; Pengfei Liu 003; Hang Yan 001; Xipeng Qiu; Xuanjing Huang 001 (AAAI, 2020)

CoLAKE: Contextualized Language and Knowledge Embedding. - Tianxiang Sun; Yunfan Shao; Xipeng Qiu; Qipeng Guo; Yaru Hu; Xuanjing Huang 001; Zheng Zhang 001 (COLING, 2020)

Pre-trained Models for Natural Language Processing: A Survey. - Xipeng Qiu; Tianxiang Sun; Yige Xu 001; Yunfan Shao; Ning Dai; Xuanjing Huang 001 (CoRR, 2020)

Accelerating BERT Inference for Sequence Labeling via Early-Exit. - Xiaonan Li; Yunfan Shao; Tianxiang Sun; Hang Yan 001; Xipeng Qiu; Xuanjing Huang 001 (ACL/IJCNLP (1), 2021)

Does syntax matter? A strong baseline for Aspect-based Sentiment Analysis with RoBERTa. - Junqi Dai; Hang Yan 001; Tianxiang Sun; Pengfei Liu 003; Xipeng Qiu (NAACL-HLT, 2021)

Early Exiting with Ensemble Internal Classifiers. - Tianxiang Sun; Yunhua Zhou; Xiangyang Liu; Xinyu Zhang 019; Hao Jiang 022; Zhao Cao; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2021)

Learning to Teach with Student Feedback. - Yitao Liu; Tianxiang Sun; Xipeng Qiu; Xuanjing Huang 001 (CoRR, 2021)

Towards Efficient NLP: A Standard Evaluation and A Strong Baseline. - Xiangyang Liu; Tianxiang Sun; Junliang He; Lingling Wu; Xinyu Zhang 019; Hao Jiang 022; Zhao Cao; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2021)

A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation. - Tianxiang Sun; Xiangyang Liu; Wei Zhu 016; Zhichao Geng; Lingling Wu; Yilong He; Yuan Ni; Guotong Xie; Xuanjing Huang 001; Xipeng Qiu (ACL (Findings), 2022)

Late Prompt Tuning: A Late Prompt Could Be Better Than Many Prompts. - Xiangyang Liu; Tianxiang Sun; Xuanjing Huang 001; Xipeng Qiu (EMNLP (Findings), 2022)

BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation. - Tianxiang Sun; Junliang He; Xipeng Qiu; Xuanjing Huang 001 (EMNLP, 2022)

BBTv2: Towards a Gradient-Free Future with Large Language Models. - Tianxiang Sun; Zhengfu He; Hong Qian; Yunhua Zhou; Xuanjing Huang 001; Xipeng Qiu (EMNLP, 2022)

Black-Box Tuning for Language-Model-as-a-Service. - Tianxiang Sun; Yunfan Shao; Hong Qian; Xuanjing Huang 001; Xipeng Qiu (ICML, 2022)

Towards Efficient NLP: A Standard Evaluation and A Strong Baseline. - Xiangyang Liu; Tianxiang Sun; Junliang He; Jiawen Wu 002; Lingling Wu; Xinyu Zhang 019; Hao Jiang 022; Zhao Cao; Xuanjing Huang 001; Xipeng Qiu (NAACL-HLT, 2022)

BBTv2: Pure Black-Box Optimization Can Be Comparable to Gradient Descent for Few-Shot Learning. - Tianxiang Sun; Zhengfu He; Hong Qian; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2022)

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning. - Tianxiang Sun; Zhengfu He; Qin Zhu; Xipeng Qiu; Xuanjing Huang 001 (CoRR, 2022)

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models. - Zhengfu He; Tianxiang Sun; Kuanning Wang; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2022)

Paradigm Shift in Natural Language Processing. - Tianxiang Sun; Xiangyang Liu; Xipeng Qiu; Xuanjing Huang 001 (Int. J. Autom. Comput., 2022)

Improving Contrastive Learning of Sentence Embeddings from AI Feedback. - Qinyuan Cheng; Xiaogui Yang; Tianxiang Sun; Linyang Li; Xipeng Qiu (ACL (Findings), 2023)

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models. - Zhengfu He; Tianxiang Sun; Qiong Tang; Kuanning Wang; Xuanjing Huang 001; Xipeng Qiu (ACL (1), 2023)

CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors. - Peng Li; Tianxiang Sun; Qiong Tang; Hang Yan 001; Yuanbin Wu; Xuanjing Huang 001; Xipeng Qiu (ACL (1), 2023)

Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning. - Tianxiang Sun; Zhengfu He; Qin Zhu; Xipeng Qiu; Xuanjing Huang 001 (ACL (1), 2023)

Origin Tracing and Detecting of LLMs. - Linyang Li; Pengyu Wang 006; Ke Ren; Tianxiang Sun; Xipeng Qiu (CoRR, 2023)

Secrets of RLHF in Large Language Models Part I: PPO. - Rui Zheng; Shihan Dou; Songyang Gao; Yuan Hua; Wei Shen; Binghai Wang; Yan Liu 002; Senjie Jin; Qin Liu 010; Yuhao Zhou; Limao Xiong; Lu Chen; et al. (CoRR, 2023)

Evaluating Hallucinations in Chinese Large Language Models. - Qinyuan Cheng; Tianxiang Sun; Wenwei Zhang; Siyin Wang; Xiangyang Liu; Mozhi Zhang; Junliang He; Mianqiu Huang; Zhangyue Yin; Kai Chen 026; Xipeng Qiu (CoRR, 2023)

Flames: Benchmarking Value Alignment of Chinese Large Language Models. - Kexin Huang; Xiangyang Liu; Qianyu Guo; Tianxiang Sun; Jiawei Sun; Yaru Wang; Zeyang Zhou; Yixu Wang; Yan Teng 002; Xipeng Qiu; Yingchun Wang; Dahua Lin (CoRR, 2023)

DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning. - Xinghao Wang; Junliang He; Pengyu Wang 006; Yunhua Zhou; Tianxiang Sun; Xipeng Qiu (AAAI, 2024)

LLM can Achieve Self-Regulation via Hyperparameter Aware Generation. - Siyin Wang; Shimin Li; Tianxiang Sun; Jinlan Fu; Qinyuan Cheng; Jiasheng Ye; Junjie Ye; Xipeng Qiu; Xuanjing Huang 001 (ACL (Findings), 2024)

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling. - Jun Zhan; Junqi Dai; Jiasheng Ye; Yunhua Zhou; Dong Zhang; Zhigeng Liu; Xin Zhang; Ruibin Yuan; Ge Zhang 009; Linyang Li; Hang Yan 001; Jie Fu 001; et al. (ACL (1), 2024)

Aggregation of Reasoning: A Hierarchical Framework for Enhancing Answer Selection in Large Language Models. - Zhangyue Yin; Qiushi Sun; Qipeng Guo; Zhiyuan Zeng 004; Xiaonan Li; Tianxiang Sun; Cheng Chang; Qinyuan Cheng; Ding Wang; Xiaofeng Mou; Xipeng Qiu; Xuanjing Huang 001 (LREC/COLING, 2024)

Unified Active Retrieval for Retrieval Augmented Generation. - Qinyuan Cheng; Xiaonan Li; Shimin Li; Qin Zhu; Zhangyue Yin; Yunfan Shao; Linyang Li; Tianxiang Sun; Hang Yan 001; Xipeng Qiu (EMNLP (Findings), 2024)

Turn Waste into Worth: Rectifying Top-k Router of MoE. - Zhiyuan Zeng 004; Qipeng Guo; Zhaoye Fei; Zhangyue Yin; Yunhua Zhou; Linyang Li; Tianxiang Sun; Hang Yan 001; Dahua Lin; Xipeng Qiu (EMNLP, 2024)

Can AI Assistants Know What They Don't Know? - Qinyuan Cheng; Tianxiang Sun; Xiangyang Liu; Wenwei Zhang; Zhangyue Yin; Shimin Li; Linyang Li; Zhengfu He; Kai Chen 026; Xipeng Qiu (ICML, 2024)

Flames: Benchmarking Value Alignment of LLMs in Chinese. - Kexin Huang; Xiangyang Liu; Qianyu Guo; Tianxiang Sun; Jiawei Sun; Yaru Wang; Zeyang Zhou; Yixu Wang; Yan Teng 002; Xipeng Qiu; Yingchun Wang; Dahua Lin (NAACL-HLT, 2024)

LLatrieval: LLM-Verified Retrieval for Verifiable Generation. - Xiaonan Li; Changtai Zhu; Linyang Li; Zhangyue Yin; Tianxiang Sun; Xipeng Qiu (NAACL-HLT, 2024)

Agent Alignment in Evolving Social Norms. - Shimin Li; Tianxiang Sun; Xipeng Qiu (CoRR, 2024)

Dictionary Learning Improves Patch-Free Circuit Discovery in Mechanistic Interpretability: A Case Study on Othello-GPT. - Zhengfu He; Xuyang Ge; Qiong Tang; Tianxiang Sun; Qinyuan Cheng; Xipeng Qiu (CoRR, 2024)

In-Memory Learning: A Declarative Learning Framework for Large Language Models. - Bo Wang 084; Tianxiang Sun; Hang Yan 001; Siyin Wang; Qingyuan Cheng; Xipeng Qiu (CoRR, 2024)

DetectiveQA: Evaluating Long-Context Reasoning on Detective Novels. - Zhe Xu; Jiasheng Ye; Xiangyang Liu; Tianxiang Sun; Xiaoran Liu; Qipeng Guo; Linlin Li 001; Qun Liu 001; Xuanjing Huang 001; Xipeng Qiu (CoRR, 2024)

MOSS: An Open Conversational Large Language Model. - Tianxiang Sun; Xiaotian Zhang; Zhengfu He; Peng Li; Qinyuan Cheng; Xiangyang Liu; Hang Yan 001; Yunfan Shao; Qiong Tang; Shiduo Zhang; Xingjian Zhao; Ke Chen; et al. (Mach. Intell. Res., 2024)

Correction to: MOSS: An Open Conversational Large Language Model. - Tianxiang Sun; Xiaotian Zhang; Zhengfu He; Peng Li; Qinyuan Cheng; Xiangyang Liu; Hang Yan 001; Yunfan Shao; Qiong Tang; Shiduo Zhang; Xingjian Zhao; Ke Chen; et al. (Mach. Intell. Res., 2024)

Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance. - Jiasheng Ye; Peiju Liu; Tianxiang Sun; Jun Zhan; Yunhua Zhou; Xipeng Qiu (ICLR, 2025)