CoNT: Contrastive Neural Text Generation. - Chenxin An; Jiangtao Feng; Kai Lv 001; Lingpeng Kong; Xipeng Qiu; Xuanjing Huang 001 (NeurIPS, 2022)

Unified Demonstration Retriever for In-Context Learning. - Xiaonan Li; Kai Lv 001; Hang Yan 001; Tianyang Lin; Wei Zhu 016; Yuan Ni; Guotong Xie; Xiaoling Wang 004; Xipeng Qiu (ACL (1), 2023)

CoLLiE: Collaborative Training of Large Language Models in an Efficient Way. - Kai Lv 001; Shuo Zhang 022; Tianle Gu; Shuhao Xing; Jiawei Hong; Keyu Chen; Xiaoran Liu; Yuqing Yang 004; Honglin Guo; Tengxiao Liu; Yu Sun 031; Qipeng Guo; et al. (EMNLP (Demos), 2023)

Full Parameter Fine-tuning for Large Language Models with Limited Resources. - Kai Lv 001; Yuqing Yang 004; Tengxiao Liu; Qinghui Gao; Qipeng Guo; Xipeng Qiu (CoRR, 2023)

AdaLomo: Low-memory Optimization with Adaptive Learning Rate. - Kai Lv 001; Hang Yan 001; Qipeng Guo; Haijun Lv; Xipeng Qiu (ACL (Findings), 2024)

Full Parameter Fine-tuning for Large Language Models with Limited Resources. - Kai Lv 001; Yuqing Yang 004; Tengxiao Liu; Qipeng Guo; Xipeng Qiu (ACL (1), 2024)

LongWanjuan: Towards Systematic Measurement for Long Text Quality. - Xiaoran Liu; Kai Lv 001; Qipeng Guo; Hang Yan 001; Conghui He; Xipeng Qiu; Dahua Lin (EMNLP (Findings), 2024)

InternLM2 Technical Report. - Zheng Cai; Maosong Cao; Haojiong Chen; Kai Chen 026; Keyu Chen; Xin Chen; Xun Chen; Zehui Chen; Zhi Chen 006; Pei Chu; Xiaoyi Dong; Haodong Duan; et al. (CoRR, 2024)

Farewell to Length Extrapolation, a Training-Free Infinite Context with Finite Attention Scope. - Xiaoran Liu; Qipeng Guo; Yuerong Song; Zhigeng Liu; Kai Lv 001; Hang Yan 001; Linlin Li 001; Qun Liu 001; Xipeng Qiu (CoRR, 2024)

CritiQ: Mining Data Quality Criteria from Human Preferences. - Honglin Guo; Kai Lv 001; Qipeng Guo; Tianyi Liang; Zhiheng Xi; Demin Song; Qiuyinzhe Zhang; Yu Sun 031; Kai Chen 026; Xipeng Qiu; Tao Gui (ACL (1), 2025)

FastMCTS: A Simple Sampling Strategy for Data Synthesis. - Peiji Li; Kai Lv 001; Yunfan Shao; Yichuan Ma; Linyang Li; Xiaoqing Zheng; Xipeng Qiu; Qipeng Guo (ACL (1), 2025)

ReAttention: Training-Free Infinite Context with Finite Attention Scope. - Xiaoran Liu; Ruixiao Li; Zhigeng Liu; Qipeng Guo; Yuerong Song; Kai Lv 001; Hang Yan 001; Linlin Li 001; Qun Liu 001; Xipeng Qiu (ICLR, 2025)

CritiQ: Mining Data Quality Criteria from Human Preferences. - Honglin Guo; Kai Lv 001; Qipeng Guo; Tianyi Liang; Zhiheng Xi; Demin Song; Qi Zhang 001; Yu Sun 031; Kai Chen 026; Xipeng Qiu; Tao Gui (CoRR, 2025)

DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting. - Kai Lv 001; Honglin Guo; Qipeng Guo; Xipeng Qiu (CoRR, 2025)