T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing. - Yuntao Li; Zhenpeng Su; Yutian Li; Hanchu Zhang; Sirui Wang; Wei Wu 014; Yan Zhang (ICASSP, 2023)

ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems. - Zhenpeng Su; Xing Wu 002; Wei Zhou 019; Guangyuan Ma; Songlin Hu 001 (CoRR, 2023)

HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpus. - Zhenpeng Su; Xing Wu 002; Wei Zhou 019; Guangyuan Ma; Songlin Hu 001 (CoRR, 2023)

InfoEntropy Loss to Mitigate Bias of Learning Difficulties for Generative Language Models. - Zhenpeng Su; Xing Wu 002; Xue Bai; Zijia Lin; Hui Chen 013; Guiguang Ding; Wei Zhou 019; Songlin Hu 001 (CoRR, 2023)

Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems. - Zhenpeng Su; Xing Wu 002; Wei Zhou 019; Guangyuan Ma; Songlin Hu 001 (NAACL-HLT, 2024)

MiLe Loss: a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models. - Zhenpeng Su; Zijia Lin; Bai Xue; Hui Chen 013; Guiguang Ding; Wei Zhou 019; Songlin Hu 001 (NAACL-HLT (Findings), 2024)

Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal. - Haoran Lian; Yizhe Xiong; Jianwei Niu 002; Shasha Mo; Zhenpeng Su; Zijia Lin; Peng Liu; Hui Chen 013; Guiguang Ding (CoRR, 2024)

MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts. - Zhenpeng Su; Zijia Lin; Xue Bai; Xing Wu 002; Yizhe Xiong; Haoran Lian; Guangyuan Ma; Hui Chen 013; Guiguang Ding; Wei Zhou 019; Songlin Hu 001 (CoRR, 2024)

Scaffold-BPE: Enhancing Byte Pair Encoding for Large Language Models with Simple and Effective Scaffold Token Removal. - Haoran Lian; Yizhe Xiong; Jianwei Niu 002; Shasha Mo; Zhenpeng Su; Zijia Lin; Hui Chen 013; Jungong Han; Guiguang Ding (AAAI, 2025)

Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval. - Guangyuan Ma; Yongliang Ma; Xing Wu 002; Zhenpeng Su; Ming Zhou 001; Songlin Hu 001 (AAAI, 2025)

CartesianMoE: Boosting Knowledge Sharing among Experts via Cartesian Product Routing in Mixture-of-Experts. - Zhenpeng Su; Xing Wu 002; Zijia Lin; Yizhe Xiong; Minxuan Lv; Guangyuan Ma; Hui Chen 013; Songlin Hu 001; Guiguang Ding (NAACL (Long Papers), 2025)

UniAttn: Reducing Inference Costs via Softmax Unification for Post-Training LLMs. - Yizhe Xiong; Wei Huang; Xin Ye; Hui Chen 013; Zijia Lin; Haoran Lian; Zhenpeng Su; Jungong Han; Guiguang Ding (CoRR, 2025)

DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs. - Minxuan Lv; Zhenpeng Su; Leiyu Pan; Yizhe Xiong; Zijia Lin; Hui Chen 013; Wei Zhou 019; Jungong Han; Guiguang Ding; Cheng Luo; Di Zhang; Kun Gai; et al. (CoRR, 2025)

Finedeep: Mitigating Sparse Activation in Dense LLMs via Multi-Layer Fine-Grained Experts. - Leiyu Pan; Zhenpeng Su; Minxuan Lv; Yizhe Xiong; Xiangwen Zhang; Zijia Lin; Hui Chen 013; Jungong Han; Guiguang Ding; Cheng Luo; Di Zhang; Kun Gai; et al. (CoRR, 2025)

LightRetriever: A LLM-based Hybrid Retrieval Architecture with 1000x Faster Query Inference. - Guangyuan Ma; Yongliang Ma; Xuanrui Gou; Zhenpeng Su; Ming Zhou 001; Songlin Hu 001 (CoRR, 2025)

Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization. - Zhenpeng Su; Leiyu Pan; Xue Bai; Dening Liu; Guanting Dong; Jiaming Huang; Wenping Hu; Fuzheng Zhang; Kun Gai; Guorui Zhou (CoRR, 2025)