Zhenpeng Su

According to our database, Zhenpeng Su authored at least 16 papers between 2023 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization.

Zhenpeng Su, Leiyu Pan, Xue Bai, Dening Liu, Guanting Dong, Jiaming Huang, Wenping Hu, Fuzheng Zhang, Kun Gai, Guorui Zhou

CoRR, August, 2025

LightRetriever: A LLM-based Hybrid Retrieval Architecture with 1000x Faster Query Inference.

Guangyuan Ma, Yongliang Ma, Xuanrui Gou, Zhenpeng Su, Ming Zhou, Songlin Hu

CoRR, May, 2025

Finedeep: Mitigating Sparse Activation in Dense LLMs via Multi-Layer Fine-Grained Experts.

Leiyu Pan, Zhenpeng Su, Minxuan Lv, Yizhe Xiong, Xiangwen Zhang, Zijia Lin, Hui Chen, Jungong Han, Guiguang Ding, Cheng Luo, Di Zhang, Kun Gai, Deyi Xiong

CoRR, February, 2025

DSMoE: Matrix-Partitioned Experts with Dynamic Routing for Computation-Efficient Dense LLMs.

Minxuan Lv, Zhenpeng Su, Leiyu Pan, Yizhe Xiong, Zijia Lin, Hui Chen, Wei Zhou, Jungong Han, Guiguang Ding, Cheng Luo, Di Zhang, Kun Gai, Songlin Hu

CoRR, February, 2025

UniAttn: Reducing Inference Costs via Softmax Unification for Post-Training LLMs.

Yizhe Xiong, Wei Huang, Xin Ye, Hui Chen, Zijia Lin, Haoran Lian, Zhenpeng Su, Jungong Han, Guiguang Ding

CoRR, February, 2025

CartesianMoE: Boosting Knowledge Sharing among Experts via Cartesian Product Routing in Mixture-of-Experts.

Zhenpeng Su, Xing Wu, Zijia Lin, Yizhe Xiong, Minxuan Lv, Guangyuan Ma, Hui Chen, Songlin Hu, Guiguang Ding

Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, 2025

Task-level Distributionally Robust Optimization for Large Language Model-based Dense Retrieval.

Guangyuan Ma, Yongliang Ma, Xing Wu, Zhenpeng Su, Ming Zhou, Songlin Hu

Proceedings of the AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25, 2025

Scaffold-BPE: Enhancing Byte Pair Encoding for Large Language Models with Simple and Effective Scaffold Token Removal.

Haoran Lian, Yizhe Xiong, Jianwei Niu, Shasha Mo, Zhenpeng Su, Zijia Lin, Hui Chen, Jungong Han, Guiguang Ding

Proceedings of the AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25, 2025

2024

MaskMoE: Boosting Token-Level Learning via Routing Mask in Mixture-of-Experts.

Zhenpeng Su, Zijia Lin, Xue Bai, Xing Wu, Yizhe Xiong, Haoran Lian, Guangyuan Ma, Hui Chen, Guiguang Ding, Wei Zhou, Songlin Hu

CoRR, 2024

Scaffold-BPE: Enhancing Byte Pair Encoding with Simple and Effective Scaffold Token Removal.

Haoran Lian, Yizhe Xiong, Jianwei Niu, Shasha Mo, Zhenpeng Su, Zijia Lin, Peng Liu, Hui Chen, Guiguang Ding

CoRR, 2024

MiLe Loss: a New Loss for Mitigating the Bias of Learning Difficulties in Generative Language Models.

Zhenpeng Su, Zijia Lin, Bai Xue, Hui Chen, Guiguang Ding, Wei Zhou, Songlin Hu

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2024, 2024

Dial-MAE: ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems.

Zhenpeng Su, Xing Wu, Wei Zhou, Guangyuan Ma, Songlin Hu

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

2023

InfoEntropy Loss to Mitigate Bias of Learning Difficulties for Generative Language Models.

Zhenpeng Su, Xing Wu, Xue Bai, Zijia Lin, Hui Chen, Guiguang Ding, Wei Zhou, Songlin Hu

CoRR, 2023

HC3 Plus: A Semantic-Invariant Human ChatGPT Comparison Corpus.

Zhenpeng Su, Xing Wu, Wei Zhou, Guangyuan Ma, Songlin Hu

CoRR, 2023

ConTextual Masked Auto-Encoder for Retrieval-based Dialogue Systems.

Zhenpeng Su, Xing Wu, Wei Zhou, Guangyuan Ma, Songlin Hu

CoRR, 2023

T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing.

Yuntao Li, Zhenpeng Su, Yutian Li, Hanchu Zhang, Sirui Wang, Wei Wu, Yan Zhang

Proceedings of the IEEE International Conference on Acoustics, 2023