Enabling Lightweight Fine-tuning for Pre-trained Language Model Compression based on Matrix Product Operators. - Peiyu Liu 002; Ze-Feng Gao; Wayne Xin Zhao; Zhi-Yuan Xie; Zhong-Yi Lu; Ji-Rong Wen (ACL/IJCNLP (1), 2021)

WenLan: Bridging Vision and Language by Large-Scale Multi-Modal Pre-Training. - Yuqi Huo; Manli Zhang; Guangzhen Liu; Haoyu Lu; Yizhao Gao 004; Guoxing Yang; Jingyuan Wen; Heng Zhang; Baogui Xu; Weihao Zheng; Zongzheng Xi; Yueqian Yang; et al. (CoRR, 2021)

Parameter-Efficient Mixture-of-Experts Architecture for Pre-trained Language Models. - Ze-Feng Gao; Peiyu Liu 002; Wayne Xin Zhao; Zhong-Yi Lu; Ji-Rong Wen (COLING, 2022)

Small Pre-trained Language Models Can be Fine-tuned as Large Models via Over-Parameterization. - Ze-Feng Gao; Kun Zhou 002; Peiyu Liu 002; Wayne Xin Zhao; Ji-Rong Wen (ACL (1), 2023)

Enhancing Scalability of Pre-trained Language Models via Efficient Parameter Sharing. - Peiyu Liu 002; Ze-Feng Gao; Yushuo Chen; Xin Zhao 018; Ji-Rong Wen (EMNLP (Findings), 2023)

TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World. - Hongpeng Lin; Ludan Ruan; Wenke Xia; Peiyu Liu 002; Jingyuan Wen; Yixin Xu; Di Hu 001; Ruihua Song; Wayne Xin Zhao; Qin Jin; Zhiwu Lu 001 (ACM Multimedia, 2023)

TikTalk: A Multi-Modal Dialogue Dataset for Real-World Chitchat. - Hongpeng Lin; Ludan Ruan; Wenke Xia; Peiyu Liu 002; Jingyuan Wen; Yixin Xu; Di Hu 001; Ruihua Song; Wayne Xin Zhao; Qin Jin; Zhiwu Lu 001 (CoRR, 2023)

Scaling Pre-trained Language Models to Deeper via Parameter-efficient Architecture. - Peiyu Liu 002; Ze-Feng Gao; Yushuo Chen; Wayne Xin Zhao; Ji-Rong Wen (CoRR, 2023)

A Survey of Large Language Models. - Wayne Xin Zhao; Kun Zhou 002; Junyi Li; Tianyi Tang; Xiaolei Wang 005; Yupeng Hou; Yingqian Min; Beichen Zhang; Junjie Zhang 009; Zican Dong; Yifan Du 002; Chen Yang; et al. (CoRR, 2023)

Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression. - Peiyu Liu 002; Ze-Feng Gao; Xin Zhao 018; Yipeng Ma; Tao Wang; Ji-Rong Wen (ACL (1), 2024)

Enhancing Parameter-efficient Fine-tuning with Simple Calibration Based on Stable Rank. - Peiyu Liu 002; Ze-Feng Gao; Xiao Zhang 001; Wayne Xin Zhao; Ji-Rong Wen (LREC/COLING, 2024)

Do Emergent Abilities Exist in Quantized Large Language Models: An Empirical Study. - Peiyu Liu 002; Zikang Liu 001; Ze-Feng Gao; Dawei Gao; Wayne Xin Zhao; Yaliang Li; Bolin Ding; Ji-Rong Wen (LREC/COLING, 2024)

Compression Image Dataset Based on Multiple Matrix Product States. - Ze-Feng Gao; Peiyu Liu 002; Wayne Xin Zhao; Zhi-Yuan Xie; Ji-Rong Wen; Zhong-Yi Lu (FICC (2), 2024)

Domain-Specific Pruning of Large Mixture-of-Experts Models with Few-shot Demonstrations. - Zican Dong; Han Peng; Peiyu Liu 002; Wayne Xin Zhao; Dong Wu; Feng Xiao; Zhifeng Wang (CoRR, 2025)