Runyu Peng

According to our database, Runyu Peng authored at least 11 papers between 2020 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

How Attention Sinks Emerge in Large Language Models: An Interpretability Perspective.

Runyu Peng, Ruixiao Li, Mingshu Chen, Yunhua Zhou, Qipeng Guo, Xipeng Qiu

CoRR, March, 2026

Explicit Multi-head Attention for Inter-head Interaction in Large Language Models.

Runyu Peng, Yunhua Zhou, Demin Song, Kai Lv, Bo Wang, Qipeng Guo, Xipeng Qiu

CoRR, January, 2026

How to Set the Batch Size for Large-Scale Pre-training?

Yunhua Zhou, Junhao Huang, Shuhao Xing, Yechen Zhang, Runyu Peng, Qiping Guo, Xipeng Qiu

CoRR, January, 2026

2025

Intern-S1: A Scientific Multimodal Foundation Model.

Intern-S1 Team, Runyu Peng, Yu Qiao

CoRR, August, 2025

Implicit Reward as the Bridge: A Unified View of SFT and DPO Connections.

Bo Wang, Qinyuan Cheng, Runyu Peng, Rong Bao, Peiji Li, Qipeng Guo, Linyang Li, Zhiyuan Zeng, Yunhua Zhou, Xipeng Qiu

CoRR, July, 2025

AutoLogi: Automated Generation of Logic Puzzles for Evaluating Reasoning Abilities of Large Language Models.

Qin Zhu, Fei Huang, Runyu Peng, Keming Lu, Bowen Yu, Qinyuan Cheng, Xipeng Qiu, Xuanjing Huang, Junyang Lin

CoRR, February, 2025

Firewall Routing: Blocking Leads to Better Hybrid Inference for LLMs.

Runyu Peng, Yunhua Zhou, Kai Lv, Yang Gao, Qipeng Guo, Xipeng Qiu

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

2024

WanJuan-CC: A Safe and High-Quality Open-sourced English Webtext Dataset.

Jiantao Qiu, Haijun Lv, Zhenjiang Jin, Rui Wang, Wenchang Ning, Jia Yu, ChaoBin Zhang, Zhenxiang Li, Pei Chu, Yuan Qu, Jin Shi, Lindong Lu, Runyu Peng, Zhiyuan Zeng, Huanze Tang, Zhikai Lei, Jiawei Hong, Keyu Chen, Zhaoye Fei, Ruiliang Xu, Wei Li, Zhongying Tu, Dahua Lin, Yu Qiao, Hang Yan, Conghui He

CoRR, 2024

Data-freeWeight Compress and Denoise for Large Language Models.

Runyu Peng, Yunhua Zhou, Qipeng Guo, Yang Gao, Hang Yan, Xipeng Qiu, Dahua Lin

CoRR, 2024

Inference-Time Decontamination: Reusing Leaked Benchmarks for Large Language Model Evaluation.

Qin Zhu, Qinyuan Cheng, Runyu Peng, Xiaonan Li, Ru Peng, Tengxiao Liu, Xipeng Qiu, Xuanjing Huang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

2020

Look into Multi-Person: A New Benchmark for Pose Estimation and Human Parsing.

Yanlu Cai, Yuqing Li, Runyu Peng, Yipei Xu, Chenzhe Jin, Cheng Jin

Proceedings of the 2020 IEEE International Conference on Big Data (IEEE BigData 2020), 2020