Zihan Qiu

According to our database, Zihan Qiu authored at least 34 papers between 2021 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training.

Shengkun Tang, Zekun Wang, Bo Zheng, Liangyu Wang, Rui Men, Siqi Zhang, Xiulong Yuan, Zihan Qiu, Zhiqiang Shen, Dayiheng Liu

CoRR, May, 2026

The Cancellation Hypothesis in Critic-Free RL: From Outcome Rewards to Token Credits.

Tianhao Cheng, Zeyu Huang, Zihan Qiu, Yu Cheng, Edoardo Maria Ponti, Yinghui Xu, Ivan Titov, Zenglin Xu

CoRR, May, 2026

Canzona: A Unified, Asynchronous, and Load-Balanced Framework for Distributed Matrix-based Optimizers.

Liangyu Wang, Siqi Zhang, Junjie Wang, Yiming Dong, Bo Zheng, Zihan Qiu, Shengkun Tang, Di Wang, Rui Men, Dayiheng Liu

CoRR, February, 2026

A Unified View of Attention and Residual Sinks: Outlier-Driven Rescaling is Essential for Transformer Training.

Zihan Qiu, Zeyu Huang, Kaiyue Wen, Peng Jin, Bo Zheng, Yuxin Zhou, Haofeng Huang, Zekun Wang, Xiao Li, Huaqing Zhang, Yang Xu, Haoran Lian, Siqi Zhang, Rui Men, Jianwei Zhang, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin

CoRR, January, 2026

2025

A survey on multilingual large language models: corpora, alignment, and bias.

Yuemei Xu, Ling Hu, Jiayi Zhao, Zihan Qiu, Kexin Xu, Yuqi Ye, Hanwen Gu

Frontiers Comput. Sci., November, 2025

Blending Supervised and Reinforcement Fine-Tuning with Prefix Sampling.

Zeyu Huang, Tianhao Cheng, Zihan Qiu, Zili Wang, Yinghui Xu, Edoardo M. Ponti, Ivan Titov

CoRR, July, 2025

Neo-TKGC: Enhancing Temporal Knowledge Graph Completion with Integrated Node Weights and Future Information.

Zihan Qiu, Xiaoling Zhou, Chunyan An, Qiang Yang, Zhixu Li

Proceedings of the Eighteenth ACM International Conference on Web Search and Data Mining, 2025

A Controllable Examination for Long-Context Language Models.

Yijun Yang, Zeyu Huang, Wenhao Zhu, Zihan Qiu, Fei Yuan, Jeff Z. Pan, Ivan Titov

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free.

Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, Junyang Lin

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

A Closer Look into Mixture-of-Experts in Large Language Models.

Ka Man Lo, Zeyu Huang, Zihan Qiu, Zili Wang, Jie Fu

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29, 2025

Layerwise Recurrent Router for Mixture-of-Experts.

Zihan Qiu, Zeyu Huang, Shuang Cheng, Yizhi Zhou, Zili Wang, Ivan Titov, Jie Fu

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Post-hoc Reward Calibration: A Case Study on Length Bias.

Zeyu Huang, Zihan Qiu, Zili Wang, Edoardo M. Ponti, Ivan Titov

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Demonstration of Nanoseconds Reconfigurable All-Optical Switching Network for Distributed Deep Learning.

Xianchen Wu, Daohang Dang, Xiangfei Chen, Bingli Guo, Shikui Shen, Zihan Qiu, Yuanzhi Guo, Changsheng Yang, Yisong Zhao, Wenzhe Li, Shanguo Huang, Xuwei Xue

Proceedings of the European Conference on Optical Communications, 2025

Demons in the Detail: On Implementing Load Balancing Loss for Training Specialized Mixture-of-Expert Models.

Zihan Qiu, Zeyu Huang, Bo Zheng, Kaiyue Wen, Zekun Wang, Rui Men, Ivan Titov, Dayiheng Liu, Jingren Zhou, Junyang Lin

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark.

Yongliang Wu, Wenbo Zhu, Jiawang Cao, Yi Lu, Bozheng Li, Weiheng Chi, Zihan Qiu, Lirian Su, Haolin Zheng, Jay Wu, Xu Yang

Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence, 2025

2024

Qwen2.5 Technical Report.

An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, Huan Lin, Jian Yang, Jianhong Tu, Jianwei Zhang, Jianxin Yang, Jiaxi Yang, Jingren Zhou, Junyang Lin, Kai Dang, Keming Lu, Keqin Bao, Kexin Yang, Le Yu, Mei Li, Mingfeng Xue, Pei Zhang, Qin Zhu, Rui Men, Runji Lin, Tianhao Li, Tingyu Xia, Xingzhang Ren, Xuancheng Ren, Yang Fan, Yang Su, Yichang Zhang, Yu Wan, Yuqiong Liu, Zeyu Cui, Zhenru Zhang, Zihan Qiu

CoRR, 2024

Reconstructing Global Daily CO2 Emissions via Machine Learning.

Tao Li, Lixing Wang, Zihan Qiu, Philippe Ciais, Taochun Sun, Matthew W. Jones, Robbie M. Andrew, Glen P. Peters, Piyu Ke, Xiaoting Huang, Robert B. Jackson, Zhu Liu

CoRR, 2024

GW-MoE: Resolving Uncertainty in MoE Router with Global Workspace Theory.

Haoze Wu, Zihan Qiu, Zili Wang, Hang Zhao, Jie Fu

CoRR, 2024

A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias.

Yuemei Xu, Ling Hu, Jiayi Zhao, Zihan Qiu, Yuqi Ye, Hanwen Gu

CoRR, 2024

HyperMoE: Paying Attention to Unselected Experts in Mixture of Experts via Dynamic Transfer.

Hao Zhao, Zihan Qiu, Huijia Wu, Zili Wang, Zhaofeng He, Jie Fu

CoRR, 2024

DSIFNet: Implicit feature network for nasal cavity and vestibule segmentation from 3D head CT.

Yi Lu, Hongjian Gao, Jikuan Qiu, Zihan Qiu, Junxiu Liu, Xiangzhi Bai

Comput. Medical Imaging Graph., 2024

ValueCSV: Evaluating Core Socialist Values Understanding in Large Language Models.

Yuemei Xu, Ling Hu, Zihan Qiu

Proceedings of the Natural Language Processing and Chinese Computing, 2024

Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training.

Wenyu Du, Tongxu Luo, Zihan Qiu, Zeyu Huang, Yikang Shen, Reynold Cheng, Yike Guo, Jie Fu

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Unlocking Emergent Modularity in Large Language Models.

Zihan Qiu, Zeyu Huang, Jie Fu

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Empirical Study on Updating Key-Value Memories in Transformer Feed-forward Layers.

Zihan Qiu, Zeyu Huang, Youcheng Huang, Jie Fu

Proceedings of the Second Tiny Papers Track at ICLR 2024, 2024

Unlocking Continual Learning Abilities in Language Models.

Wenyu Du, Shuang Cheng, Tongxu Luo, Zihan Qiu, Zeyu Huang, Ka Chun Cheung, Reynold Cheng, Jie Fu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

HyperMoE: Towards Better Mixture of Experts via Transferring Among Experts.

Hao Zhao, Zihan Qiu, Huijia Wu, Zili Wang, Zhaofeng He, Jie Fu

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

Heterogenous Memory Augmented Neural Networks.

Zihan Qiu, Zhen Liu, Shuicheng Yan, Shanghang Zhang, Jie Fu

CoRR, 2023

Emergent Mixture-of-Experts: Can Dense Pre-trained Transformers Benefit from Emergent Modular Structures?

Zihan Qiu, Zeyu Huang, Jie Fu

CoRR, 2023

2022

Supported Policy Optimization for Offline Reinforcement Learning.

Jialong Wu, Haixu Wu, Zihan Qiu, Jianmin Wang, Mingsheng Long

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

2021

Detection of Advertising Users Based on K-SMOTE and Ensemble Learning.

Zihan Qiu, Zekai Zhou, Yongxu Long, Chang Ji, Jianguo Li, Yong Tang

Proceedings of the Human Centered Computing - 7th International Conference, 2021

Academic Article Classification Algorithm Based on Pre-trained Model and Keyword Extraction.

Zekai Zhou, Dongyang Zheng, Zihan Qiu, Ronghua Lin, Zhengyang Wu, Chengzhe Yuan

Proceedings of the Computer Supported Cooperative Work and Social Computing, 2021

ResConvE: Deeper Convolution-Based Knowledge Graph Embeddings.

Yongxu Long, Zihan Qiu, Dongyang Zheng, Zhengyang Wu, Jianguo Li, Yong Tang

Proceedings of the Computer Supported Cooperative Work and Social Computing, 2021

A University Portrait System Incorporating Academic Social Network.

Yu Lai, Liantao Lan, Rui Liang, Li Huang, Zihan Qiu, Yong Tang

Proceedings of the Computer Supported Cooperative Work and Social Computing, 2021