Rui Pan

According to our database, Rui Pan authored at least 42 papers between 2022 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Chain-of-Experts: Unlocking the Communication Power of Mixture-of-Experts Models.

Zihan Wang, Rui Pan, Jiarui Yao, Robert Csordas, Linjie Li, Lu Yin, Jiajun Wu, Tong Zhang, Manling Li, Shiwei Liu

CoRR, June, 2025

VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training.

Jipeng Zhang, Kehao Miao, Renjie Pi, Zhaowei Wang, Runtao Liu, Rui Pan, Tong Zhang

CoRR, June, 2025

Understanding Overadaptation in Supervised Fine-Tuning: The Role of Ensemble Methods.

Yifan Hao, Xingyuan Pan, Hanning Zhang, Chenlu Ye, Rui Pan, Tong Zhang

CoRR, June, 2025

MiCRo: Mixture Modeling and Context-aware Routing for Personalized Preference Learning.

Jingyan Shen, Jiarui Yao, Rui Yang, Yifan Sun, Feng Luo, Rui Pan, Tong Zhang, Han Zhao

CoRR, May, 2025

AstroMLab 4: Benchmark-Topping Performance in Astronomy Q&A with a 70B-Parameter Domain-Specialized Reasoning Model.

Tijmen de Haan, Yuan-Sen Ting, Tirthankar Ghosal, Tuan Dung Nguyen, Alberto Accomazzi, Emily Herron, Vanessa Lama, Rui Pan, Azton Wells, Nesar Ramachandra

CoRR, May, 2025

ASGO: Adaptive Structured Gradient Optimization.

Kang An, Yuxing Liu, Rui Pan, Shiqian Ma, Donald Goldfarb, Tong Zhang

CoRR, March, 2025

MA-LoT: Multi-Agent Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving.

Ruida Wang, Rui Pan, Yuxin Li, Jipeng Zhang, Yizhen Jia, Shizhe Diao, Renjie Pi, Junjie Hu, Tong Zhang

CoRR, March, 2025

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training.

Boyao Wang, Rui Pan, Shizhe Diao, Xingyuan Pan, Jipeng Zhang, Renjie Pi, Tong Zhang

CoRR, February, 2025

Entropy-Regularized Process Reward Model.

Hanning Zhang, Pengcheng Wang, Shizhe Diao, Yong Lin, Rui Pan, Hanze Dong, Dylan Zhang, Pavlo Molchanov, Tong Zhang

Trans. Mach. Learn. Res., 2025

AstroMLab 1: Who wins astronomy jeopardy!?

Yuan-Sen Ting, Tuan Dung Nguyen, Tirthankar Ghosal, Rui Pan, Hardik Arora, Zechang Sun, Tijmen de Haan, Nesar Ramachandra, Azton Wells, Sandeep Madireddy, Alberto Accomazzi

Astron. Comput., 2025

TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data.

Jipeng Zhang, Yaxuan Qin, Renjie Pi, Weizhong Zhang, Rui Pan, Tong Zhang

Proceedings of the Findings of the Association for Computational Linguistics: NAACL 2025, Albuquerque, New Mexico, USA, April 29, 2025

Personalized Visual Instruction Tuning.

Renjie Pi, Jianshu Zhang, Tianyang Han, Jipeng Zhang, Rui Pan, Tong Zhang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

AdaGrad under Anisotropic Smoothness.

Yuxing Liu, Rui Pan, Tong Zhang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Bridge-Coder: Transferring Model Capabilities from High-Resource to Low-Resource Programming Language.

Jipeng Zhang, Jianshu Zhang, Yuanzhe Li, Renjie Pi, Rui Pan, Runtao Liu, Ziqiang Zheng, Tong Zhang

Proceedings of the Findings of the Association for Computational Linguistics, 2025

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting.

Rui Pan, Dylan Zhang, Hanning Zhang, Xingyuan Pan, Minrui Xu, Jipeng Zhang, Renjie Pi, Xiaoyu Wang, Tong Zhang

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

Fox-1 Technical Report.

Zijian Hu, Jipeng Zhang, Rui Pan, Zhaozhuo Xu, Shanshan Han, Han Jin, Alay Dilipbhai Shah, Dimitris Stripelis, Yuhang Yao, Salman Avestimehr, Chaoyang He, Tong Zhang

CoRR, 2024

Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code.

Jipeng Zhang, Jianshu Zhang, Yuanzhe Li, Renjie Pi, Rui Pan, Runtao Liu, Ziqiang Zheng, Tong Zhang

CoRR, 2024

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting.

Rui Pan, Jipeng Zhang, Xingyuan Pan, Renjie Pi, Xiaoyu Wang, Tong Zhang

CoRR, 2024

Large Batch Analysis for Adagrad Under Anisotropic Smoothness.

Yuxing Liu, Rui Pan, Tong Zhang

CoRR, 2024

Image Textualization: An Automatic Framework for Creating Accurate and Detailed Image Descriptions.

Renjie Pi, Jianshu Zhang, Jipeng Zhang, Rui Pan, Zhekai Chen, Tong Zhang

CoRR, 2024

The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs.

Tianyang Han, Qing Lian, Rui Pan, Renjie Pi, Jipeng Zhang, Shizhe Diao, Yong Lin, Tong Zhang

CoRR, 2024

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance.

Renjie Pi, Tianyang Han, Yueqi Xie, Rui Pan, Qing Lian, Hanze Dong, Jipeng Zhang, Tong Zhang

CoRR, 2024

AstroLLaMA-Chat: Scaling AstroLLaMA with Conversational and Diverse Datasets.

Ernest Perkowski, Rui Pan, Tuan Dung Nguyen, Yuan-Sen Ting, Sandor Kruk, Tong Zhang, Charlie O'Neill, Maja Jablonska, Zechang Sun, Michael J. Smith, Huiling Liu, Kevin Schawinski, Kartheik Iyer, Ioana Ciuca, UniverseTBD

CoRR, 2024

AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy.

Rui Pan, Tuan Dung Nguyen, Hardik Arora, Alberto Accomazzi, Tirthankar Ghosal, Yuan-Sen Ting

Proceedings of the SC24-W: Workshops of the International Conference for High Performance Computing, 2024

Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions.

Renjie Pi, Jianshu Zhang, Jipeng Zhang, Rui Pan, Zhekai Chen, Tong Zhang

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning.

Rui Pan, Xiang Liu, Shizhe Diao, Renjie Pi, Jipeng Zhang, Chi Han, Tong Zhang

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models.

Shizhe Diao, Rui Pan, Hanze Dong, Kashun Shum, Jipeng Zhang, Wei Xiong, Tong Zhang

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: System Demonstrations, 2024

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise.

Rui Pan, Yuxing Liu, Xiaoyu Wang, Tong Zhang

Proceedings of the Twelfth International Conference on Learning Representations, 2024

TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts.

Ruida Wang, Jipeng Zhang, Yizhen Jia, Rui Pan, Shizhe Diao, Renjie Pi, Tong Zhang

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance.

Renjie Pi, Tianyang Han, Jianshu Zhang, Yueqi Xie, Rui Pan, Qing Lian, Hanze Dong, Jipeng Zhang, Tong Zhang

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Mitigating the Alignment Tax of RLHF.

Yong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao, Jianmeng Liu, Jipeng Zhang, Rui Pan, Haoxiang Wang, Wenbin Hu, Hanning Zhang, Hanze Dong, Renjie Pi, Han Zhao, Nan Jiang, Heng Ji, Yuan Yao, Tong Zhang

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

The Instinctive Bias: Spurious Images lead to Illusion in MLLMs.

Tianyang Han, Qing Lian, Rui Pan, Renjie Pi, Jipeng Zhang, Shizhe Diao, Yong Lin, Tong Zhang

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization.

Renjie Pi, Tianyang Han, Wei Xiong, Jipeng Zhang, Runtao Liu, Rui Pan, Tong Zhang

Proceedings of the Computer Vision - ECCV 2024, 2024

Plum: Prompt Learning using Metaheuristics.

Rui Pan, Shuo Xing, Shizhe Diao, Wenhe Sun, Xiang Liu, Kashun Shum, Jipeng Zhang, Renjie Pi, Tong Zhang

Proceedings of the Findings of the Association for Computational Linguistics, 2024

Active Prompting with Chain-of-Thought for Large Language Models.

Shizhe Diao, Pengcheng Wang, Yong Lin, Rui Pan, Xiang Liu, Tong Zhang

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

2023

RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment.

Hanze Dong, Wei Xiong, Deepanshu Goyal, Yihan Zhang, Winnie Chow, Rui Pan, Shizhe Diao, Jipeng Zhang, Kashun Shum, Tong Zhang

Trans. Mach. Learn. Res., 2023

Plum: Prompt Learning using Metaheuristic.

Rui Pan, Shuo Xing, Shizhe Diao, Xiang Liu, Kashun Shum, Jipeng Zhang, Tong Zhang

CoRR, 2023

Mitigating the Alignment Tax of RLHF.

Yong Lin, Hangyu Lin, Wei Xiong, Shizhe Diao, Jianmeng Liu, Jipeng Zhang, Rui Pan, Haoxiang Wang, Wenbin Hu, Hanning Zhang, Hanze Dong, Renjie Pi, Han Zhao, Nan Jiang, Yuan Yao, Tong Zhang

CoRR, 2023

RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment.

Hanze Dong, Wei Xiong, Deepanshu Goyal, Rui Pan, Shizhe Diao, Jipeng Zhang, Kashun Shum, Tong Zhang

CoRR, 2023

DetGPT: Detect What You Need via Reasoning.

Renjie Pi, Jiahui Gao, Shizhe Diao, Rui Pan, Hanze Dong, Jipeng Zhang, Lewei Yao, Jianhua Han, Hang Xu, Lingpeng Kong, Tong Zhang

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT.

Rui Pan, Shizhe Diao, Jianlin Chen, Tong Zhang

CoRR, 2022

Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objectives with Skewed Hessian Spectrums.

Rui Pan, Haishan Ye, Tong Zhang

Proceedings of the Tenth International Conference on Learning Representations, 2022