Eigencurve: Optimal Learning Rate Schedule for SGD on Quadratic Objectives with Skewed Hessian Spectrums. - Rui Pan 002; Haishan Ye; Tong Zhang 001 (ICLR, 2022)

ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT. - Rui Pan 002; Shizhe Diao; Jianlin Chen; Tong Zhang 001 (CoRR, 2022)

DetGPT: Detect What You Need via Reasoning. - Renjie Pi; Jiahui Gao; Shizhe Diao; Rui Pan 002; Hanze Dong; Jipeng Zhang; Lewei Yao; Jianhua Han; Hang Xu 004; Lingpeng Kong; Tong Zhang 001 (EMNLP, 2023)

RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment. - Hanze Dong; Wei Xiong 015; Deepanshu Goyal; Rui Pan 002; Shizhe Diao; Jipeng Zhang; Kashun Shum; Tong Zhang 001 (CoRR, 2023)

Mitigating the Alignment Tax of RLHF. - Yong Lin; Hangyu Lin; Wei Xiong 015; Shizhe Diao; Jianmeng Liu; Jipeng Zhang; Rui Pan 002; Haoxiang Wang 003; Wenbin Hu 002; Hanning Zhang; Hanze Dong; Renjie Pi; et al. (CoRR, 2023)

Plum: Prompt Learning using Metaheuristic. - Rui Pan 002; Shuo Xing; Shizhe Diao; Xiang Liu; Kashun Shum; Jipeng Zhang; Tong Zhang 001 (CoRR, 2023)

RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment. - Hanze Dong; Wei Xiong 015; Deepanshu Goyal; Yihan Zhang; Winnie Chow; Rui Pan 002; Shizhe Diao; Jipeng Zhang; Kashun Shum; Tong Zhang 001 (Trans. Mach. Learn. Res., 2023)

Active Prompting with Chain-of-Thought for Large Language Models. - Shizhe Diao; Pengcheng Wang 005; Yong Lin; Rui Pan 002; Xiang Liu; Tong Zhang 001 (ACL (1), 2024)

Plum: Prompt Learning using Metaheuristics. - Rui Pan 002; Shuo Xing; Shizhe Diao; Wenhe Sun; Xiang Liu; Kashun Shum; Jipeng Zhang; Renjie Pi; Tong Zhang 001 (ACL (Findings), 2024)

Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization. - Renjie Pi; Tianyang Han; Wei Xiong 015; Jipeng Zhang; Runtao Liu; Rui Pan 002; Tong Zhang 001 (ECCV (33), 2024)

The Instinctive Bias: Spurious Images lead to Illusion in MLLMs. - Tianyang Han; Qing Lian; Rui Pan 002; Renjie Pi; Jipeng Zhang; Shizhe Diao; Yong Lin; Tong Zhang 001 (EMNLP, 2024)

Mitigating the Alignment Tax of RLHF. - Yong Lin; Hangyu Lin; Wei Xiong 015; Shizhe Diao; Jianmeng Liu; Jipeng Zhang; Rui Pan 002; Haoxiang Wang 003; Wenbin Hu 002; Hanning Zhang; Hanze Dong; Renjie Pi; et al. (EMNLP, 2024)

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance. - Renjie Pi; Tianyang Han; Jianshu Zhang 003; Yueqi Xie; Rui Pan 002; Qing Lian; Hanze Dong; Jipeng Zhang; Tong Zhang 001 (EMNLP, 2024)

TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts. - Ruida Wang; Jipeng Zhang; Yizhen Jia; Rui Pan 002; Shizhe Diao; Renjie Pi; Tong Zhang 001 (EMNLP, 2024)

Accelerated Convergence of Stochastic Heavy Ball Method under Anisotropic Gradient Noise. - Rui Pan 002; Yuxing Liu; Xiaoyu Wang 008; Tong Zhang 001 (ICLR, 2024)

LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. - Shizhe Diao; Rui Pan 002; Hanze Dong; Kashun Shum; Jipeng Zhang; Wei Xiong 015; Tong Zhang 001 (NAACL (Demonstrations), 2024)

LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning. - Rui Pan 002; Xiang Liu; Shizhe Diao; Renjie Pi; Jipeng Zhang; Chi Han; Tong Zhang 001 (NeurIPS, 2024)

Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions. - Renjie Pi; Jianshu Zhang 003; Jipeng Zhang; Rui Pan 002; Zhekai Chen; Tong Zhang 001 (NeurIPS, 2024)

AstroMLab 2: AstroLLaMA-2-70B Model and Benchmarking Specialised LLMs for Astronomy. - Rui Pan 002; Tuan Dung Nguyen; Hardik Arora; Alberto Accomazzi; Tirthankar Ghosal; Yuan-Sen Ting (SC Workshops, 2024)

AstroLLaMA-Chat: Scaling AstroLLaMA with Conversational and Diverse Datasets. - Ernest Perkowski; Rui Pan 002; Tuan Dung Nguyen; Yuan-Sen Ting; Sandor Kruk; Tong Zhang 001; Charlie O'Neill; Maja Jablonska; Zechang Sun; Michael J. Smith 013; Huiling Liu; Kevin Schawinski; et al. (CoRR, 2024)

MLLM-Protector: Ensuring MLLM's Safety without Hurting Performance. - Renjie Pi; Tianyang Han; Yueqi Xie; Rui Pan 002; Qing Lian; Hanze Dong; Jipeng Zhang; Tong Zhang 001 (CoRR, 2024)

The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs. - Tianyang Han; Qing Lian; Rui Pan 002; Renjie Pi; Jipeng Zhang; Shizhe Diao; Yong Lin; Tong Zhang 001 (CoRR, 2024)

Image Textualization: An Automatic Framework for Creating Accurate and Detailed Image Descriptions. - Renjie Pi; Jianshu Zhang 003; Jipeng Zhang; Rui Pan 002; Zhekai Chen; Tong Zhang 001 (CoRR, 2024)

Large Batch Analysis for Adagrad Under Anisotropic Smoothness. - Yuxing Liu; Rui Pan 002; Tong Zhang 001 (CoRR, 2024)

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting. - Rui Pan 002; Jipeng Zhang; Xingyuan Pan; Renjie Pi; Xiaoyu Wang 008; Tong Zhang 001 (CoRR, 2024)

Bridge-Coder: Unlocking LLMs' Potential to Overcome Language Gaps in Low-Resource Code. - Jipeng Zhang; Jianshu Zhang 003; Yuanzhe Li; Renjie Pi; Rui Pan 002; Runtao Liu; Ziqiang Zheng; Tong Zhang 001 (CoRR, 2024)

Fox-1 Technical Report. - Zijian Hu 001; Jipeng Zhang; Rui Pan 002; Zhaozhuo Xu; Shanshan Han; Han Jin; Alay Dilipbhai Shah; Dimitris Stripelis; Yuhang Yao; Salman Avestimehr; Chaoyang He 001; Tong Zhang 001 (CoRR, 2024)

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting. - Rui Pan 002; Dylan Zhang; Hanning Zhang; Xingyuan Pan; Minrui Xu; Jipeng Zhang; Renjie Pi; Xiaoyu Wang 008; Tong Zhang 001 (ACL (1), 2025)

Bridge-Coder: Transferring Model Capabilities from High-Resource to Low-Resource Programming Language. - Jipeng Zhang; Jianshu Zhang 003; Yuanzhe Li; Renjie Pi; Rui Pan 002; Runtao Liu; Ziqiang Zheng; Tong Zhang 001 (ACL (Findings), 2025)

AdaGrad under Anisotropic Smoothness. - Yuxing Liu; Rui Pan 002; Tong Zhang 001 (ICLR, 2025)

Personalized Visual Instruction Tuning. - Renjie Pi; Jianshu Zhang 003; Tianyang Han; Jipeng Zhang; Rui Pan 002; Tong Zhang 001 (ICLR, 2025)

TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data. - Jipeng Zhang; Yaxuan Qin; Renjie Pi; Weizhong Zhang; Rui Pan 002; Tong Zhang 001 (NAACL (Findings), 2025)

AstroMLab 1: Who wins astronomy jeopardy!? - Yuan-Sen Ting; Tuan Dung Nguyen; Tirthankar Ghosal; Rui Pan 002; Hardik Arora; Zechang Sun; Tijmen de Haan; Nesar Ramachandra; Azton Wells; Sandeep Madireddy; Alberto Accomazzi (Astron. Comput., 2025)

Entropy-Regularized Process Reward Model. - Hanning Zhang; Pengcheng Wang 005; Shizhe Diao; Yong Lin; Rui Pan 002; Hanze Dong; Dylan Zhang; Pavlo Molchanov 001; Tong Zhang 001 (Trans. Mach. Learn. Res., 2025)

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training. - Boyao Wang; Rui Pan 002; Shizhe Diao; Xingyuan Pan; Jipeng Zhang; Renjie Pi; Tong Zhang 001 (CoRR, 2025)

MA-LoT: Multi-Agent Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving. - Ruida Wang; Rui Pan 002; Yuxin Li; Jipeng Zhang; Yizhen Jia; Shizhe Diao; Renjie Pi; Junjie Hu; Tong Zhang 001 (CoRR, 2025)

ASGO: Adaptive Structured Gradient Optimization. - Kang An; Yuxing Liu; Rui Pan 002; Shiqian Ma; Donald Goldfarb; Tong Zhang 001 (CoRR, 2025)

AstroMLab 4: Benchmark-Topping Performance in Astronomy Q&A with a 70B-Parameter Domain-Specialized Reasoning Model. - Tijmen de Haan; Yuan-Sen Ting; Tirthankar Ghosal; Tuan Dung Nguyen; Alberto Accomazzi; Emily Herron; Vanessa Lama; Rui Pan 002; Azton Wells; Nesar Ramachandra (CoRR, 2025)

MiCRo: Mixture Modeling and Context-aware Routing for Personalized Preference Learning. - Jingyan Shen; Jiarui Yao; Rui Yang 010; Yifan Sun; Feng Luo; Rui Pan 002; Tong Zhang 001; Han Zhao 002 (CoRR, 2025)

Understanding Overadaptation in Supervised Fine-Tuning: The Role of Ensemble Methods. - Yifan Hao 002; Xingyuan Pan; Hanning Zhang; Chenlu Ye; Rui Pan 002; Tong Zhang 001 (CoRR, 2025)

VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training. - Jipeng Zhang; Kehao Miao; Renjie Pi; Zhaowei Wang; Runtao Liu; Rui Pan 002; Tong Zhang 001 (CoRR, 2025)

Chain-of-Experts: Unlocking the Communication Power of Mixture-of-Experts Models. - Zihan Wang 008; Rui Pan 002; Jiarui Yao; Robert Csordas; Linjie Li; Lu Yin; Jiajun Wu 001; Tong Zhang 001; Manling Li; Shiwei Liu (CoRR, 2025)