GubaLex: Guba-Oriented Sentiment Lexicon for Big Texts in Finance. - Yunchuan Sun; Mengting Fang; Xinyu Wang; Shizhe Diao (SKG, 2017)

ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations. - Shizhe Diao; Jiaxin Bai; Yan Song 003; Tong Zhang 001; Yonggang Wang (EMNLP (Findings), 2020)

TILGAN: Transformer-based Implicit Latent GAN for Diverse and Coherent Text Generation. - Shizhe Diao; Xinwei Shen 002; Kashun Shum; Yan Song 003; Tong Zhang 001 (ACL/IJCNLP (Findings), 2021)

Taming Pre-trained Language Models with N-gram Representations for Low-Resource Domain Adaptation. - Shizhe Diao; Ruijia Xu; Hongjin Su; Yilei Jiang; Yan Song 003; Tong Zhang 001 (ACL/IJCNLP (1), 2021)

Efficient Neural Network Training via Forward and Backward Propagation Sparsification. - Xiao Zhou; Weizhong Zhang; Zonghao Chen; Shizhe Diao; Tong Zhang 001 (NeurIPS, 2021)

VLUE: A Multi-Task Multi-Dimension Benchmark for Evaluating Vision-Language Pre-training. - Wangchunshu Zhou; Yan Zeng 003; Shizhe Diao; Xinsong Zhang (ICML, 2022)

Black-box Prompt Learning for Pre-trained Language Models. - Shizhe Diao; Xuechun Li; Yong Lin; Zhichao Huang 002; Tong Zhang 001 (CoRR, 2022)

VLUE: A Multi-Task Benchmark for Evaluating Vision-Language Models. - Wangchunshu Zhou; Yan Zeng 003; Shizhe Diao; Xinsong Zhang (CoRR, 2022)

Prefix Language Models are Unified Modal Learners. - Shizhe Diao; Wangchunshu Zhou; Xinsong Zhang; Jiawei Wang (CoRR, 2022)

Normalizing Flow with Variational Latent Representation. - Hanze Dong; Shizhe Diao; Weizhong Zhang; Tong Zhang 001 (CoRR, 2022)

ExtremeBERT: A Toolkit for Accelerating Pretraining of Customized BERT. - Rui Pan 002; Shizhe Diao; Jianlin Chen; Tong Zhang 001 (CoRR, 2022)

On the Difference of BERT-style and CLIP-style Text Encoders. - Zhihong Chen; Guiming Chen; Shizhe Diao; Xiang Wan; Benyou Wang (ACL (Findings), 2023)

Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memories. - Shizhe Diao; Tianyang Xu; Ruijia Xu; Jiawei Wang; Tong Zhang 001 (ACL (1), 2023)

Doolittle: Benchmarks and Corpora for Academic Writing Formalization. - Shizhe Diao; Yongyu Lei; Liangming Pan; Tianqing Fang; Wangchunshu Zhou; Sedrick Scott Keh; Min-Yen Kan; Tong Zhang 001 (EMNLP, 2023)

DetGPT: Detect What You Need via Reasoning. - Renjie Pi; Jiahui Gao; Shizhe Diao; Rui Pan 002; Hanze Dong; Jipeng Zhang; Lewei Yao; Jianhua Han; Hang Xu 004; Lingpeng Kong; Tong Zhang 001 (EMNLP, 2023)

Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data. - Kashun Shum; Shizhe Diao; Tong Zhang 001 (EMNLP (Findings), 2023)

Towards Unifying Medical Vision-and-Language Pre-training via Soft Prompts. - Zhihong Chen; Shizhe Diao; Benyou Wang; Guanbin Li; Xiang Wan (ICCV, 2023)

Write and Paint: Generative Vision-Language Models are Unified Modal Learners. - Shizhe Diao; Wangchunshu Zhou; Xinsong Zhang; Jiawei Wang (ICLR, 2023)

Hashtag-Guided Low-Resource Tweet Classification. - Shizhe Diao; Sedrick Scott Keh; Liangming Pan; Zhiliang Tian; Yan Song 003; Tong Zhang 001 (WWW, 2023)

Active Prompting with Chain-of-Thought for Large Language Models. - Shizhe Diao; Pengcheng Wang 005; Yong Lin; Tong Zhang 001 (CoRR, 2023)

RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment. - Hanze Dong; Wei Xiong 015; Deepanshu Goyal; Rui Pan 002; Shizhe Diao; Jipeng Zhang; Kashun Shum; Tong Zhang 001 (CoRR, 2023)

On the Difference of BERT-style and CLIP-style Text Encoders. - Zhihong Chen; Guiming Hardy Chen; Shizhe Diao; Xiang Wan; Benyou Wang (CoRR, 2023)

Mitigating the Alignment Tax of RLHF. - Yong Lin; Hangyu Lin; Wei Xiong 015; Shizhe Diao; Jianmeng Liu; Jipeng Zhang; Rui Pan 002; Haoxiang Wang 003; Wenbin Hu 002; Hanning Zhang; Hanze Dong; Renjie Pi; et al. (CoRR, 2023)

MarineGPT: Unlocking Secrets of Ocean to the Public. - Ziqiang Zheng; Jipeng Zhang; Tuan-Anh Vu; Shizhe Diao; Yue Him Tim Wong; Sai-Kit Yeung (CoRR, 2023)

Plum: Prompt Learning using Metaheuristic. - Rui Pan 002; Shuo Xing; Shizhe Diao; Xiang Liu; Kashun Shum; Jipeng Zhang; Tong Zhang 001 (CoRR, 2023)

R-Tuning: Teaching Large Language Models to Refuse Unknown Questions. - Hanning Zhang; Shizhe Diao; Yong Lin; Yi R. Fung 001; Qing Lian; Xingyao Wang 002; Yangyi Chen; Heng Ji 001; Tong Zhang 001 (CoRR, 2023)

Black-Box Prompt Learning for Pre-trained Language Models. - Shizhe Diao; Zhichao Huang 002; Ruijia Xu; Xuechun Li; Yong Lin; Xiao Zhou; Tong Zhang 001 (Trans. Mach. Learn. Res., 2023)

RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment. - Hanze Dong; Wei Xiong 015; Deepanshu Goyal; Yihan Zhang; Winnie Chow; Rui Pan 002; Shizhe Diao; Jipeng Zhang; Kashun Shum; Tong Zhang 001 (Trans. Mach. Learn. Res., 2023)

Active Prompting with Chain-of-Thought for Large Language Models. - Shizhe Diao; Pengcheng Wang 005; Yong Lin; Rui Pan 002; Xiang Liu; Tong Zhang 001 (ACL (1), 2024)

Plum: Prompt Learning using Metaheuristics. - Rui Pan 002; Shuo Xing; Shizhe Diao; Wenhe Sun; Xiang Liu; Kashun Shum; Jipeng Zhang; Renjie Pi; Tong Zhang 001 (ACL (Findings), 2024)

Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards. - Haoxiang Wang 003; Yong Lin; Wei Xiong 015; Rui Yang 010; Shizhe Diao; Shuang Qiu; Han Zhao 002; Tong Zhang 001 (ACL (1), 2024)

ConstraintChecker: A Plugin for Large Language Models to Reason on Commonsense Knowledge Bases. - Quyet V. Do; Tianqing Fang; Shizhe Diao; Zhaowei Wang 003; Yangqiu Song (EACL (1), 2024)

The Instinctive Bias: Spurious Images lead to Illusion in MLLMs. - Tianyang Han; Qing Lian; Rui Pan 002; Renjie Pi; Jipeng Zhang; Shizhe Diao; Yong Lin; Tong Zhang 001 (EMNLP, 2024)

Mitigating the Alignment Tax of RLHF. - Yong Lin; Hangyu Lin; Wei Xiong 015; Shizhe Diao; Jianmeng Liu; Jipeng Zhang; Rui Pan 002; Haoxiang Wang 003; Wenbin Hu 002; Hanning Zhang; Hanze Dong; Renjie Pi; et al. (EMNLP, 2024)

FIRST: Teach A Reliable Large Language Model Through Efficient Trustworthy Distillation. - KaShun Shum; Minrui Xu; Jianshu Zhang 003; Zixin Chen; Shizhe Diao; Hanze Dong; Jipeng Zhang; Muhammad Omer Raza (EMNLP, 2024)

TheoremLlama: Transforming General-Purpose LLMs into Lean4 Experts. - Ruida Wang; Jipeng Zhang; Yizhen Jia; Rui Pan 002; Shizhe Diao; Renjie Pi; Tong Zhang 001 (EMNLP, 2024)

SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales. - Tianyang Xu; Shujin Wu; Shizhe Diao; Xiaoze Liu; Xingyao Wang 002; Yangyi Chen; Jing Gao 004 (EMNLP, 2024)

LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. - Shizhe Diao; Rui Pan 002; Hanze Dong; Kashun Shum; Jipeng Zhang; Wei Xiong 015; Tong Zhang 001 (NAACL (Demonstrations), 2024)

R-Tuning: Instructing Large Language Models to Say 'I Don't Know'. - Hanning Zhang; Shizhe Diao; Yong Lin; Yi R. Fung 001; Qing Lian; Xingyao Wang 002; Yangyi Chen; Heng Ji 001; Tong Zhang 001 (NAACL-HLT, 2024)

LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning. - Rui Pan 002; Xiang Liu; Shizhe Diao; Renjie Pi; Jipeng Zhang; Chi Han; Tong Zhang 001 (NeurIPS, 2024)

UniTime: A Language-Empowered Unified Model for Cross-Domain Time Series Forecasting. - Xu Liu 014; Junfeng Hu 001; Yuan Li 032; Shizhe Diao; Yuxuan Liang; Bryan Hooi; Roger Zimmermann (WWW, 2024)

The Instinctive Bias: Spurious Images lead to Hallucination in MLLMs. - Tianyang Han; Qing Lian; Rui Pan 002; Renjie Pi; Jipeng Zhang; Shizhe Diao; Yong Lin; Tong Zhang 001 (CoRR, 2024)

Can We Verify Step by Step for Incorrect Answer Detection? - Xin Xu; Shizhe Diao; Can Yang; Yang Wang 020 (CoRR, 2024)

PLUM: Preference Learning Plus Test Cases Yields Better Code Language Models. - Dylan Zhang; Shizhe Diao; Xueyan Zou; Hao Peng (CoRR, 2024)

VeraCT Scan: Retrieval-Augmented Fake News Detection with Justifiable Reasoning. - Cheng Niu; Yang Guan; Yuanhao Wu; Juno Zhu; Juntong Song; Randy Zhong; Kaihua Zhu; Siliang Xu; Shizhe Diao; Tong Zhang 001 (CoRR, 2024)

CodeGraph: Enhancing Graph Reasoning of LLMs with Code. - Qiaolong Cai; Zhaowei Wang 003; Shizhe Diao; James Kwok; Yangqiu Song (CoRR, 2024)

Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models. - Haibo Wang; Zhiyang Xu; Yu Cheng; Shizhe Diao; Yufan Zhou 001; Yixin Cao 006; Qifan Wang 001; Weifeng Ge; Lifu Huang (CoRR, 2024)

Hymba: A Hybrid-head Architecture for Small Language Models. - Xin Dong 009; Yonggan Fu; Shizhe Diao; Wonmin Byeon; Zijia Chen; Ameya Sunil Mahabaleshwarkar; Shih-Yang Liu; Matthijs Van Keirsbilck; Min-Hung Chen; Yoshi Suhara; Yingyan Celine Lin; Jan Kautz; et al. (ICLR, 2025)

LongMamba: Enhancing Mamba's Long-Context Capabilities via Training-Free Receptive Field Enlargement. - Zhifan Ye; Kejing Xia; Yonggan Fu; Xin Dong 009; Jihoon Hong; Xiangchi Yuan; Shizhe Diao; Jan Kautz; Pavlo Molchanov 001; Yingyan Celine Lin (ICLR, 2025)

Entropy-Regularized Process Reward Model. - Hanning Zhang; Pengcheng Wang 005; Shizhe Diao; Yong Lin; Rui Pan 002; Hanze Dong; Dylan Zhang; Pavlo Molchanov 001; Tong Zhang 001 (Trans. Mach. Learn. Res., 2025)

UGPhysics: A Comprehensive Benchmark for Undergraduate Physics Reasoning with Large Language Models. - Xin Xu; Qiyun Xu; Tong Xiao; Tianhao Chen; Yuchen Yan; Jiaxin Zhang; Shizhe Diao; Can Yang; Yang Wang 020 (CoRR, 2025)

Adapt-Pruner: Adaptive Structural Pruning for Efficient Small Language Model Training. - Boyao Wang; Rui Pan 002; Shizhe Diao; Xingyuan Pan; Jipeng Zhang; Renjie Pi; Tong Zhang 001 (CoRR, 2025)

MA-LoT: Multi-Agent Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem Proving. - Ruida Wang; Rui Pan 002; Yuxin Li; Jipeng Zhang; Yizhen Jia; Shizhe Diao; Renjie Pi; Junjie Hu; Tong Zhang 001 (CoRR, 2025)

CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training. - Shizhe Diao; Yu Yang; Yonggan Fu; Xin Dong 009; Dan Su 003; Markus Kliegl; Zijia Chen; Peter Belcak; Yoshi Suhara; Hongxu Yin; Mostofa Patwary; Yingyan Lin; et al. (CoRR, 2025)

Fast-dLLM: Training-free Acceleration of Diffusion LLM by Enabling KV Cache and Parallel Decoding. - Chengyue Wu; Hao Zhang 097; Shuchen Xue; Zhijian Liu; Shizhe Diao; Ligeng Zhu; Ping Luo 002; Song Han 003; Enze Xie (CoRR, 2025)

ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models. - Mingjie Liu; Shizhe Diao; Ximing Lu; Jian Hu; Xin Dong 009; Yejin Choi 001; Jan Kautz; Yi Dong (CoRR, 2025)

Small Language Models are the Future of Agentic AI. - Peter Belcak; Greg Heinrich; Shizhe Diao; Yonggan Fu; Xin Dong 009; Saurav Muralidharan; Yingyan Celine Lin; Pavlo Molchanov 001 (CoRR, 2025)

LaTtE-Flow: Layerwise Timestep-Expert Flow-based Transformer. - Ying Shen 006; Zhiyang Xu; Jiuhai Chen; Shizhe Diao; Jiaxin Zhang 005; Yuguang Yao; Joy Rimchala; Ismini Lourentzou; Lifu Huang (CoRR, 2025)

Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning. - Xin Xu; Tianlong Chen 001; Fan Zhang; Wanlong Liu; Pengxiang Li; Ajay Kumar Jaiswal; Yuchen Yan; Jishan Hu; Yang Wang 020; Hao Chen; Shiwei Liu 003; Shizhe Diao; et al. (CoRR, 2025)

GPAS: Accelerating Convergence of LLM Pretraining via Gradient-Preserving Activation Scaling. - Tianlong Chen 001; Xin Xu; Zijing Liu; Pengxiang Li; Xinyuan Song; Ajay Kumar Jaiswal; Fan Zhang; Jishan Hu; Yang Wang 020; Hao Chen; Shizhe Diao; Shiwei Liu 003; et al. (CoRR, 2025)

The Challenge of Teaching Reasoning to LLMs Without RL or Distillation. - Wei Du; Branislav Kisacanin; George Armstrong; Shubham Toshniwal; Ivan Moshkov; Alexan Ayrapetyan; Sadegh Mahdavi; Dan Zhao; Shizhe Diao; Dragan Masulovic; Marius Stanean; Advaith Avadhanam; et al. (CoRR, 2025)

Scaling Up RL: Unlocking Diverse Reasoning in LLMs via Prolonged Training. - Mingjie Liu; Shizhe Diao; Jian Hu; Ximing Lu; Xin Dong 009; Hao Zhang 097; Alexander Bukharin; Shaokun Zhang; Jiaqi Zeng; Makesh Narsimhan Sreedhar; Gerald Shen; David Mosallanezhad; et al. (CoRR, 2025)