Randomized Channel Shuffling: Minimal-Overhead Backdoor Attack Detection without Clean Datasets. - Ruisi Cai; Zhenyu Zhang 015; Tianlong Chen 001; Xiaohan Chen; Zhangyang Wang (NeurIPS, 2022)

Many-Task Federated Learning: A New Problem Setting and A Simple Baseline. - Ruisi Cai; Xiaohan Chen; Shiwei Liu 003; Jayanth Srinivasa; Myungjin Lee; Ramana Kompella; Zhangyang Wang (CVPR Workshops, 2023)

Robust Mixture-of-Expert Training for Convolutional Neural Networks. - Yihua Zhang; Ruisi Cai; Tianlong Chen 001; Guanhua Zhang; Huan Zhang 001; Pin-Yu Chen; Shiyu Chang; Zhangyang Wang; Sijia Liu 001 (ICCV, 2023)

Robust Weight Signatures: Gaining Robustness as Easy as Patching Weights? - Ruisi Cai; Zhenyu Zhang 015; Zhangyang Wang (ICML, 2023)

H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models. - Zhenyu Zhang 015; Ying Sheng 007; Tianyi Zhou 001; Tianlong Chen 001; Lianmin Zheng; Ruisi Cai; Zhao Song 002; Yuandong Tian; Christopher Ré; Clark W. Barrett; Zhangyang Wang; Beidi Chen (NeurIPS, 2023)

H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models. - Zhenyu Zhang 015; Ying Sheng 007; Tianyi Zhou 002; Tianlong Chen 001; Lianmin Zheng; Ruisi Cai; Zhao Song 002; Yuandong Tian; Christopher Ré; Clark W. Barrett; Zhangyang Wang; Beidi Chen (CoRR, 2023)

Flextron: Many-in-One Flexible Large Language Model. - Ruisi Cai; Saurav Muralidharan; Greg Heinrich; Hongxu Yin; Zhangyang Wang; Jan Kautz; Pavlo Molchanov 001 (ICML, 2024)

LoCoCo: Dropping In Convolutions for Long Context Compression. - Ruisi Cai; Yuandong Tian; Zhangyang Wang; Beidi Chen (ICML, 2024)

Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design. - Ruisi Cai; Yeonju Ro; Geon-Woo Kim; Peihao Wang; Babak Ehteshami Bejnordi; Aditya Akella; Zhangyang Wang (NeurIPS, 2024)

Model-GLUE: Democratized LLM Scaling for A Large Model Zoo in the Wild. - Xinyu Zhao; Guoheng Sun; Ruisi Cai; Yukun Zhou; Pingzhi Li; Peihao Wang; Bowen Tan; Yexiao He; Li Chen; Yi Liang; Beidi Chen; Binhang Yuan; et al. (NeurIPS, 2024)

FlexGS: Train Once, Deploy Everywhere with Many-in-One Flexible 3D Gaussian Splatting. - Hengyu Liu; Yuehao Wang; Chenxin Li; Ruisi Cai; Kevin Wang; Wuyang Li; Pavlo Molchanov 001; Peihao Wang; Zhangyang Wang (CVPR, 2025)

Steepest Descent Density Control for Compact 3D Gaussian Splatting. - Peihao Wang; Yuehao Wang; Dilin Wang; Sreyas Mohan; Zhiwen Fan; Lemeng Wu; Ruisi Cai; Yu-Ying Yeh; Zhangyang Wang; Qiang Liu 001; Rakesh Ranjan (CVPR, 2025)

LLaMaFlex: Many-in-one LLMs via Generalized Pruning and Weight Sharing. - Ruisi Cai; Saurav Muralidharan; Hongxu Yin; Zhangyang Wang; Jan Kautz; Pavlo Molchanov 001 (ICLR, 2025)

Understanding and Mitigating Bottlenecks of State Space Models through the Lens of Recency and Over-smoothing. - Peihao Wang; Ruisi Cai; Yuehao Wang; Jiajun Zhu; Pragya Srivastava; Zhangyang Wang; Pan Li 005 (ICLR, 2025)

Rethinking Addressing in Language Models via Contexualized Equivariant Positional Encoding. - Jiajun Zhu; Peihao Wang; Ruisi Cai; Jason D. Lee; Pan Li 005; Zhangyang Wang (CoRR, 2025)