Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention. - Yunyang Xiong; Zhanpeng Zeng; Rudrasis Chakraborty; Mingxing Tan; Glenn Fung; Yin Li 003; Vikas Singh (AAAI, 2021)

You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling. - Zhanpeng Zeng; Yunyang Xiong; Sathya N. Ravi; Shailesh Acharya; Glenn Moo Fung; Vikas Singh (ICML, 2021)

Multi Resolution Analysis (MRA) for Approximate Self-Attention. - Zhanpeng Zeng; Sourav Pal; Jeffery Kline; Glenn Moo Fung; Vikas Singh (ICML, 2022)

Controlled Differential Equations on Long Sequences via Non-standard Wavelets. - Sourav Pal; Zhanpeng Zeng; Sathya N. Ravi; Vikas Singh (ICML, 2023)

LookupFFN: Making Transformers Compute-lite for CPU inference. - Zhanpeng Zeng; Michael Davies; Pranav Pulijala; Karthikeyan Sankaralingam; Vikas Singh (ICML, 2023)

VCC: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens. - Zhanpeng Zeng; Cole Hawkins; Mingyi Hong 001; Aston Zhang; Nikolaos Pappas 004; Vikas Singh; Shuai Zheng (NeurIPS, 2023)

FrameQuant: Flexible Low-Bit Quantization for Transformers. - Harshavardhan Adepu; Zhanpeng Zeng; Li Zhang; Vikas Singh (ICML, 2024)

IM-Unpack: Training and Inference with Arbitrarily Low Precision Integers. - Zhanpeng Zeng; Karthikeyan Sankaralingam; Vikas Singh (ICML, 2024)

Alleviating Distortion in Image Generation via Multi-Resolution Diffusion Models and Time-Dependent Layer Normalization. - Qihao Liu; Zhanpeng Zeng; Ju He; Qihang Yu; Xiaohui Shen; Liang-Chieh Chen (NeurIPS, 2024)

Alleviating Distortion in Image Generation via Multi-Resolution Diffusion Models. - Qihao Liu; Zhanpeng Zeng; Ju He; Qihang Yu; Xiaohui Shen; Liang-Chieh Chen (CoRR, 2024)

Semantics Prompting Data-Free Quantization for Low-Bit Vision Transformers. - Yunshan Zhong; Yuyao Zhou; Yuxin Zhang 002; Shen Li; Yong Li; Fei Chao 001; Zhanpeng Zeng; Rongrong Ji (CoRR, 2024)

LightMotion: A Light and Tuning-free Method for Simulating Camera Motion in Video Generation. - Quanjian Song; Zhihang Lin; Zhanpeng Zeng; Ziyue Zhang; Liujuan Cao; Rongrong Ji (CoRR, 2025)

Speculative Decoding Reimagined for Multimodal Large Language Models. - Luxi Lin; Zhihang Lin; Zhanpeng Zeng; Rongrong Ji (CoRR, 2025)