Circuit Complexity Bounds for RoPE-based Transformer Architecture. - Bo Chen 029; Xiaoyu Li 001; Yingyu Liang; Jiangxuan Long 001; Zhenmei Shi; Zhao Song 002 (CoRR, 2024)

Numerical Pruning for Efficient Autoregressive Models. - Xuan Shen; Zhao Song 002; Yufa Zhou 001; Bo Chen 029; Jing Liu 001; Ruiyi Zhang 002; Ryan A. Rossi; Hao Tan 002; Tong Yu 001; Xiang Chen; Yufan Zhou 001; Tong Sun 005; et al. (CoRR, 2024)

LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers. - Xuan Shen; Zhao Song 002; Yufa Zhou 001; Bo Chen 029; Yanyu Li; Yifan Gong 004; Kai Zhang 045; Hao Tan 002; Jason Kuen; Henghui Ding; Zhihao Shu; Wei Niu 002; et al. (AAAI, 2025)

Numerical Pruning for Efficient Autoregressive Models. - Xuan Shen; Zhao Song 002; Yufa Zhou 001; Bo Chen 029; Jing Liu 001; Ruiyi Zhang 002; Ryan A. Rossi; Hao Tan 005; Tong Yu 001; Xiang Chen; Yufan Zhou 001; Tong Sun 005; et al. (AAAI, 2025)

Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent. - Bo Chen 029; Xiaoyu Li 001; Yingyu Liang; Zhenmei Shi; Zhao Song 002 (AISTATS, 2025)

HSR-Enhanced Sparse Attention Acceleration. - Bo Chen 029; Yingyu Liang; Zhizhou Sha; Zhenmei Shi; Zhao Song 002 (CPAL, 2025)

NRFlow: Towards Noise-Robust Generative Modeling via High-Order Mechanism. - Bo Chen 029; Chengyue Gong; Xiaoyu Li 001; Yingyu Liang; Zhizhou Sha; Zhenmei Shi; Zhao Song 002; Mingda Wan; Xugang Ye (UAI, 2025)

High-Order Matching for One-Step Shortcut Diffusion Models. - Bo Chen 029; Chengyue Gong; Xiaoyu Li 001; Yingyu Liang; Zhizhou Sha; Zhenmei Shi; Zhao Song 002; Mingda Wan (CoRR, 2025)

Force Matching with Relativistic Constraints: A Physics-Inspired Approach to Stable and Efficient Generative Modeling. - Yang Cao 020; Bo Chen 029; Xiaoyu Li 001; Yingyu Liang; Zhizhou Sha; Zhenmei Shi; Zhao Song 002; Mingda Wan (CoRR, 2025)

Exploring the Limits of KV Cache Compression in Visual Autoregressive Transformers. - Bo Chen 029; Xiaoyu Li 001; Yekun Ke; Yingyu Liang; Zhenmei Shi; Zhao Song 002 (CoRR, 2025)

Provable Failure of Language Models in Learning Majority Boolean Logic via Gradient Descent. - Bo Chen 029; Zhenmei Shi; Zhao Song 002; Jiahao Zhang (CoRR, 2025)