Tensor Attention Training: Provably Efficient Learning of Higher-order Transformers. - Jiuxiang Gu; Yingyu Liang; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (CoRR, 2024)

Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective. - Jiuxiang Gu; Yingyu Liang; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (CoRR, 2024)

Differential Privacy of Cross-Attention with Provable Guarantee. - Jiuxiang Gu; Yingyu Liang; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (CoRR, 2024)

Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time. - Yingyu Liang; Zhizhou Sha; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (CoRR, 2024)

Fine-grained Attention I/O Complexity: Comprehensive Analysis for Backward Passes. - Xiaoyu Li 001; Yingyu Liang; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (CoRR, 2024)

Numerical Pruning for Efficient Autoregressive Models. - Xuan Shen; Zhao Song 002; Yufa Zhou 001; Bo Chen 029; Jing Liu 001; Ruiyi Zhang 002; Ryan A. Rossi; Hao Tan 002; Tong Yu 001; Xiang Chen; Yufan Zhou 001; Tong Sun 005; et al. (CoRR, 2024)

LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers. - Xuan Shen; Zhao Song 002; Yufa Zhou 001; Bo Chen 029; Yanyu Li; Yifan Gong 004; Kai Zhang 045; Hao Tan 002; Jason Kuen; Henghui Ding; Zhihao Shu; Wei Niu 002; et al. (AAAI, 2025)

Numerical Pruning for Efficient Autoregressive Models. - Xuan Shen; Zhao Song 002; Yufa Zhou 001; Bo Chen 029; Jing Liu 001; Ruiyi Zhang 002; Ryan A. Rossi; Hao Tan 005; Tong Yu 001; Xiang Chen; Yufan Zhou 001; Tong Sun 005; et al. (AAAI, 2025)

Looped ReLU MLPs May Be All You Need as Practical Programmable Computers. - Yingyu Liang; Zhizhou Sha; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (AISTATS, 2025)

Beyond Linear Approximations: A Novel Pruning Approach for Attention Matrix. - Yingyu Liang; Jiangxuan Long 001; Zhenmei Shi; Zhao Song 002; Yufa Zhou 001 (ICLR, 2025)

DraftAttention: Fast Video Diffusion via Low-Resolution Attention Guidance. - Xuan Shen; Chenxia Han; Yufa Zhou 001; Yanyue Xie; Yifan Gong 004; Quanyi Wang; Yiwei Wang 001; Yanzhi Wang; Pu Zhao 001; Jiuxiang Gu (CoRR, 2025)

FastCar: Cache Attentive Replay for Fast Auto-Regressive Video Generation on the Edge. - Xuan Shen; Weize Ma; Yufa Zhou 001; Enhao Tang; Yanyue Xie; Zhengang Li; Yifan Gong 004; Quanyi Wang; Henghui Ding; Yiwei Wang 001; Yanzhi Wang; Pu Zhao 001; et al. (CoRR, 2025)