Neural Architecture Search on Efficient Transformers and Beyond. - Zexiang Liu; Dong Li 033; Kaiyue Lu; Zhen Qin 003; Weixuan Sun; Jiacheng Xu; Yiran Zhong (CoRR, 2022)

Linear Video Transformer with Feature Fixation. - Kaiyue Lu; Zexiang Liu; Jianyuan Wang; Weixuan Sun; Zhen Qin 003; Dong Li 033; Xuyang Shen; Hui Deng; Xiaodong Han; Yuchao Dai; Yiran Zhong (CoRR, 2022)

Fine-grained Audible Video Description. - Xuyang Shen; Dong Li 033; Jinxing Zhou; Zhen Qin 003; Bowen He; Xiaodong Han; Aixuan Li; Yuchao Dai; Lingpeng Kong; Meng Wang 001; Yu Qiao 001; Yiran Zhong (CVPR, 2023)

Toeplitz Neural Network for Sequence Modeling. - Zhen Qin 003; Xiaodong Han; Weixuan Sun; Bowen He; Dong Li 033; Dongxu Li; Yuchao Dai; Lingpeng Kong; Yiran Zhong (ICLR, 2023)

Scaling TransNormer to 175 Billion Parameters. - Zhen Qin 003; Dong Li 033; Weigao Sun; Weixuan Sun; Xuyang Shen; Xiaodong Han; Yunshen Wei; Baohong Lv; Fei Yuan; Xiao Luo; Yu Qiao 001; Yiran Zhong (CoRR, 2023)

Scaling Laws for Linear Complexity Language Models. - Xuyang Shen; Dong Li 033; Ruitao Leng; Zhen Qin 003; Weigao Sun; Yiran Zhong (EMNLP, 2024)

CO2: Efficient Distributed Training with Full Communication-Computation Overlap. - Weigao Sun; Zhen Qin 003; Weixuan Sun; Shidi Li; Dong Li 033; Xuyang Shen; Yu Qiao 001; Yiran Zhong (ICLR, 2024)

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention. - Zhen Qin 003; Weigao Sun; Dong Li 033; Xuyang Shen; Weixuan Sun; Yiran Zhong (ICML, 2024)

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models. - Zhen Qin 003; Weigao Sun; Dong Li 033; Xuyang Shen; Weixuan Sun; Yiran Zhong (CoRR, 2024)

Linear Attention Sequence Parallelism. - Weigao Sun; Zhen Qin 003; Dong Li 033; Xuyang Shen; Yu Qiao 001; Yiran Zhong (CoRR, 2024)

HGRN2: Gated Linear RNNs with State Expansion. - Zhen Qin 003; Songlin Yang; Weixuan Sun; Xuyang Shen; Dong Li 033; Weigao Sun; Yiran Zhong (CoRR, 2024)

Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective. - Zhen Qin 003; Xuyang Shen; Dong Li 033; Weigao Sun; Stan Birchfield; Richard I. Hartley; Yiran Zhong (CoRR, 2024)

You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet. - Zhen Qin 003; Yuxin Mao; Xuyang Shen; Dong Li 033; Jing Zhang 052; Yuchao Dai; Yiran Zhong (CoRR, 2024)

Contrastive Conditional Latent Diffusion for Audio-Visual Segmentation. - Yuxin Mao; Jing Zhang 052; Mochu Xiang; Yunqiu Lv; Dong Li 033; Yiran Zhong; Yuchao Dai (IEEE Trans. Image Process., 2025)

LASP: Linear Attention Sequence Parallelism. - Weigao Sun; Zhen Qin 003; Dong Li 033; Xuyang Shen; Yu Qiao 001; Yiran Zhong (Trans. Mach. Learn. Res., 2025)

MiniMax-01: Scaling Foundation Models with Lightning Attention. - MiniMax; Aonian Li; Bangwei Gong; Bo Yang; Boji Shan; Chang Liu; Cheng Zhu; Chunhao Zhang; Congchao Guo; Da Chen; Dong Li 033; Enwei Jiao; et al. (CoRR, 2025)

MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention. - Aili Chen; Aonian Li; Bangwei Gong; Binyang Jiang; Bo Fei; Bo Yang; Boji Shan; Changqing Yu; Chao Wang; Cheng Zhu; Chengjun Xiao; Chengyu Du; et al. (CoRR, 2025)