Zhen Qin

According to our database, Zhen Qin authored at least 27 papers between 2022 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Autoregressive Image Generation with Linear Complexity: A Spatial-Aware Decay Perspective.

Yuxin Mao, Zhen Qin, Jinxing Zhou, Hui Deng, Xuyang Shen, Bin Fan, Jing Zhang, Yiran Zhong, Yuchao Dai

CoRR, July, 2025

MiniMax-01: Scaling Foundation Models with Lightning Attention.

MiniMax, Aonian Li, Bangwei Gong, Bo Yang, Boji Shan, Chang Liu, Cheng Zhu, Chunhao Zhang, Congchao Guo, Da Chen, Dong Li, Enwei Jiao, Gengxin Li, Guojun Zhang, Haohai Sun, Houze Dong, Jiadai Zhu, Jiaqi Zhuang, Jiayuan Song, Jin Zhu, Jingtao Han, Jingyang Li, Junbin Xie, Junhao Xu, Junjie Yan, Kaishun Zhang, Kecheng Xiao, Kexi Kang, Le Han, Leyang Wang, Lianfei Yu, Liheng Feng, Lin Zheng, Linbo Chai, Long Xing, Meizhi Ju, Mingyuan Chi, Mozhi Zhang, Peikai Huang, Pengcheng Niu, Pengfei Li, Pengyu Zhao, Qi Yang, Qidi Xu, Qiexiang Wang, Qin Wang, Qiuhui Li, Ruitao Leng, Shengmin Shi, Shuqi Yu, Sichen Li, Songquan Zhu, Tao Huang, Tianrun Liang, Weigao Sun, Weixuan Sun, Weiyu Cheng, Wenkai Li, Xiangjun Song, Xiao Su, Xiaodong Han, Xinjie Zhang, Xinzhu Hou, Xu Min, Xun Zou, Xuyang Shen, Yan Gong, Yingjie Zhu, Yipeng Zhou, Yiran Zhong, Yongyi Hu, Yuanxiang Fan, Yue Yu, Yufeng Yang, Yuhao Li, Yunan Huang, Yunji Li, Yunpeng Huang, Yunzhi Xu, Yuxin Mao, Zehan Li, Zekang Li, Zewei Tao, Zewen Ying, Zhaoyang Cong, Zhen Qin, Zhenhua Fan, Zhihang Yu, Zhuo Jiang, Zijia Wu

CoRR, January, 2025

LASP: Linear Attention Sequence Parallelism.

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Trans. Mach. Learn. Res., 2025

Local enhanced toeplitz neural network for in-vehicle network intrusion detection.

Dongxian Shi, Ming Xu, Zhen Qin, Yiran Zhong

J. King Saud Univ. Comput. Inf. Sci., 2025

Deep Non-Rigid Structure-from-Motion Revisited: Canonicalization and Sequence Modeling.

Hui Deng, Jiawei Shi, Zhen Qin, Yiran Zhong, Yuchao Dai

Proceedings of the AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25, 2025

2024

You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet.

Zhen Qin, Yuxin Mao, Xuyang Shen, Dong Li, Jing Zhang, Yuchao Dai, Yiran Zhong

CoRR, 2024

Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective.

Zhen Qin, Xuyang Shen, Dong Li, Weigao Sun, Stan Birchfield, Richard I. Hartley, Yiran Zhong

CoRR, 2024

HGRN2: Gated Linear RNNs with State Expansion.

Zhen Qin, Songlin Yang, Weixuan Sun, Xuyang Shen, Dong Li, Weigao Sun, Yiran Zhong

CoRR, 2024

Linear Attention Sequence Parallelism.

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

CoRR, 2024

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

CoRR, 2024

TAVGBench: Benchmarking Text to Audible-Video Generation.

Yuxin Mao, Xuyang Shen, Jing Zhang, Zhen Qin, Jinxing Zhou, Mochu Xiang, Yiran Zhong, Yuchao Dai

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

Proceedings of the Forty-first International Conference on Machine Learning, 2024

CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Scaling Laws for Linear Complexity Language Models.

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Exploring Transformer Extrapolation.

Zhen Qin, Yiran Zhong, Hui Deng

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Vicinity Vision Transformer.

Weixuan Sun, Zhen Qin, Hui Deng, Jianyuan Wang, Yi Zhang, Kaihao Zhang, Nick Barnes, Stan Birchfield, Lingpeng Kong, Yiran Zhong

IEEE Trans. Pattern Anal. Mach. Intell., October, 2023

Linearized Relative Positional Encoding.

Zhen Qin, Weixuan Sun, Kaiyue Lu, Hui Deng, Dongxu Li, Xiaodong Han, Yuchao Dai, Lingpeng Kong, Yiran Zhong

Trans. Mach. Learn. Res., 2023

Scaling TransNormer to 175 Billion Parameters.

Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen, Xiaodong Han, Yunshen Wei, Baohong Lv, Fei Yuan, Xiao Luo, Yu Qiao, Yiran Zhong

CoRR, 2023

Hierarchically Gated Recurrent Neural Network for Sequence Modeling.

Zhen Qin, Songlin Yang, Yiran Zhong

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Toeplitz Neural Network for Sequence Modeling.

Zhen Qin, Xiaodong Han, Weixuan Sun, Bowen He, Dong Li, Dongxu Li, Yuchao Dai, Lingpeng Kong, Yiran Zhong

Proceedings of the Eleventh International Conference on Learning Representations, 2023

All-pairs Consistency Learning for Weakly Supervised Semantic Segmentation.

Weixuan Sun, Yanhao Zhang, Zhen Qin, Zheyuan Liu, Lin Cheng, Fanyi Wang, Yiran Zhong, Nick Barnes

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Accelerating Toeplitz Neural Network with Constant-time Inference Complexity.

Zhen Qin, Yiran Zhong

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Fine-grained Audible Video Description.

Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, Yu Qiao, Yiran Zhong

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

2022

Linear Video Transformer with Feature Fixation.

Kaiyue Lu, Zexiang Liu, Jianyuan Wang, Weixuan Sun, Zhen Qin, Dong Li, Xuyang Shen, Hui Deng, Xiaodong Han, Yuchao Dai, Yiran Zhong

CoRR, 2022

Neural Architecture Search on Efficient Transformers and Beyond.

Zexiang Liu, Dong Li, Kaiyue Lu, Zhen Qin, Weixuan Sun, Jiacheng Xu, Yiran Zhong

CoRR, 2022

cosFormer: Rethinking Softmax In Attention.

Zhen Qin, Weixuan Sun, Hui Deng, Dongxu Li, Yunshen Wei, Baohong Lv, Junjie Yan, Lingpeng Kong, Yiran Zhong

Proceedings of the Tenth International Conference on Learning Representations, 2022

The Devil in Linear Transformer.

Zhen Qin, Xiaodong Han, Weixuan Sun, Dongxu Li, Lingpeng Kong, Nick Barnes, Yiran Zhong

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022