Weigao Sun

According to our database, Weigao Sun authored at least 27 papers between 2018 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Comba: Improving Bilinear RNNs with Closed-loop Control.

Jiaxi Hu, Yongqi Pan, Jusen Du, Disen Lan, Xiaqiang Tang, Qingsong Wen, Yuxuan Liang, Weigao Sun

CoRR, June, 2025

A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and Beyond.

Xiaoye Qu, Yafu Li, Zhaochen Su, Weigao Sun, Jianhao Yan, Dongrui Liu, Ganqu Cui, Daizong Liu, Shuxian Liang, Junxian He, Peng Li, Wei Wei, Jing Shao, Chaochao Lu, Yue Zhang, Xian-Sheng Hua, Bowen Zhou, Yu Cheng

CoRR, March, 2025

Linear-MoE: Linear Sequence Modeling Meets Mixture-of-Experts.

Weigao Sun, Disen Lan, Tong Zhu, Xiaoye Qu, Yu Cheng

CoRR, March, 2025

Liger: Linearizing Large Language Models to Gated Recurrent Structures.

Disen Lan, Weigao Sun, Jiaxi Hu, Jusen Du, Yu Cheng

CoRR, March, 2025

MoM: Linear Sequence Modeling with Mixture-of-Memories.

Jusen Du, Weigao Sun, Disen Lan, Jiaxi Hu, Yu Cheng

CoRR, February, 2025

LASP-2: Rethinking Sequence Parallelism for Linear Attention and Its Hybrid.

Weigao Sun, Disen Lan, Yiran Zhong, Xiaoye Qu, Yu Cheng

CoRR, February, 2025

MiniMax-01: Scaling Foundation Models with Lightning Attention.

MiniMax, Aonian Li, Bangwei Gong, Bo Yang, Boji Shan, Chang Liu, Cheng Zhu, Chunhao Zhang, Congchao Guo, Da Chen, Dong Li, Enwei Jiao, Gengxin Li, Guojun Zhang, Haohai Sun, Houze Dong, Jiadai Zhu, Jiaqi Zhuang, Jiayuan Song, Jin Zhu, Jingtao Han, Jingyang Li, Junbin Xie, Junhao Xu, Junjie Yan, Kaishun Zhang, Kecheng Xiao, Kexi Kang, Le Han, Leyang Wang, Lianfei Yu, Liheng Feng, Lin Zheng, Linbo Chai, Long Xing, Meizhi Ju, Mingyuan Chi, Mozhi Zhang, Peikai Huang, Pengcheng Niu, Pengfei Li, Pengyu Zhao, Qi Yang, Qidi Xu, Qiexiang Wang, Qin Wang, Qiuhui Li, Ruitao Leng, Shengmin Shi, Shuqi Yu, Sichen Li, Songquan Zhu, Tao Huang, Tianrun Liang, Weigao Sun, Weixuan Sun, Weiyu Cheng, Wenkai Li, Xiangjun Song, Xiao Su, Xiaodong Han, Xinjie Zhang, Xinzhu Hou, Xu Min, Xun Zou, Xuyang Shen, Yan Gong, Yingjie Zhu, Yipeng Zhou, Yiran Zhong, Yongyi Hu, Yuanxiang Fan, Yue Yu, Yufeng Yang, Yuhao Li, Yunan Huang, Yunji Li, Yunpeng Huang, Yunzhi Xu, Yuxin Mao, Zehan Li, Zekang Li, Zewei Tao, Zewen Ying, Zhaoyang Cong, Zhen Qin, Zhenhua Fan, Zhihang Yu, Zhuo Jiang, Zijia Wu

CoRR, January, 2025

LASP: Linear Attention Sequence Parallelism.

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Trans. Mach. Learn. Res., 2025

CogniBench: A Legal-inspired Framework and Dataset for Assessing Cognitive Faithfulness of Large Language Models.

Xiaqiang Tang, Jian Li, Keyu Hu, Nan Du, Xiaolong Li, Xi Zhang, Weigao Sun, Sihong Xie

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

Sequence Accumulation and Beyond: Infinite Context Length on Single GPU and Large Clusters.

Weigao Sun, Yongtuo Liu, Xiaqiang Tang, Xiaoyu Mo

Proceedings of the AAAI-25, Sponsored by the Association for the Advancement of Artificial Intelligence, February 25, 2025

2024

MS-Net: A Multi-Path Sparse Model for Motion Prediction in Multi-Scenes.

Xiaqiang Tang, Weigao Sun, Siyuan Hu, Yiyang Sun, Yafeng Guo

IEEE Robotics Autom. Lett., January, 2024

LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training.

Xiaoye Qu, Daize Dong, Xuyang Hu, Tong Zhu, Weigao Sun, Yu Cheng

CoRR, 2024

Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective.

Zhen Qin, Xuyang Shen, Dong Li, Weigao Sun, Stan Birchfield, Richard I. Hartley, Yiran Zhong

CoRR, 2024

HGRN2: Gated Linear RNNs with State Expansion.

Zhen Qin, Songlin Yang, Weixuan Sun, Xuyang Shen, Dong Li, Weigao Sun, Yiran Zhong

CoRR, 2024

Linear Attention Sequence Parallelism.

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

CoRR, 2024

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

CoRR, 2024

Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention.

Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

Proceedings of the Forty-first International Conference on Machine Learning, 2024

CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Scaling Laws for Linear Complexity Language Models.

Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Scaling TransNormer to 175 Billion Parameters.

Zhen Qin, Dong Li, Weigao Sun, Weixuan Sun, Xuyang Shen, Xiaodong Han, Yunshen Wei, Baohong Lv, Fei Yuan, Xiao Luo, Yu Qiao, Yiran Zhong

CoRR, 2023

2021

The Relationship Between CT Signs of Computed Tomography and Risk Classification of Gastric Stromal Tumors.

Wang Chen, Rong Guo, Weigao Sun, Dingyou Lu

J. Medical Imaging Health Informatics, 2021

2020

Data-Driven Probabilistic Optimal Power Flow With Nonparametric Bayesian Modeling and Inference.

Weigao Sun, Mohsen Zamani, Mohammad Reza Hesamzadeh, Hai-Tao Zhang

IEEE Trans. Smart Grid, 2020

A Fast Optimal Power Flow Algorithm Using Powerball Method.

Hai-Tao Zhang, Weigao Sun, Yuanzheng Li, Dongfei Fu, Ye Yuan

IEEE Trans. Ind. Informatics, 2020

pbSGD: Powered Stochastic Gradient Descent Methods for Accelerated Non-Convex Optimization.

Beitong Zhou, Jun Liu, Weigao Sun, Ruijuan Chen, Claire J. Tomlin, Ye Yuan

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, 2020

2019

Probabilistic Optimal Power Flow With Correlated Wind Power Uncertainty via Markov Chain Quasi-Monte-Carlo Sampling.

Weigao Sun, Mohsen Zamani, Hai-Tao Zhang, Yuanzheng Li

IEEE Trans. Ind. Informatics, 2019

A Nonparametric Bayesian Approach for Probabilistic Representation of Power Uncertainties.

Weigao Sun, Mohsen Zamani

Proceedings of the 2019 IEEE International Conference on Communications, 2019

2018

Probabilistic Optimal Power Flow Considering Correlation of Wind Farms via Markov Chain Quasi-Monte Carlo Sampling.

Weigao Sun, Mohsen Zamani, Hai-Tao Zhang, Yuanzheng Li

CoRR, 2018