Weidong Han

According to our database, Weidong Han authored at least 5 papers between 2025 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

TransMamba: A Sequence-Level Hybrid Transformer-Mamba Language Model.

Yixing Li, Ruobing Xie, Zhen Yang, Xingwu Sun, Shuaipeng Li, Weidong Han, Zhanhui Kang, Di Wang, Yu Cheng

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

2025

Towards a Comprehensive Scaling Law of Mixture-of-Experts.

Guoliang Zhao, Yuhan Fu, Shuaipeng Li, Xingwu Sun, Ruobing Xie, An Wang, Weidong Han, Zhen Yang, Weixuan Sun, Yudong Zhang, Cheng-zhong Xu, Di Wang, Jie Jiang

CoRR, September, 2025

TransMamba: Flexibly Switching between Transformer and Mamba.

Yixing Li, Ruobing Xie, Zhen Yang, Xingwu Sun, Shuaipeng Li, Weidong Han, Zhanhui Kang, Yu Cheng, Cheng-Zhong Xu, Di Wang, Jie Jiang

CoRR, March, 2025

Scaling Laws for Floating-Point Quantization Training.

Xingwu Sun, Shuaipeng Li, Ruobing Xie, Weidong Han, Kan Wu, Zhen Yang, Yixing Li, An Wang, Shuai Li, Jinbao Xue, Yu Cheng, Yangyu Tao, Zhanhui Kang, Cheng-zhong Xu, Di Wang, Jie Jiang

Proceedings of the Forty-second International Conference on Machine Learning, 2025

HMoE: Heterogeneous Mixture of Experts for Language Modeling.

An Wang, Xingwu Sun, Ruobing Xie, Shuaipeng Li, Jiaqi Zhu, Zhen Yang, Pinxue Zhao, Weidong Han, Zhanhui Kang, Di Wang, Naoaki Okazaki, Cheng-Zhong Xu

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025