Pinxue Zhao

According to our database, Pinxue Zhao authored at least 5 papers between 2022 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

MEMO: Fine-grained Tensor Management For Ultra-long Context LLM Training.

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

Proc. ACM Manag. Data, February, 2025

HMoE: Heterogeneous Mixture of Experts for Language Modeling.

An Wang, Xingwu Sun, Ruobing Xie, Shuaipeng Li, Jiaqi Zhu, Zhen Yang, Pinxue Zhao, Weidong Han, Zhanhui Kang, Di Wang, Naoaki Okazaki, Cheng-Zhong Xu

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

2024

HMoE: Heterogeneous Mixture of Experts for Language Modeling.

An Wang, Xingwu Sun, Ruobing Xie, Shuaipeng Li, Jiaqi Zhu, Zhen Yang, Pinxue Zhao, J. N. Han, Zhanhui Kang, Di Wang, Naoaki Okazaki, Cheng-Zhong Xu

CoRR, 2024

Efficiently Training 7B LLM with 1 Million Sequence Length on 8 GPUs.

Pinxue Zhao, Hailin Zhang, Fangcheng Fu, Xiaonan Nie, Qibin Liu, Fang Yang, Yuanbo Peng, Dian Jiao, Shuaipeng Li, Jinbao Xue, Yangyu Tao, Bin Cui

CoRR, 2024

2022

HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System.

Xiaonan Nie, Pinxue Zhao, Xupeng Miao, Tong Zhao, Bin Cui

CoRR, 2022