Zijie Yan

According to our database, Zijie Yan authored at least 9 papers between 2018 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Scalable Training of Mixture-of-Experts Models with Megatron Core.

Zijie Yan, Hongxiao Bai, Xin Yao, Dennis Liu, Tong Liu, Hongbin Liu, Pingtian Li, Evan Wu, Shiqing Fan, Li Tao, Robin Zhang, Yuzhong Wang, Shifang Xu, Jack Chang, Xuwen Chen, Kunlun Li, Yan Bai, Gao Deng, Nan Zheng, Vijay Anand Korthikanti, Abhinav Khattar, Ethan He, Soham Govande, Sangkug Lym, Zhongbo Zhu, Qi Zhang, Haochen Yuan, Xiaowei Ren, Deyu Fu, Tailai Ma, Shunkang Zhang, Jiang Shao, Ray Wang, Vasudevan Rengasamy, Rachit Garg, Santosh Bhavani, Xipeng Li, Chandler Zhou, David Wu, Yingcan Wei, Ashwath Aithal, Michael Andersch, Mohammad Shoeybi, Jiajie Yao, June Yang

CoRR, March, 2026

HYDRA: Unearthing "Black Swan" Vulnerabilities in LEO Satellite Networks.

Bintao Yuan, Mingsheng Tang, Binbin Ge, Hongbin Luo, Zijie Yan

CoRR, February, 2026

2025

MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core.

Dennis Liu, Zijie Yan, Xin Yao, Tong Liu, Vijay Korthikanti, Evan Wu, Shiqing Fan, Gao Deng, Hongxiao Bai, Jianbin Chang, Ashwath Aithal, Michael Andersch, Mohammad Shoeybi, Jiajie Yao, Chandler Zhou, David Wu, Xipeng Li, June Yang

CoRR, April, 2025

2024

Llama 3 Meets MoE: Efficient Upcycling.

Aditya Vavre, Ethan He, Dennis Liu, Zijie Yan, June Yang, Nima Tajbakhsh, Ashwath Aithal

CoRR, 2024

Upcycling Large Language Models into Mixture of Experts.

Ethan He, Abhinav Khattar, Ryan Prenger, Vijay Korthikanti, Zijie Yan, Tong Liu, Shiqing Fan, Ashwath Aithal, Mohammad Shoeybi, Bryan Catanzaro

CoRR, 2024

2020

Dual-Way Gradient Sparsification for Asynchronous Distributed Deep Learning.

Zijie Yan, Danyang Xiao, Mengqiang Chen, Jieying Zhou, Weigang Wu

Proceedings of the ICPP 2020: 49th International Conference on Parallel Processing, 2020

Standard Deviation Based Adaptive Gradient Compression For Distributed Deep Learning.

Mengqiang Chen, Zijie Yan, Jiangtao Ren, Weigang Wu

Proceedings of the 20th IEEE/ACM International Symposium on Cluster, 2020

2019

Gradient Sparification for Asynchronous Distributed Training.

Zijie Yan

CoRR, 2019

2018

More Effective Distributed Deep Learning Using Staleness Based Parameter Updating.

Yan Ye, Mengqiang Chen, Zijie Yan, Weigang Wu, Nong Xiao

Proceedings of the Algorithms and Architectures for Parallel Processing, 2018