Xiaonan Nie

According to our database, Xiaonan Nie authored at least 13 papers between 2021 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Hetu: a highly efficient automatic parallel distributed deep learning system.

Xupeng Miao, Xiaonan Nie, Hailin Zhang, Tong Zhao, Bin Cui

Sci. China Inf. Sci., January, 2023

Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent.

Xiaonan Nie, Yi Liu, Fangcheng Fu, Jinbao Xue, Dian Jiao, Xupeng Miao, Yangyu Tao, Bin Cui

Proc. VLDB Endow., 2023

FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement.

Xiaonan Nie, Xupeng Miao, Zilong Wang, Zichao Yang, Jilong Xue, Lingxiao Ma, Gang Cao, Bin Cui

Proc. ACM Manag. Data, 2023

Improving Automatic Parallel Training via Balanced Memory Workload Optimization.

Yujie Wang, Youhe Jiang, Xupeng Miao, Fangcheng Fu, Xiaonan Nie, Bin Cui

CoRR, 2023

OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning.

Youhe Jiang, Fangcheng Fu, Xupeng Miao, Xiaonan Nie, Bin Cui

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

2022

Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism.

Xupeng Miao, Yujie Wang, Youhe Jiang, Chunan Shi, Xiaonan Nie, Hailin Zhang, Bin Cui

Proc. VLDB Endow., 2022

OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning.

Youhe Jiang, Xupeng Miao, Xiaonan Nie, Bin Cui

CoRR, 2022

HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System.

Xiaonan Nie, Pinxue Zhao, Xupeng Miao, Tong Zhao, Bin Cui

CoRR, 2022

HET-GMP: A Graph-based System Approach to Scaling Large Embedding Model Training.

Xupeng Miao, Yining Shi, Hailin Zhang, Xin Zhang, Xiaonan Nie, Zhi Yang, Bin Cui

Proceedings of the SIGMOD '22: International Conference on Management of Data, Philadelphia, PA, USA, June 12, 2022

TSPLIT: Fine-grained GPU Memory Management for Efficient DNN Training via Tensor Splitting.

Xiaonan Nie, Xupeng Miao, Zhi Yang, Bin Cui

Proceedings of the 38th IEEE International Conference on Data Engineering, 2022

2021

HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework.

Xupeng Miao, Hailin Zhang, Yining Shi, Xiaonan Nie, Zhi Yang, Yangyu Tao, Bin Cui

Proc. VLDB Endow., 2021

Dense-to-Sparse Gate for Mixture-of-Experts.

Xiaonan Nie, Shijie Cao, Xupeng Miao, Lingxiao Ma, Jilong Xue, Youshan Miao, Zichao Yang, Zhi Yang, Bin Cui

CoRR, 2021

Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce.

Xupeng Miao, Xiaonan Nie, Yingxia Shao, Zhi Yang, Jiawei Jiang, Lingxiao Ma, Bin Cui

Proceedings of the SIGMOD '21: International Conference on Management of Data, 2021