Shengwei Li

According to our database, Shengwei Li authored at least 18 papers between 2009 and 2024.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2024

A Memory-Efficient Hybrid Parallel Framework for Deep Neural Network Training.

Dongsheng Li, Shengwei Li, Zhiquan Lai, Yongquan Fu, Xiangyu Ye, Lei Cai, Linbo Qiao

IEEE Trans. Parallel Distributed Syst., April, 2024

2023

Merak: An Efficient Distributed DNN Training Framework With Automated 3D Parallelism for Giant Foundation Models.

Zhiquan Lai, Shengwei Li, Xudong Tang, Keshi Ge, Weijie Liu, Yabo Duan, Linbo Qiao, Dongsheng Li

IEEE Trans. Parallel Distributed Syst., May, 2023

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent.

Xiaoge Deng, Li Shen, Shengwei Li, Tao Sun, Dongsheng Li, Dacheng Tao

CoRR, 2023

Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training.

Shengwei Li, Zhiquan Lai, Yanqi Hao, Weijie Liu, Keshi Ge, Xiaoge Deng, Dongsheng Li, Kai Lu

CoRR, 2023

Improved Accuracy of XCO2 Retrieval Based on OCO-2 Rtretrieval Framework Model.

Tao Yuan, Yong Xue, Liang Zhao, Chunlin Jin, Shengwei Li, Pei Li

Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, 2023

Observing Anthropogenic CO2 Emissions with TanSat in Northeast China.

Chunlin Jin, Yong Xue, Tao Yuan, Shengwei Li, Botao He, Liang Zhao

Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, 2023

Monitoring of Xch4 Changes and Anomaly in Hebei Province, China Based on Tropomi.

Botao He, Yong Xue, Xi Lu, Chunlin Jin, Shengwei Li, Wenhao Liu, Peng Wang, Xiangkai Wang, Pei Li

Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, 2023

Communication Analysis for Multidimensional Parallel Training of Large-scale DNN Models.

Zhiquan Lai, Yanqi Hao, Shengwei Li, Dongsheng Li

Proceedings of the IEEE International Conference on High Performance Computing & Communications, 2023

Prophet: Fine-grained Load Balancing for Parallel Training of Large-scale MoE Models.

Wei Wang, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Yujie Liu, Ao Shen, Dongsheng Li

Proceedings of the IEEE International Conference on Cluster Computing, 2023

Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD.

Xiaoge Deng, Tao Sun, Shengwei Li, Dongsheng Li

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

Keyword Spotting Based on CTC and Similarity Matching for Chinese Speech.

Shengwei Li, Huajun Zhang

Proceedings of the 23rd IEEE/ACIS International Conference on Computer and Information Science, 2023

2022

EmbRace: Accelerating Sparse Communication for Distributed Training of Deep Neural Networks.

Shengwei Li, Zhiquan Lai, Dongsheng Li, Yiming Zhang, Xiangyu Ye, Yabo Duan

Proceedings of the 51st International Conference on Parallel Processing, 2022

AutoPipe: A Fast Pipeline Parallelism Approach with Balanced Partitioning and Micro-batch Slicing.

Weijie Liu, Zhiquan Lai, Shengwei Li, Yabo Duan, Keshi Ge, Dongsheng Li

Proceedings of the IEEE International Conference on Cluster Computing, 2022

HPH: Hybrid Parallelism on Heterogeneous Clusters for Accelerating Large-scale DNNs Training.

Yabo Duan, Zhiquan Lai, Shengwei Li, Weijie Liu, Keshi Ge, Peng Liang, Dongsheng Li

Proceedings of the IEEE International Conference on Cluster Computing, 2022

2021

EmbRace: Accelerating Sparse Communication for Distributed Training of NLP Neural Networks.

Shengwei Li, Zhiquan Lai, Dongsheng Li, Xiangyu Ye, Yabo Duan

CoRR, 2021

Hippie: A Data-Paralleled Pipeline Approach to Improve Memory-Efficiency and Scalability for Large DNN Training.

Xiangyu Ye, Zhiquan Lai, Shengwei Li, Lei Cai, Ding Sun, Linbo Qiao, Dongsheng Li

Proceedings of the ICPP 2021: 50th International Conference on Parallel Processing, Lemont, IL, USA, August 9, 2021

2PGraph: Accelerating GNN Training over Large Graphs on GPU Clusters.

Lizhi Zhang, Zhiquan Lai, Shengwei Li, Yu Tang, Feng Liu, Dongsheng Li

Proceedings of the IEEE International Conference on Cluster Computing, 2021

2009

Mining closed frequent itemset based on FP-Tree.

Shengwei Li, Lingsheng Li, Chong Han

Proceedings of the 2009 IEEE International Conference on Granular Computing, 2009