PRIAG: Proximal Reweighted Incremental Aggregated Gradient Algorithm for Distributed Optimizations. - Xiaoge Deng; Tao Sun 005; Feng Liu; Feng Huang (ICA3PP (1), 2020)

Linear Convergence Rate of Splitting Algorithms for Multi-Block Constrained Convex Minimizations. - Xiaoge Deng; Feng Liu; Feng Huang (IEEE Access, 2020)

A Nonconvex Implementation of Sparse Subspace Clustering: Algorithm and Convergence Analysis. - Xiaoge Deng; Tao Sun 005; Peibing Du; Dongsheng Li 001 (IEEE Access, 2020)

CASQ: Accelerate Distributed Deep Learning with Sketch-Based Gradient Quantization. - Keshi Ge; Yiming Zhang 003; Yongquan Fu; Zhiquan Lai; Xiaoge Deng; Dongsheng Li 001 (CLUSTER, 2021)

S2 Reducer: High-Performance Sparse Communication to Accelerate Distributed Deep Learning. - Keshi Ge; Yongquan Fu; Zhiquan Lai; Xiaoge Deng; Dongsheng Li 001 (CoRR, 2021)

SASG: Sparsification with Adaptive Stochastic Gradients for Communication-efficient Distributed Learning. - Xiaoge Deng; Tao Sun 005; Dongsheng Li 001 (CoRR, 2021)

S2 Reducer: High-Performance Sparse Communication to Accelerate Distributed Deep Learning. - Keshi Ge; Yongquan Fu; Yiming Zhang 003; Zhiquan Lai; Xiaoge Deng; Dongsheng Li 001 (ICASSP, 2022)

Stability-Based Generalization Analysis of the Asynchronous Decentralized SGD. - Xiaoge Deng; Tao Sun 005; Shengwei Li; Dongsheng Li 001 (AAAI, 2023)

Normalized Stochastic Heavy Ball with Adaptive Momentum. - Ziqing Wen; Xiaoge Deng; Tao Sun 005; Dongsheng Li 001 (ECAI, 2023)

Automated Tensor Model Parallelism with Overlapped Communication for Efficient Foundation Model Training. - Shengwei Li; Zhiquan Lai; Yanqi Hao; Weijie Liu; Keshi Ge; Xiaoge Deng; Dongsheng Li 001; Kai Lu 001 (CoRR, 2023)

Towards Understanding the Generalizability of Delayed Stochastic Gradient Descent. - Xiaoge Deng; Li Shen 008; Shengwei Li; Tao Sun 005; Dongsheng Li 001; Dacheng Tao (CoRR, 2023)

Compressed Collective Sparse-Sketch for Distributed Data-Parallel Training of Deep Learning Models. - Keshi Ge; Kai Lu 001; Yongquan Fu; Xiaoge Deng; Zhiquan Lai; Dongsheng Li 001 (IEEE J. Sel. Areas Commun., 2023)

Exploring the Inefficiency of Heavy Ball as Momentum Parameter Approaches 1. - Xiaoge Deng; Tao Sun 005; Dongsheng Li 001; Xicheng Lu (IJCAI, 2024)

Stability and Generalization of Asynchronous SGD: Sharper Bounds Beyond Lipschitz and Smoothness. - Xiaoge Deng; Tao Sun 005; Shengwei Li; Dongsheng Li 001; Xicheng Lu (NeurIPS, 2024)

Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients. - Ping Luo; Xiaoge Deng; Ziqing Wen; Tao Sun 005; Dongsheng Li 001 (CoRR, 2024)

Score-based Generative Models with Adaptive Momentum. - Ziqing Wen; Xiaoge Deng; Ping Luo; Tao Sun 005; Dongsheng Li 001 (CoRR, 2024)

Federated Prediction-Powered Inference from Decentralized Data. - Ping Luo; Xiaoge Deng; Ziqing Wen; Tao Sun 005; Dongsheng Li 001 (CoRR, 2024)

Decentralized stochastic sharpness-aware minimization algorithm. - Simiao Chen; Xiaoge Deng; Dongpo Xu; Tao Sun 005; Dongsheng Li 001 (Neural Networks, 2024)

Sharpness-Aware Minimization with Adaptive Regularization for Training Deep Neural Networks. - Jinping Zou; Xiaoge Deng; Tao Sun 005 (ICASSP, 2025)

Breaking Memory Limits: Gradient Wavelet Transform Enhances LLMs Training. - Ziqing Wen; Ping Luo; Jiahuan Wang; Xiaoge Deng; Jinping Zou; Kun Yuan; Tao Sun 005; Dongsheng Li 001 (CoRR, 2025)

Communication-Efficient Distributed Learning via Sparse and Adaptive Stochastic Gradient. - Xiaoge Deng; Dongsheng Li 001; Tao Sun 005; Xicheng Lu (IEEE Trans. Big Data, 2025)

Toward Understanding the Generalizability of Delayed Stochastic Gradient Descent. - Xiaoge Deng; Li Shen 008; Shengwei Li; Tao Sun 005; Dongsheng Li 001; Dacheng Tao (IEEE Trans. Pattern Anal. Mach. Intell., 2025)

BHerd: Accelerating Federated Learning by Selecting Beneficial Herd of Local Gradients. - Ping Luo; Xiaoge Deng; Ziqing Wen; Tao Sun 005; Dongsheng Li 001 (IEEE Trans. Computers, 2025)

Oases: Efficient Large-Scale Model Training on Commodity Servers via Overlapped and Automated Tensor Model Parallelism. - Shengwei Li; Zhiquan Lai; Dongsheng Li 001; Yanqi Hao; Weijie Liu; Keshi Ge; Xiaoge Deng; Kai Lu 001 (IEEE Trans. Parallel Distributed Syst., 2025)