Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models. - Xin He; Xiaoming Liu; Zhili Wu; Wu Yu; Xiaowen Chu 001; Shihao Wang; Shaohuai Shi; Zhenheng Tang; Yuxin Wang 003; Zhihao Zhao; Jing Dai; Ronghao Ni; et al. (IEEE BigData, 2019)

The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study. - Zhenheng Tang; Yuxin Wang 003; Qiang Wang 022; Xiaowen Chu 001 (e-Energy, 2019)

A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks. - Shaohuai Shi; Qiang Wang 022; Kaiyong Zhao; Zhenheng Tang; Yuxin Wang 003; Xiang Huang; Xiaowen Chu 001 (ICDCS, 2019)

Benchmarking the Performance and Energy Efficiency of AI Accelerators for AI Training. - Yuxin Wang 003; Qiang Wang 022; Shaohuai Shi; Xin He; Zhenheng Tang; Kaiyong Zhao; Xiaowen Chu 001 (CCGRID, 2020)

Energy-efficient Inference Service of Transformer-based Deep Learning Models on GPUs. - Yuxin Wang 003; Qiang Wang 022; Xiaowen Chu 001 (iThings/GreenCom/CPSCom/SmartData/Cybermatics, 2020)

A Survey of Deep Learning Techniques for Neural Machine Translation. - Shuoheng Yang; Yuxin Wang 003; Xiaowen Chu 001 (CoRR, 2020)

Energy-Efficient Online Scheduling of Transformer Inference Services on GPU Servers. - Yuxin Wang 003; Qiang Wang 022; Xiaowen Chu 001 (IEEE Trans. Green Commun. Netw., 2022)

NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension. - Xin He; Jiangchao Yao; Yuxin Wang 003; Zhenheng Tang; Ka Chun Cheung; Simon See; Bo Han 003; Xiaowen Chu 001 (AAAI, 2023)

FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training. - Zhenheng Tang; Xiaowen Chu 001; Ryan Yide Ran; Sunwoo Lee 001; Shaohuai Shi; Yonggang Zhang 003; Yuxin Wang 003; Alex Qiaozhong Liang; Salman Avestimehr; Chaoyang He 001 (CoRR, 2023)

FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs. - Zhenheng Tang; Yuxin Wang 003; Xin He; Longteng Zhang; Xinglin Pan; Qiang Wang 022; Rongfei Zeng; Kaiyong Zhao; Shaohuai Shi; Bingsheng He; Xiaowen Chu 001 (CoRR, 2023)

Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining. - Yuxin Wang 003; Shaohuai Shi; Xin He; Zhenheng Tang; Xinglin Pan; Yang Zheng; Xiaoyu Wu; Amelie Chi Zhou; Bingsheng He; Xiaowen Chu 001 (CoRR, 2023)

Bandwidth-Aware and Overlap-Weighted Compression for Communication-Efficient Federated Learning. - Zichen Tang; Junlin Huang; Rudan Yan; Yuxin Wang 003; Zhenheng Tang; Shaohuai Shi; Amelie Chi Zhou; Xiaowen Chu 001 (ICPP, 2024)

Towards Efficient and Reliable LLM Serving: A Real-World Workload Study. - Yuxin Wang 003; Yuhan Chen; Zeyu Li; Zhenheng Tang; Rui Guo; Xin Wang; Qiang Wang 022; Amelie Chi Zhou; Xiaowen Chu 001 (CoRR, 2024)

FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression. - Zhenheng Tang; Xueze Kang; Yiming Yin; Xinglin Pan; Yuxin Wang 003; Xin He; Qiang Wang 022; Rongfei Zeng; Kaiyong Zhao; Shaohuai Shi; Amelie Chi Zhou; Bo Li 001; et al. (CoRR, 2024)

ExpertFlow: Optimized Expert Activation and Token Allocation for Efficient Mixture-of-Experts Inference. - Xin He; Shunkang Zhang; Yuxin Wang 003; Haiyan Yin; Zihao Zeng; Shaohuai Shi; Zhenheng Tang; Xiaowen Chu 001; Ivor W. Tsang; Yew-Soon Ong (CoRR, 2024)

DreamDDP: Accelerating Data Parallel Distributed LLM Training with Layer-wise Scheduled Partial Synchronization. - Zhenheng Tang; Zichen Tang; Junlin Huang; Xinglin Pan; Rudan Yan; Yuxin Wang 003; Amelie Chi Zhou; Shaohuai Shi; Xiaowen Chu 001; Bo Li 001 (CoRR, 2025)