Zhenheng Tang

According to our database, Zhenheng Tang authored at least 20 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting.

Yujin Tang, Peijie Dong, Zhenheng Tang, Xiaowen Chu, Junwei Liang

CoRR, 2024

FedImpro: Measuring and Improving Client Update in Federated Learning.

Zhenheng Tang, Yonggang Zhang, Shaohuai Shi, Xinmei Tian, Tongliang Liu, Bo Han, Xiaowen Chu

CoRR, 2024

Towards Efficient and Reliable LLM Serving: A Real-World Workload Study.

Yuxin Wang, Yuhan Chen, Zeyu Li, Zhenheng Tang, Rui Guo, Xin Wang, Qiang Wang, Amelie Chi Zhou, Xiaowen Chu

CoRR, 2024

2023

GossipFL: A Decentralized Federated Learning Framework With Sparsified and Adaptive Communication.

Zhenheng Tang, Shaohuai Shi, Bo Li, Xiaowen Chu

IEEE Trans. Parallel Distributed Syst., March, 2023

Reliable and Efficient In-Memory Fault Tolerance of Large Language Model Pretraining.

Yuxin Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Xinglin Pan, Yang Zheng, Xiaoyu Wu, Amelie Chi Zhou, Bingsheng He, Xiaowen Chu

CoRR, 2023

FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUs.

Zhenheng Tang, Yuxin Wang, Xin He, Longteng Zhang, Xinglin Pan, Qiang Wang, Rongfei Zeng, Kaiyong Zhao, Shaohuai Shi, Bingsheng He, Xiaowen Chu

CoRR, 2023

FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training.

Zhenheng Tang, Xiaowen Chu, Ryan Yide Ran, Sunwoo Lee, Shaohuai Shi, Yonggang Zhang, Yuxin Wang, Alex Qiaozhong Liang, Salman Avestimehr, Chaoyang He

CoRR, 2023

NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension.

Xin He, Jiangchao Yao, Yuxin Wang, Zhenheng Tang, Ka Chun Cheung, Simon See, Bo Han, Xiaowen Chu

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Virtual Homogeneity Learning: Defending against Data Heterogeneity in Federated Learning.

Zhenheng Tang, Yonggang Zhang, Shaohuai Shi, Xin He, Bo Han, Xiaowen Chu

Proceedings of the International Conference on Machine Learning, 2022

2021

A Quantitative Survey of Communication Optimizations in Distributed Deep Learning.

Shaohuai Shi, Zhenheng Tang, Xiaowen Chu, Chengjian Liu, Wei Wang, Bo Li

IEEE Netw., 2021

FedCV: A Federated Learning Framework for Diverse Computer Vision Tasks.

Chaoyang He, Alay Dilipbhai Shah, Zhenheng Tang, Di Fan, Adarshan Naiynar Sivashunmugam, Keerti Bhogaraju, Mita Shimpi, Li Shen, Xiaowen Chu, Mahdi Soltanolkotabi, Salman Avestimehr

CoRR, 2021

2020

Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges.

Shaohuai Shi, Zhenheng Tang, Xiaowen Chu, Chengjian Liu, Wei Wang, Bo Li

CoRR, 2020

Communication-Efficient Distributed Deep Learning: A Comprehensive Survey.

Zhenheng Tang, Shaohuai Shi, Xiaowen Chu, Wei Wang, Bo Li

CoRR, 2020

Communication-Efficient Decentralized Learning with Sparsification and Adaptive Peer Selection.

Zhenheng Tang, Shaohuai Shi, Xiaowen Chu

Proceedings of the 40th IEEE International Conference on Distributed Computing Systems, 2020

Layer-Wise Adaptive Gradient Sparsification for Distributed Deep Learning with Convergence Guarantees.

Shaohuai Shi, Zhenheng Tang, Qiang Wang, Kaiyong Zhao, Xiaowen Chu

Proceedings of the ECAI 2020 - 24th European Conference on Artificial Intelligence, 29 August-8 September 2020, Santiago de Compostela, Spain, August 29 - September 8, 2020, 2020

Benchmarking the Performance and Energy Efficiency of AI Accelerators for AI Training.

Yuxin Wang, Qiang Wang, Shaohuai Shi, Xin He, Zhenheng Tang, Kaiyong Zhao, Xiaowen Chu

Proceedings of the 20th IEEE/ACM International Symposium on Cluster, 2020

2019

A Convergence Analysis of Distributed SGD with Communication-Efficient Gradient Sparsification.

Shaohuai Shi, Kaiyong Zhao, Qiang Wang, Zhenheng Tang, Xiaowen Chu

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, 2019

A Distributed Synchronous SGD Algorithm with Global Top-k Sparsification for Low Bandwidth Networks.

Shaohuai Shi, Qiang Wang, Kaiyong Zhao, Zhenheng Tang, Yuxin Wang, Xiang Huang, Xiaowen Chu

Proceedings of the 39th IEEE International Conference on Distributed Computing Systems, 2019

The Impact of GPU DVFS on the Energy and Performance of Deep Learning: an Empirical Study.

Zhenheng Tang, Yuxin Wang, Qiang Wang, Xiaowen Chu

Proceedings of the Tenth ACM International Conference on Future Energy Systems, 2019

Computer-Aided Clinical Skin Disease Diagnosis Using CNN and Object Detection Models.

Xin He, Xiaoming Liu, Zhili Wu, Wu Yu, Xiaowen Chu, Shihao Wang, Shaohuai Shi, Zhenheng Tang, Yuxin Wang, Zhihao Zhao, Jing Dai, Ronghao Ni, Xiaofeng Zhang

Proceedings of the 2019 IEEE International Conference on Big Data (IEEE BigData), 2019