RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition. - Peiyan Dong; Siyue Wang; Wei Niu 002; Chengming Zhang 006; Sheng Lin 001; Zhengang Li; Yifan Gong 004; Bin Ren; Xue Lin 001; Dingwen Tao (DAC, 2020)

CurvaNet: Geometric Deep Learning based on Directional Curvature for 3D Shape Analysis. - Wenchong He; Zhe Jiang 001; Chengming Zhang 006; Arpan Man Sainju (KDD, 2020)

waveSZ: a hardware-algorithm co-design of efficient lossy compression for scientific data. - Jiannan Tian; Sheng Di; Chengming Zhang 006; Xin Liang 001; Sian Jin; Dazhao Cheng; Dingwen Tao; Franck Cappello (PPoPP, 2020)

RTMobile: Beyond Real-Time Mobile Acceleration of RNNs for Speech Recognition. - Peiyan Dong; Siyue Wang; Wei Niu 002; Chengming Zhang 006; Sheng Lin 001; Zhengang Li; Yifan Gong 004; Bin Ren; Xue Lin 001; Yanzhi Wang; Dingwen Tao (CoRR, 2020)

An Efficient End-to-End Deep Learning Training Framework via Fine-Grained Pattern-Based Pruning. - Chengming Zhang 006; Geng Yuan; Wei Niu 002; Jiannan Tian; Sian Jin; Donglin Zhuang; Zhe Jiang 001; Yanzhi Wang; Bin Ren; Shuaiwen Leon Song; Dingwen Tao (CoRR, 2020)

ClickTrain: efficient and accurate end-to-end deep learning training via fine-grained architecture-preserving pruning. - Chengming Zhang 006; Geng Yuan; Wei Niu 002; Jiannan Tian; Sian Jin; Donglin Zhuang; Zhe Jiang 001; Yanzhi Wang; Bin Ren; Shuaiwen Leon Song; Dingwen Tao (ICS, 2021)

Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AI. - Geng Yuan; Zhiheng Liao; Xiaolong Ma; Yuxuan Cai 001; Zhenglun Kong; Xuan Shen; Jingyan Fu; Zhengang Li; Chengming Zhang 006; Hongwu Peng; Ning Liu 007; Ao Ren; et al. (ISQED, 2021)

CEAZ: Accelerating Parallel I/O via Hardware-Algorithm Co-Design of Efficient and Adaptive Lossy Compression. - Chengming Zhang 006; Sian Jin; Tong Geng; Jiannan Tian; Ang Li 006; Dingwen Tao (CoRR, 2021)

COMET: A Novel Memory-Efficient Deep Learning Training Framework by Using Error-Bounded Lossy Compression. - Sian Jin; Chengming Zhang 006; Xintong Jiang; Yunhe Feng; Hui Guan 001; Guanpeng Li; Shuaiwen Song; Dingwen Tao (Proc. VLDB Endow., 2021)

H-GCN: A Graph Convolutional Network Accelerator on Versal ACAP Architecture. - Chengming Zhang 006; Tong Geng; Anqi Guo; Jiannan Tian; Martin C. Herbordt; Ang Li 006; Dingwen Tao (FPL, 2022)

CEAZ: accelerating parallel I/O via hardware-algorithm co-designed adaptive lossy compression. - Chengming Zhang 006; Sian Jin; Tong Geng; Jiannan Tian; Ang Li 006; Dingwen Tao (ICS, 2022)

SOLAR: A Highly Optimized Data Loading Framework for Distributed Training of CNN-based Scientific Surrogates. - Baixi Sun; Xiaodong Yu 001; Chengming Zhang 006; Jiannan Tian; Sian Jin; Kamil Iskra; Tao Zhou; Tekin Bicer; Pete Beckman; Dingwen Tao (CoRR, 2022)

HALOC: Hardware-Aware Automatic Low-Rank Compression for Compact Neural Networks. - Jinqi Xiao; Chengming Zhang 006; Yu Gong; Miao Yin; Yang Sui; Lizhi Xiang; Dingwen Tao; Bo Yuan 001 (AAAI, 2023)

HEAT: A Highly Efficient and Affordable Training System for Collaborative Filtering Based Recommendation on CPUs. - Chengming Zhang 006; Shaden Smith; Baixi Sun; Jiannan Tian; Jonathan Soifer; Xiaodong Yu 001; Shuaiwen Leon Song; Yuxiong He; Dingwen Tao (ICS, 2023)

TDC: Towards Extremely Efficient CNNs on GPUs via Hardware-Aware Tucker Decomposition. - Lizhi Xiang; Miao Yin; Chengming Zhang 006; Aravind Sukumaran-Rajam; P. Sadayappan; Bo Yuan 001; Dingwen Tao (PPoPP, 2023)

Benchmarking and In-depth Performance Study of Large Language Models on Habana Gaudi Processors. - Chengming Zhang 006; Baixi Sun; Xiaodong Yu 001; Zhen Xie; Weijian Zheng; Kamil A. Iskra; Pete Beckman; Dingwen Tao (SC Workshops, 2023)

DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. - Sam Ade Jacobs; Masahiro Tanaka; Chengming Zhang 006; Minjia Zhang; Shuaiwen Leon Song; Samyam Rajbhandari; Yuxiong He (CoRR, 2023)

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. - Shuaiwen Leon Song; Bonnie Kruft; Minjia Zhang; Conglong Li; Shiyang Chen 004; Chengming Zhang 006; Masahiro Tanaka; Xiaoxia Wu; Jeff Rasley; Ammar Ahmad Awan; Connor Holmes; Martin Cai; et al. (CoRR, 2023)

HRBP: Hardware-friendly Regrouping towards Block-based Pruning for Sparse CNN Training. - Haoyu Ma; Chengming Zhang 006; Lizhi Xiang; Xiaolong Ma; Geng Yuan; Wenkai Zhang; Shiwei Liu 003; Tianlong Chen 001; Dingwen Tao; Yanzhi Wang; Zhangyang Wang; Xiaohui Xie (CPAL, 2024)

System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. - Sam Ade Jacobs; Masahiro Tanaka; Chengming Zhang 006; Minjia Zhang; Reza Yazdani Aminabadi; Shuaiwen Leon Song; Samyam Rajbhandari; Yuxiong He (IPDPS (Workshops), 2024)

SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training. - Jinda Jia; Cong Xie; Hanlin Lu; Daoce Wang; Hao Feng; Chengming Zhang 006; Baixi Sun; Haibin Lin; Zhi Zhang; Xin Liu; Dingwen Tao (NeurIPS, 2024)

System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. - Sam Ade Jacobs; Masahiro Tanaka; Chengming Zhang 006; Minjia Zhang; Reza Yazdani Aminadabi; Shuaiwen Leon Song; Samyam Rajbhandari; Yuxiong He (PODC, 2024)

Sequence Length Scaling in Vision Transformers for Scientific Images on Frontier. - Aristeidis Tsaris; Chengming Zhang 006; Xiao Wang 004; Junqi Yin; Siyan Liu; Moetasim Ashfaq; Ming Fan; Jong-Youl Choi; Mohamed Wahib; Dan Lu 001; Prasanna Balaprakash; Fei-Yue Wang 001 (CoRR, 2024)

AdaCM2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction. - Yuanbin Man; Ying Huang 008; Chengming Zhang 006; Bingzhe Li; Wei Niu 002; Miao Yin (CoRR, 2024)

GFormer: Accelerating Large Language Models with Optimized Transformers on Gaudi Processors. - Chengming Zhang 006; Xinheng Ding; Baixi Sun; Xiaodong Yu 001; Weijian Zheng; Zhen Xie; Dingwen Tao (CoRR, 2024)

AdaCM^2: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction. - Yuanbin Man; Ying Huang 008; Chengming Zhang 006; Bingzhe Li; Wei Niu 002; Miao Yin (CVPR, 2025)

High-performance Visual Semantics Compression for AI-Driven Science. - Boyuan Zhang 002; Luanzheng Guo; Jiannan Tian; Jinyang Liu 003; Daoce Wang; Fanjiang Ye; Chengming Zhang 006; Jan Strube 001; Nathan R. Tallent; Dingwen Tao (PPoPP, 2025)