HMC-TRAN: A Tensor-core Inspired Hierarchical Model Compression for Transformer-based DNNs on GPU. - Shaoyi Huang; Shiyang Chen 004; Hongwu Peng; Daniel Manu; Zhenglun Kong; Geng Yuan; Lei Yang 018; Shusen Wang; Hang Liu 001; Caiwen Ding (ACM Great Lakes Symposium on VLSI, 2021)

Optimizing FPGA-based Accelerator Design for Large-Scale Molecular Similarity Search (Special Session Paper). - Hongwu Peng; Shiyang Chen 004; Zhepeng Wang 001; Junhuan Yang; Scott A. Weitze; Tong Geng; Ang Li 006; Jinbo Bi; Minghu Song; Weiwen Jiang; Hang Liu 001; Caiwen Ding (ICCAD, 2021)

E.T.: re-thinking self-attention for transformer models on GPUs. - Shiyang Chen 004; Shaoyi Huang; Santosh Pandey; Bingbing Li; Guang R. Gao; Long Zheng 001; Caiwen Ding; Hang Liu 001 (SC, 2021)

Optimizing FPGA-based Accelerator Design for Large-Scale Molecular Similarity Search. - Hongwu Peng; Shiyang Chen 004; Zhepeng Wang 001; Junhuan Yang; Scott A. Weitze; Tong Geng; Ang Li 006; Jinbo Bi; Minghu Song; Weiwen Jiang; Hang Liu 001; Caiwen Ding (CoRR, 2021)

Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm. - Shaoyi Huang; Dongkuan Xu; Ian En-Hsu Yen; Sung-En Chang; Bingbing Li; Shiyang Chen 004; Mimi Xie; Hang Liu 001; Caiwen Ding (CoRR, 2021)

Sparse Progressive Distillation: Resolving Overfitting under Pretrain-and-Finetune Paradigm. - Shaoyi Huang; Dongkuan Xu; Ian En-Hsu Yen; Yijue Wang; Sung-En Chang; Bingbing Li; Shiyang Chen 004; Mimi Xie; Sanguthevar Rajasekaran; Hang Liu 001; Caiwen Ding (ACL (1), 2022)

A length adaptive algorithm-hardware co-design of transformer on FPGA through sparse attention and dynamic pipelining. - Hongwu Peng; Shaoyi Huang; Shiyang Chen 004; Bingbing Li; Tong Geng; Ang Li 006; Weiwen Jiang; Wujie Wen; Jinbo Bi; Hang Liu 001; Caiwen Ding (DAC, 2022)

TANGO: re-thinking quantization for graph neural network training on GPUs. - Shiyang Chen 004; Da Zheng; Caiwen Ding; Chengying Huan; Yuede Ji; Hang Liu 001 (SC, 2023)

PeeK: A Prune-Centric Approach for K Shortest Path Computation. - Wang Feng; Shiyang Chen 004; Hang Liu 001; Yuede Ji (SC, 2023)

Tango: rethinking quantization for graph neural network training on GPUs. - Shiyang Chen 004; Da Zheng; Caiwen Ding; Chengying Huan; Yuede Ji; Hang Liu 001 (CoRR, 2023)

DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies. - Shuaiwen Leon Song; Bonnie Kruft; Minjia Zhang; Conglong Li; Shiyang Chen 004; Chengming Zhang 006; Masahiro Tanaka; Xiaoxia Wu; Jeff Rasley; Ammar Ahmad Awan; Connor Holmes; Martin Cai; et al. (CoRR, 2023)

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6-Centric Strategy for Diverse Generative Tasks. - Xiaoxia Wu; Haojun Xia; Stephen Youn; Zhen Zheng; Shiyang Chen 004; Arash Bakhtiari; Michael Wyatt; Reza Yazdani Aminabadi; Yuxiong He; Olatunji Ruwase; Leon Song; Zhewei Yao (CoRR, 2023)

Motif-Based Graph Representation Learning with Application to Chemical Molecules. - Yifei Wang 002; Shiyang Chen 004; Guobin Chen; Ethan Shurberg; Hang Liu 001; Pengyu Hong (Informatics, 2023)

Quant-LLM: Accelerating the Serving of Large Language Models via FP6-Centric Algorithm-System Co-Design on Modern GPUs. - Haojun Xia; Zhen Zheng; Xiaoxia Wu; Shiyang Chen 004; Zhewei Yao; Stephen Youn; Arash Bakhtiari; Michael Wyatt; Donglin Zhuang; Zhongzhu Zhou; Olatunji Ruwase; Yuxiong He; et al. (USENIX ATC, 2024)

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design. - Haojun Xia; Zhen Zheng; Xiaoxia Wu; Shiyang Chen 004; Zhewei Yao; Stephen Youn; Arash Bakhtiari; Michael Wyatt; Donglin Zhuang; Zhongzhu Zhou; Olatunji Ruwase; Yuxiong He; et al. (CoRR, 2024)

PrisonBreak: Jailbreaking Large Language Models with Fewer Than Twenty-Five Targeted Bit-flips. - Zachary Coalson; Jeonghyun Woo; Shiyang Chen 004; Yu Sun; Lishan Yang; Prashant J. Nair; Bo Fang 002; Sanghyun Hong 001 (CoRR, 2024)

Kernel fusion in atomistic spin dynamics simulations on Nvidia GPUs using tensor core. - Hongwei Chen; Shiyang Chen 004; Joshua J. Turner; Adrian E. Feiguin (J. Comput. Sci., 2024)

TEA+: A Novel Temporal Graph Random Walk Engine with Hybrid Storage Architecture. - Chengying Huan; Yongchao Liu; Heng Zhang 005; Shuaiwen Song; Santosh Pandey; Shiyang Chen 004; Xiangfei Fang; Yue Jin; Baptiste Lepers; Yanjun Wu; Hang Liu 001 (ACM Trans. Archit. Code Optim., 2024)

TeGraph+: Scalable Temporal Graph Processing Enabling Flexible Edge Modifications. - Chengying Huan; Yongchao Liu; Heng Zhang 005; Hang Liu 001; Shiyang Chen 004; Shuaiwen Leon Song; Yanjun Wu (IEEE Trans. Parallel Distributed Syst., 2024)

KVDirect: Distributed Disaggregated LLM Inference. - Shiyang Chen 004; Rain Jiang; Dezhi Yu; Jinlai Xu; Mengyuan Chao; Fanlong Meng; Chenyu Jiang; Wei Xu; Hang Liu 001 (CoRR, 2025)

Deal: Distributed End-to-End GNN Inference for All Nodes. - Shiyang Chen 004; Xiang Song; Vasiloudis Theodore; Hang Liu 001 (CoRR, 2025)