CUBE - Towards an Optimal Scaling of Cosmological N-body Simulations. - Shenggan Cheng; Hao-Ran Yu; Derek Inman; Qiucheng Liao; Qiaoya Wu; James Lin (CCGRID, 2020)

FTL: A Universal Framework for Training Low-Bit DNNs via Feature Transfer. - Kunyuan Du; Ya Zhang 002; Haibing Guan; Qi Tian 001; Yanfeng Wang 001; Shenggan Cheng; James Lin (ECCV (25), 2020)

HMS-Net: Hierarchical Multi-Scale Sparsity-Invariant Network for Sparse Depth Completion. - Zixuan Huang 001; Junming Fan; Shenggan Cheng; Shuai Yi; Xiaogang Wang 001; Hongsheng Li 001 (IEEE Trans. Image Process., 2020)

tcFFT: A Fast Half-Precision FFT Library for NVIDIA Tensor Cores. - Bin-Rui Li; Shenggan Cheng; James Lin (CLUSTER, 2021)

tcFFT: Accelerating Half-Precision FFT through Tensor Cores. - Bin-Rui Li; Shenggan Cheng; James Lin (CoRR, 2021)

FastFold: Reducing AlphaFold Training Time from 11 Days to 67 Hours. - Shenggan Cheng; Ruidong Wu; Zhongming Yu; Bin-Rui Li; Xiwen Zhang; Jian Peng 001; Yang You 001 (CoRR, 2022)

Hanayo: Harnessing Wave-like Pipeline Parallelism for Enhanced Large Model Training Efficiency. - Ziming Liu; Shenggan Cheng; Haotian Zhou; Yang You 001 (SC, 2023)

ATP: Adaptive Tensor Parallelism for Foundation Models. - Shenggan Cheng; Ziming Liu; Jiangsu Du; Yang You 001 (CoRR, 2023)

AutoChunk: Automated Activation Chunk for Memory-Efficient Deep Learning Inference. - Xuanlei Zhao; Shenggan Cheng; Guangyang Lu; Haotian Zhou; Bin Jia; Yang You 001 (ICLR, 2024)

HeteGen: Efficient Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices. - Xuanlei Zhao; Bin Jia; Haotian Zhou; Ziming Liu; Shenggan Cheng; Yang You 001 (MLSys, 2024)

FastFold: Optimizing AlphaFold Training and Inference on GPU Clusters. - Shenggan Cheng; Xuanlei Zhao; Guangyang Lu; Jiarui Fang; Tian Zheng; Ruidong Wu; Xiwen Zhang; Jian Peng 001; Yang You 001 (PPoPP, 2024)

Liger: Interleaving Intra- and Inter-Operator Parallelism for Distributed Large Model Inference. - Jiangsu Du; Jinhui Wei; Jiazhi Jiang; Shenggan Cheng; Dan Huang 001; Zhiguang Chen 001; Yutong Lu (PPoPP, 2024)

AutoChunk: Automated Activation Chunk for Memory-Efficient Long Sequence Inference. - Xuanlei Zhao; Shenggan Cheng; Guangyang Lu; Jiarui Fang; Haotian Zhou; Bin Jia; Ziming Liu; Yang You 001 (CoRR, 2024)

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices. - Xuanlei Zhao; Bin Jia; Haotian Zhou; Ziming Liu; Shenggan Cheng; Yang You 001 (CoRR, 2024)

DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers. - Xuanlei Zhao; Shenggan Cheng; Zangwei Zheng; Zheming Yang; Ziming Liu; Yang You 001 (CoRR, 2024)

WallFacer: Guiding Transformer Model Training Out of the Long-Context Dark Forest with N-body Problem. - Ziming Liu; Shaoyu Wang; Shenggan Cheng; Zhongkai Zhao; Xuanlei Zhao; James Demmel; Yang You 001 (CoRR, 2024)

Concerto: Automatic Communication Optimization and Scheduling for Large-Scale Deep Learning. - Shenggan Cheng; Shengjie Lin; Lansong Diao; Hao Wu 077; Siyu Wang; Chang Si; Ziming Liu; Xuanlei Zhao; Jiangsu Du; Wei Lin 016; Yang You 001 (ASPLOS (1), 2025)

SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation. - Shenggan Cheng; Yuanxin Wei; Lansong Diao; Yong Liu 020; Bujiao Chen; Lianghua Huang; Yu Liu 023; Wenyuan Yu; Jiangsu Du; Wei Lin 016; Yang You 001 (CoRR, 2025)

HelixPipe: Efficient Distributed Training of Long Sequence Transformers with Attention Parallel Pipeline Parallelism. - Geng Zhang; Shenggan Cheng; Xuanlei Zhao; Ziming Liu; Yang You 001 (CoRR, 2025)

ElasticMM: Efficient Multimodal LLMs Serving with Elastic Multimodal Parallelism. - Zedong Liu; Shenggan Cheng; Guangming Tan; Yang You 001; Dingwen Tao (CoRR, 2025)