Support for OpenMP Tasks on Cell Architecture. - Qian Cao; Changjun Hu; Haohu He; Xiang Huang; Shigang Li 002 (ICA3PP (2), 2010)

Scheduling Multi-paradigm and Multi-grain Parallel Components on Heterogeneous Platforms. - Yunfeng Peng; Chongchong Zhao; Shucai Yao; Shigang Li 002; Yi Chen 003 (ChinaGrid, 2011)

Extending Synchronization Constructs in OpenMP to Exploit Pipeline Parallelism on Heterogeneous Multi-core. - Shigang Li 002; Shucai Yao; Haohu He; Lili Sun; Yi Chen 003; Yunfeng Peng (ICA3PP (2), 2011)

Management of Non-functional Attributes of Parallel Components. - Yunfeng Peng; Changjun Hu; Chongchong Zhao; Shigang Li 002; Shucai Yao (ICCS, 2011)

NUMA-aware shared-memory collective communication for MPI. - Shigang Li 002; Torsten Hoefler; Marc Snir (HPDC, 2013)

Asynchronous Work Stealing on Distributed Memory Systems. - Shigang Li 002; Jingyuan Hu; Xin Cheng; Chongchong Zhao (PDP, 2013)

Improved MPI collectives for MPI processes in shared address spaces. - Shigang Li 002; Torsten Hoefler; Chungjin Hu; Marc Snir (Clust. Comput., 2014)

Analyzing MPI-3.0 Process-Level Shared Memory: A Case Study with Stencil Computations. - Xiaomin Zhu; Junchao Zhang 002; Kazutomo Yoshii; Shigang Li 002; Yunquan Zhang; Pavan Balaji (CCGRID, 2015)

Fast Convolution Operations on Many-Core Architectures. - Shigang Li 002; Yunquan Zhang; Chunyang Xiang; Lei Shi 001 (HPCC/CSS/ICESS, 2015)

Automatic tuning of sparse matrix-vector multiplication on multicore clusters. - Shigang Li 002; Changjun Hu; Junchao Zhang 002; Yunquan Zhang (Sci. China Inf. Sci., 2015)

Parallel Processing Systems for Big Data: A Survey. - Yunquan Zhang; Ting Cao; Shigang Li 002; Xinhui Tian; Liang Yuan; Haipeng Jia; Athanasios V. Vasilakos (Proc. IEEE, 2016)

A Cross-Platform SpMV Framework on Many-Core Architectures. - Yunquan Zhang; Shigang Li 002; Shengen Yan; Huiyang Zhou (ACM Trans. Archit. Code Optim., 2016)

POSTER: Cache-Oblivious MPI All-to-All Communications on Many-Core Architectures. - Shigang Li 002; Yunquan Zhang; Torsten Hoefler (PPoPP, 2017)

Weighted parallel SGD for distributed unbalanced-workload training system. - Daning Cheng; Shigang Li 002; Yunquan Zhang (CoRR, 2017)

Asynchronous COMID: the theoretic basis for transmitted data sparsification tricks on Parameter Server. - Daning Cheng; Shigang Li 002; Yunquan Zhang (CoRR, 2017)

Kernel optimization for short-range molecular dynamics. - Changjun Hu; Xianmeng Wang; Jianjiang Li; Xinfu He; Shigang Li 002; Yangde Feng; Shaofeng Yang; He Bai 005 (Comput. Phys. Commun., 2017)

Hybrid-optimization strategy for the communication of large-scale Kinetic Monte Carlo simulation. - Baodong Wu; Shigang Li 002; Yunquan Zhang; Ningming Nie (Comput. Phys. Commun., 2017)

AGCM3D: A Highly Scalable Finite-Difference Dynamical Core of Atmospheric General Circulation Model Based on 3D Decomposition. - Baodong Wu; Shigang Li 002; Hang Cao; Yunquan Zhang; He Zhang 005; Junmin Xiao; Minghua Zhang (ICPADS, 2018)

Massively Scaling the Metal Microscopic Damage Simulation on Sunway TaihuLight Supercomputer. - Shigang Li 002; Baodong Wu; Yunquan Zhang; Xianmeng Wang; Jianjiang Li; Changjun Hu; Jue Wang 013; Yangde Feng; Ningming Nie (ICPP, 2018)

Communication-Avoiding for Dynamical Core of Atmospheric General Circulation Model. - Junmin Xiao; Shigang Li 002; Baodong Wu; He Zhang 005; Kun Li 016; Erlin Yao; Yunquan Zhang; Guangming Tan (ICPP, 2018)

Asynchronous Parallel Sampling Gradient Boosting Decision Tree. - Daning Cheng; Fen Xia; Shigang Li 002; Yunquan Zhang (CoRR, 2018)

Using Known Information to Accelerate HyperParameters Optimization Based on SMBO. - Daning Cheng; Hanping Zhang; Fen Xia; Shigang Li 002; Yunquan Zhang (CoRR, 2018)

Cache-Oblivious MPI All-to-All Communications Based on Morton Order. - Shigang Li 002; Yunquan Zhang; Torsten Hoefler (IEEE Trans. Parallel Distributed Syst., 2018)

Using Gradient Based Multikernel Gaussian Process and Meta-Acquisition Function to Accelerate SMBO. - Daning Cheng; Hanping Zhang; Fen Xia; Shigang Li 002; Yunquan Zhang (ICTAI, 2019)

swMD: Performance Optimizations for Molecular Dynamics Simulation on Sunway Taihulight. - Kun Li 016; Shigang Li 002; Bei Wang; Yifeng Chen; Yunquan Zhang (ISPA/BDCloud/SocialCom/SustainCom, 2019)

OpenKMC: a KMC design for hundred-billion-atom simulation using millions of cores on Sunway Taihulight. - Kun Li 016; Honghui Shang; Yunquan Zhang; Shigang Li 002; Baodong Wu; Dong Wang; Libo Zhang; Fang Li; Dexun Chen; Zhiqiang Wei 004 (SC, 2019)

The Scalability for Parallel Machine Learning Training Algorithm: Dataset Matters. - Daning Cheng; Hanping Zhang; Fen Xia; Shigang Li 002; Yunquan Zhang (CoRR, 2019)

Predicting Weather Uncertainty with Deep Convnets. - Peter Grönquist; Tal Ben-Nun; Nikoli Dryden; Peter Dueben; Luca Lavarini; Shigang Li 002; Torsten Hoefler (CoRR, 2019)

Efficient parallel optimizations of a high-performance SIFT on GPUs. - Zhihao Li 001; Haipeng Jia; Yunquan Zhang; Shice Liu; Shigang Li 002; Xiao Wang; Hao Zhang (J. Parallel Distributed Comput., 2019)

Correction to: FastNBL: fast neighbor lists establishment for molecular dynamics simulation based on bitwise operations. - Kun Li 016; Shigang Li 002; Shan Huang; Yifeng Chen; Yunquan Zhang (J. Supercomput., 2019)

A Highly Efficient Dynamical Core of Atmospheric General Circulation Model based on Leap-Format. - Hang Cao; Liang Yuan; He Zhang 005; Baodong Wu; Shigang Li 002; Pengqi Lu; Yunquan Zhang; Yongjun Xu 001; Minghua Zhang (IPDPS, 2020)

Taming unbalanced training workloads in deep learning with partial collective operations. - Shigang Li 002; Tal Ben-Nun; Salvatore Di Girolamo; Dan Alistarh; Torsten Hoefler (PPoPP, 2020)

Breaking (Global) Barriers in Parallel Stochastic Optimization with Wait-Avoiding Group Averaging. - Shigang Li 002; Tal Ben-Nun; Dan Alistarh; Salvatore Di Girolamo; Nikoli Dryden; Torsten Hoefler (CoRR, 2020)

Deep Learning for Post-Processing Ensemble Weather Forecasts. - Peter Grönquist; Chengyuan Yao; Tal Ben-Nun; Nikoli Dryden; Peter Dueben; Shigang Li 002; Torsten Hoefler (CoRR, 2020)

The static parallel distribution algorithms for hybrid density-functional calculations in HONPAS package. - Xinming Qin; Honghui Shang; Lei Xu 023; Wei Hu 006; Jinlong Yang 003; Shigang Li 002; Yunquan Zhang (Int. J. High Perform. Comput. Appl., 2020)

WP-SGD: Weighted parallel SGD for distributed unbalanced-workload training system. - Daning Cheng; Shigang Li 002; Yunquan Zhang (J. Parallel Distributed Comput., 2020)

FastNBL: fast neighbor lists establishment for molecular dynamics simulation based on bitwise operations. - Kun Li 016; Shigang Li 002; Shan Huang; Yifeng Chen; Yunquan Zhang (J. Supercomput., 2020)

Data Movement Is All You Need: A Case Study on Optimizing Transformers. - Andrei Ivanov; Nikoli Dryden; Tal Ben-Nun; Shigang Li 002; Torsten Hoefler (MLSys, 2021)

Asynchronous Decentralized SGD with Quantized and Local Updates. - Giorgi Nadiradze; Amirmojtaba Sabour; Peter Davies 001; Shigang Li 002; Dan Alistarh (NeurIPS, 2021)

Chimera: efficiently training large-scale neural networks with bidirectional pipelines. - Shigang Li 002; Torsten Hoefler (SC, 2021)

Flare: flexible in-network allreduce. - Daniele De Sensi; Salvatore Di Girolamo; Saleh Ashkboos; Shigang Li 002; Torsten Hoefler (SC, 2021)

Why Dataset Properties Bound the Scalability of Parallel Machine Learning Training Algorithms. - Daning Cheng; Shigang Li 002; Hanping Zhang; Fen Xia; Yunquan Zhang (IEEE Trans. Parallel Distributed Syst., 2021)

Breaking (Global) Barriers in Parallel Stochastic Optimization With Wait-Avoiding Group Averaging. - Shigang Li 002; Tal Ben-Nun; Giorgi Nadiradze; Salvatore Di Girolamo; Nikoli Dryden; Dan Alistarh; Torsten Hoefler (IEEE Trans. Parallel Distributed Syst., 2021)

A data-centric optimization framework for machine learning. - Oliver Rausch; Tal Ben-Nun; Nikoli Dryden; Andrei Ivanov; Shigang Li 002; Torsten Hoefler (ICS, 2022)

Near-optimal sparse allreduce for distributed deep learning. - Shigang Li 002; Torsten Hoefler (PPoPP, 2022)

HammingMesh: A Network Topology for Large-Scale Deep Learning. - Torsten Hoefler; Tommaso Bonato; Daniele De Sensi; Salvatore Di Girolamo; Shigang Li 002; Marco Heddes; Jon Belk; Deepak Goel; Miguel Castro 001; Steve Scott (SC, 2022)

Efficient Quantized Sparse Matrix Operations on Tensor Cores. - Shigang Li 002; Kazuki Osawa; Torsten Hoefler (SC, 2022)

VenusAI: An artificial intelligence platform for scientific discovery on supercomputers. - Tiechui Yao; Jue Wang 013; Meng Wan; Zhikuang Xin; Yangang Wang; Rongqiang Cao; Shigang Li 002; Xuebin Chi (J. Syst. Archit., 2022)

Asynch-SGBDT: Train Stochastic Gradient Boosting Decision Trees in an Asynchronous Parallel Manner. - Daning Cheng; Shigang Li 002; Yunquan Zhang (IPDPS, 2023)

PipeFisher: Efficient Training of Large Language Models Using Pipelining and Fisher Information Matrices. - Kazuki Osawa; Shigang Li 002; Torsten Hoefler (MLSys, 2023)

A Scalable Hybrid Total FETI Method for Massively Parallel FEM Simulations. - Kehao Lin; Chunbao Zhou; Yan Zeng; Ningming Nie; Jue Wang 013; Shigang Li 002; Yangde Feng; Yangang Wang; Kehan Yao; Tiechui Yao; Jilin Zhang; Jian Wan 001 (PPoPP, 2023)

Co-design Hardware and Algorithm for Vector Search. - Wenqi Jiang 001; Shigang Li 002; Yu Zhu; Johannes de Fine Licht; Zhenhao He; Runbin Shi; Cédric Renggli; Shuai Zhang 007; Theodoros Rekatsinas; Torsten Hoefler; Gustavo Alonso (SC, 2023)

ANT-MOC: Scalable Neutral Particle Transport Using 3D Method of Characteristics on Multi-GPU Systems. - Shunde Li; Zongguo Wang; Lingkun Bu; Jue Wang 013; Zhikuang Xin; Shigang Li 002; Yangang Wang; Yangde Feng; Peng Shi 006; Yun Hu; Xuebin Chi (SC, 2023)

Large-Scale Simulation of Structural Dynamics Computing on GPU Clusters. - Yumeng Shi; Ningming Nie; Jue Wang 013; Kehao Lin; Chunbao Zhou; Shigang Li 002; Kehan Yao; Shunde Li; Yangde Feng; Yan Zeng; Fang Liu; Yangang Wang; et al. (SC, 2023)

AutoDDL: Automatic Distributed Deep Learning with Asymptotically Optimal Communication. - Jinfan Chen; Shigang Li 002; Ran Guo; Jinhui Yuan; Torsten Hoefler (CoRR, 2023)

ASDL: A Unified Interface for Gradient Preconditioning in PyTorch. - Kazuki Osawa; Satoki Ishikawa; Rio Yokota; Shigang Li 002; Torsten Hoefler (CoRR, 2023)

AGCM-3DLF: Accelerating Atmospheric General Circulation Model via 3-D Parallelization and Leap-Format. - Hang Cao; Liang Yuan; He Zhang 005; Yunquan Zhang; Baodong Wu; Kun Li 016; Shigang Li 002; Minghua Zhang; Pengqi Lu; Junmin Xiao (IEEE Trans. Parallel Distributed Syst., 2023)

HE-ASR-IT: Hybrid Excitation and Adaptive Style Recombination for Unpaired Image-to-Image Translation. - Ziyi Wu; Juanjuan Luo; Mingxin Du; Shigang Li 002; Wenbin Yao; Zhibin Huang (IJCNN, 2024)

A High-Performance Design, Implementation, Deployment, and Evaluation of The Slim Fly Network. - Nils Blach; Maciej Besta; Daniele De Sensi; Jens Domke; Hussein Harake; Shigang Li 002; Patrick Iff; Marek Konieczny; Kartik Lakhotia; Ales Kubicek; Marcel Ferrari; Fabrizio Petrini; et al. (NSDI, 2024)

POSTER: ParGNN: Efficient Training for Large-Scale Graph Neural Network on GPU Clusters. - Shunde Li; Junyu Gu; Jue Wang 013; Tiechui Yao; Zhiqiang Liang; Yumeng Shi; Shigang Li 002; Weiting Xi; Shushen Li; Chunbao Zhou; Yangang Wang; Xuebin Chi (PPoPP, 2024)

RDRM: Real-Time Dynamic Replica Management With Joint Optimization for Edge Computing. - Xikang Zhu; Wenbin Yao; Yingying Hou; Shigang Li 002; Juanjuan Luo; Zhibin Huang; Shengdong Fu (IEEE Trans. Serv. Comput., 2024)

AutoDDL: Automatic Distributed Deep Learning With Near-Optimal Bandwidth Cost. - Jinfan Chen; Shigang Li 002; Ran Guo; Jinhui Yuan; Torsten Hoefler (IEEE Trans. Parallel Distributed Syst., 2024)

HammingMesh: A Network Topology for Large-Scale Deep Learning. - Torsten Hoefler; Tommaso Bonoto; Daniele De Sensi; Salvatore Di Girolamo; Shigang Li 002; Marco Heddes; Deepak Goel; Miguel Castro 001; Steve Scott (Commun. ACM, 2024)

FlashSparse: Minimizing Computation Redundancy for Fast Sparse Matrix Multiplications on Tensor Cores. - Jinliang Shi; Shigang Li 002; Youxuan Xu; Rongtian Fu; Xueying Wang 003; Tong Wu (PPoPP, 2025)

SparkAttention: high-performance multi-head attention for large models on Volta GPU architecture. - Youxuan Xu; Tong Wu; Shigang Li 002; Xueying Wang 003; Jingjing Wang (CCF Trans. High Perform. Comput., 2025)

Libra: Synergizing CUDA and Tensor Cores for High-Performance Sparse Matrix Multiplication. - Jinliang Shi; Shigang Li 002; Youxuan Xu; Xueying Wang 003; Rongtian Fu; Zhi Ma; Tong Wu (CoRR, 2025)

OptiFX: Automatic Optimization for Convolutional Neural Networks with Aggressive Operator Fusion on GPUs. - Xueying Wang 003; Shigang Li 002; Hao Qian; Fan Luo; Zhaoyang Hao; Tong Wu; Ruiyuan Xu; Huimin Cui; Xiaobing Feng 002; Guangli Li; Jingling Xue (ACM Trans. Archit. Code Optim., 2025)