Scaling Back-propagation by Parallel Scan Algorithm. - Shang Wang 002; Yifan Bai 003; Gennady Pekhimenko (CoRR, 2019)

BPPSA: Scaling Back-propagation by Parallel Scan Algorithm. - Shang Wang 002; Yifan Bai 003; Gennady Pekhimenko (MLSys, 2020)

Horizontally Fused Training Array: An Effective Hardware Utilization Squeezer for Training Novel Deep Learning Models. - Shang Wang 002; Peiming Yang; Yuxuan Zheng; Xin Li; Gennady Pekhimenko (MLSys, 2021)

Sylva: Sparse Embedded Adapters via Hierarchical Approximate Second-Order Information. - Baorun Mu; Christina Giannoula; Shang Wang 002; Gennady Pekhimenko (ICS, 2024)