SDP4Bit: Toward 4-bit Communication Quantization in Sharded Data Parallelism for LLM Training. - Jinda Jia; Cong Xie; Hanlin Lu; Daoce Wang; Hao Feng; Chengming Zhang 006; Baixi Sun; Haibin Lin; Zhi Zhang; Xin Liu; Dingwen Tao (NeurIPS, 2024)

COMPSO: Optimizing Gradient Compression for Distributed Training with Second-Order Optimizers. - Baixi Sun; Weijin Liu; J. Gregory Pauloski; Jiannan Tian; Jinda Jia; Daoce Wang; Boyuan Zhang 002; Mingkai Zheng; Sheng Di; Sian Jin; Zhao Zhang 007; Xiaodong Yu 001; et al. (PPoPP, 2025)