Rethinking Memory and Communication Cost for Efficient Large Language Model Training. - Chan Wu; Hanxiao Zhang; Lin Ju; Jinjing Huang; Youshao Xiao; Zhaoxin Huan; Siyuan Li; Fanzhuang Meng; Lei Liang 001; Xiaolu Zhang; Jun Zhou 011 (CoRR, 2023)

Rethinking Memory and Communication Costs for Efficient Data Parallel Training of Large Language Models. - Hanxiao Zhang; Lin Ju; Chan Wu; Jinjing Huang; Youshao Xiao; Zhenglei Zhou; Zhiming Fan; Zhaoxin Huan; Siyuan Li; Fanzhuang Meng; Lei Liang 002; Xiaolu Zhang; et al. (NeurIPS, 2024)

AntBatchInfer: Elastic Batch Inference in the Kubernetes Cluster. - Siyuan Li; Youshao Xiao; Fanzhuang Meng; Lin Ju; Lei Liang 002; Lin Wang 098; Jun Zhou 011 (CoRR, 2024)