DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales. - Zhewei Yao; Reza Yazdani Aminabadi; Olatunji Ruwase; Samyam Rajbhandari; Xiaoxia Wu; Ammar Ahmad Awan; Jeff Rasley; Minjia Zhang; Conglong Li; Connor Holmes; Zhongzhu Zhou; Michael Wyatt; et al. (CoRR, 2023)

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference. - Connor Holmes; Masahiro Tanaka; Michael Wyatt; Ammar Ahmad Awan; Jeff Rasley; Samyam Rajbhandari; Reza Yazdani Aminabadi; Heyang Qin; Arash Bakhtiari; Lev Kurilenko; Yuxiong He (CoRR, 2024)

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. - Marah I Abdin; Sam Ade Jacobs; Ammar Ahmad Awan; Jyoti Aneja; Ahmed Awadallah 001; Hany Awadalla; Nguyen Bach; Amit Bahree; Arash Bakhtiari; Harkirat S. Behl; Alon Benhaim; Misha Bilenko; et al. (CoRR, 2024)

Universal Checkpointing: Efficient and Flexible Checkpointing for Large Scale Distributed Training. - Xinyu Lian; Sam Ade Jacobs; Lev Kurilenko; Masahiro Tanaka; Stas Bekman; Olatunji Ruwase; Minjia Zhang (CoRR, 2024)

Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelism. - Xinyu Lian; Sam Ade Jacobs; Lev Kurilenko; Masahiro Tanaka; Stas Bekman; Olatunji Ruwase; Minjia Zhang (USENIX ATC, 2025)