Swift machine learning model serving scheduling: a region based reinforcement learning approach. - Heyang Qin; Syed Zawad; Yanqi Zhou; Lei Yang 001; Dongfang Zhao 001; Feng Yan 001 (SC, 2019)

Reinforcement-Learning-Empowered MLaaS Scheduling for Serving Intelligent Internet of Things. - Heyang Qin; Syed Zawad; Yanqi Zhou; Sanjay Padhi; Lei Yang 001; Feng Yan 001 (IEEE Internet Things J., 2020)

The Age of Correlated Features in Supervised Learning based Forecasting. - Md Kamran Chowdhury Shisher; Heyang Qin; Lei Yang 001; Feng Yan 001; Yin Sun (INFOCOM Workshops, 2021)

SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement. - Heyang Qin; Samyam Rajbhandari; Olatunji Ruwase; Feng Yan 001; Lei Yang 001; Yuxiong He (NeurIPS, 2021)

Nemo: An Open-Source Transformer-Supercharged Benchmark for Fine-Grained Wildfire Smoke Detection. - Amirhessam Yazdi; Heyang Qin; Connor B. Jordan; Lei Yang 001; Feng Yan 001 (Remote. Sens., 2022)

Scalable and Efficient Machine Learning as a Service. - Heyang Qin (2022)

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training. - Guanhua Wang; Heyang Qin; Sam Ade Jacobs; Connor Holmes; Samyam Rajbhandari; Olatunji Ruwase; Feng Yan 001; Lei Yang 001; Yuxiong He (CoRR, 2023)

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales. - Zhewei Yao; Reza Yazdani Aminabadi; Olatunji Ruwase; Samyam Rajbhandari; Xiaoxia Wu; Ammar Ahmad Awan; Jeff Rasley; Minjia Zhang; Conglong Li; Connor Holmes; Zhongzhu Zhou; Michael Wyatt; et al. (CoRR, 2023)

DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention. - Zhewei Yao; Xiaoxia Wu; Conglong Li; Minjia Zhang; Heyang Qin; Olatunji Ruwase; Ammar Ahmad Awan; Samyam Rajbhandari; Yuxiong He (CoRR, 2023)

ZeRO++: Extremely Efficient Collective Communication for Large Model Training. - Guanhua Wang; Heyang Qin; Sam Ade Jacobs; Xiaoxia Wu; Connor Holmes; Zhewei Yao; Samyam Rajbhandari; Olatunji Ruwase; Feng Yan 001; Lei Yang 001; Yuxiong He (ICLR, 2024)

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference. - Connor Holmes; Masahiro Tanaka; Michael Wyatt; Ammar Ahmad Awan; Jeff Rasley; Samyam Rajbhandari; Reza Yazdani Aminabadi; Heyang Qin; Arash Bakhtiari; Lev Kurilenko; Yuxiong He (CoRR, 2024)

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. - Marah I Abdin; Sam Ade Jacobs; Ammar Ahmad Awan; Jyoti Aneja; Ahmed Awadallah 001; Hany Awadalla; Nguyen Bach; Amit Bahree; Arash Bakhtiari; Harkirat S. Behl; Alon Benhaim; Misha Bilenko; et al. (CoRR, 2024)