Heyang Qin

According to our database, Heyang Qin authored at least 10 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DeepSpeed-FastGen: High-throughput Text Generation for LLMs via MII and DeepSpeed-Inference.

Connor Holmes, Masahiro Tanaka, Michael Wyatt, Ammar Ahmad Awan, Jeff Rasley, Samyam Rajbhandari, Reza Yazdani Aminabadi, Heyang Qin, Arash Bakhtiari, Lev Kurilenko, Yuxiong He

CoRR, 2024

2023

DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention.

Zhewei Yao, Xiaoxia Wu, Conglong Li, Minjia Zhang, Heyang Qin, Olatunji Ruwase, Ammar Ahmad Awan, Samyam Rajbhandari, Yuxiong He

CoRR, 2023

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales.

Zhewei Yao, Reza Yazdani Aminabadi, Olatunji Ruwase, Samyam Rajbhandari, Xiaoxia Wu, Ammar Ahmad Awan, Jeff Rasley, Minjia Zhang, Conglong Li, Connor Holmes, Zhongzhu Zhou, Michael Wyatt, Molly Smith, Lev Kurilenko, Heyang Qin, Masahiro Tanaka, Shuai Che, Shuaiwen Leon Song, Yuxiong He

CoRR, 2023

ZeRO++: Extremely Efficient Collective Communication for Giant Model Training.

Guanhua Wang, Heyang Qin, Sam Ade Jacobs, Connor Holmes, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He

CoRR, 2023

2022

Scalable and Efficient Machine Learning as a Service.

Heyang Qin

PhD thesis, 2022

Nemo: An Open-Source Transformer-Supercharged Benchmark for Fine-Grained Wildfire Smoke Detection.

Amirhessam Yazdi, Heyang Qin, Connor B. Jordan, Lei Yang, Feng Yan

Remote. Sens., 2022

2021

SimiGrad: Fine-Grained Adaptive Batching for Large Scale Training using Gradient Similarity Measurement.

Heyang Qin, Samyam Rajbhandari, Olatunji Ruwase, Feng Yan, Lei Yang, Yuxiong He

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

The Age of Correlated Features in Supervised Learning based Forecasting.

Md Kamran Chowdhury Shisher, Heyang Qin, Lei Yang, Feng Yan, Yin Sun

Proceedings of the 2021 IEEE Conference on Computer Communications Workshops, 2021

2020

Reinforcement-Learning-Empowered MLaaS Scheduling for Serving Intelligent Internet of Things.

Heyang Qin, Syed Zawad, Yanqi Zhou, Sanjay Padhi, Lei Yang, Feng Yan

IEEE Internet Things J., 2020

2019

Swift machine learning model serving scheduling: a region based reinforcement learning approach.

Heyang Qin, Syed Zawad, Yanqi Zhou, Lei Yang, Dongfang Zhao, Feng Yan

Proceedings of the International Conference for High Performance Computing, 2019