Distributed learning of multilingual DNN feature extractors using GPUs. - Yajie Miao; Hao Zhang 025; Florian Metze (INTERSPEECH, 2014)

Towards speaker adaptive training of deep neural network acoustic models. - Yajie Miao; Hao Zhang 025; Florian Metze (INTERSPEECH, 2014)

Improvements to speaker adaptive training of deep neural networks. - Yajie Miao; Lu Jiang 004; Hao Zhang 025; Florian Metze (SLT, 2014)

Automatic Photo Adjustment Using Deep Learning. - Zhicheng Yan 001; Hao Zhang 025; Baoyuan Wang; Sylvain Paris; Yizhou Yu (CoRR, 2014)

Semi-supervised training in low-resource ASR and KWS. - Florian Metze; Ankur Gandhe; Yajie Miao; Zaid Sheikh; Yun Wang 005; Di Xu; Hao Zhang 025; Jungsuk Kim; Ian R. Lane; Wonkyum Lee; Sebastian Stüker; Markus Müller 001 (ICASSP, 2015)

Regularizing DNN acoustic models with Gaussian stochastic neurons. - Hao Zhang 025; Yajie Miao; Florian Metze (ICASSP, 2015)

HD-CNN: Hierarchical Deep Convolutional Neural Networks for Large Scale Visual Recognition. - Zhicheng Yan 001; Hao Zhang 025; Robinson Piramuthu; Vignesh Jagadeesh; Dennis DeCoste; Wei Di; Yizhou Yu (ICCV, 2015)

Dynamic Topic Modeling for Monitoring Market Competition from Online Text and Image Data. - Hao Zhang 025; Gunhee Kim; Eric P. Xing (KDD, 2015)

Poseidon: A System Architecture for Efficient GPU-based Deep Learning on Multiple Machines. - Hao Zhang 025; Zhiting Hu; Jinliang Wei; Pengtao Xie; Gunhee Kim; Qirong Ho; Eric P. Xing (CoRR, 2015)

Speaker Adaptive Training of Deep Neural Network Acoustic Models Using I-Vectors. - Yajie Miao; Hao Zhang 025; Florian Metze (IEEE ACM Trans. Audio Speech Lang. Process., 2015)

Learning Concept Taxonomies from Multi-modal Data. - Hao Zhang 025; Zhiting Hu; Yuntian Deng; Mrinmaya Sachan; Zhicheng Yan 001; Eric P. Xing (ACL (1), 2016)

GeePS: scalable deep learning on distributed GPUs with a GPU-specialized parameter server. - Henggang Cui; Hao Zhang 025; Gregory R. Ganger; Phillip B. Gibbons; Eric P. Xing (EuroSys, 2016)

Combining the Best of Convolutional Layers and Recurrent Layers: A Hybrid Network for Semantic Segmentation. - Zhicheng Yan 001; Hao Zhang 025; Yangqing Jia; Thomas M. Breuel; Yizhou Yu (CoRR, 2016)

Automatic Photo Adjustment Using Deep Neural Networks. - Zhicheng Yan 001; Hao Zhang 025; Baoyuan Wang; Sylvain Paris; Yizhou Yu (ACM Trans. Graph., 2016)

Recurrent Topic-Transition GAN for Visual Paragraph Generation. - Xiaodan Liang; Zhiting Hu; Hao Zhang 025; Chuang Gan 001; Eric P. Xing (ICCV, 2017)

Structured Generative Adversarial Networks. - Zhijie Deng; Hao Zhang 025; Xiaodan Liang; Luona Yang; Shizhen Xu; Jun Zhu 001; Eric P. Xing (NIPS, 2017)

Poseidon: An Efficient Communication Architecture for Distributed Deep Learning on GPU Clusters. - Hao Zhang 025; Zeyu Zheng; Shizhen Xu; Wei Dai 003; Qirong Ho; Xiaodan Liang; Zhiting Hu; Jinliang Wei; Pengtao Xie; Eric P. Xing (USENIX ATC, 2017)

ZM-Net: Real-time Zero-shot Image Manipulation Network. - Hao Wang 014; Xiaodan Liang; Hao Zhang 025; Dit-Yan Yeung; Eric P. Xing (CoRR, 2017)

SCAN: Structure Correcting Adversarial Network for Chest X-rays Organ Segmentation. - Wei Dai 003; Joseph Doyle; Xiaodan Liang; Hao Zhang 025; Nanqing Dong; Yuan Li 032; Eric P. Xing (CoRR, 2017)

Generative Semantic Manipulation with Contrasting GAN. - Xiaodan Liang; Hao Zhang 025; Eric P. Xing (CoRR, 2017)

Cavs: A Vertex-centric Programming Interface for Dynamic Neural Networks. - Hao Zhang 025; Shizhen Xu; Graham Neubig; Wei Dai 003; Qirong Ho; Guangwen Yang; Eric P. Xing (CoRR, 2017)

Generative Semantic Manipulation with Mask-Contrasting GAN. - Xiaodan Liang; Hao Zhang 025; Liang Lin; Eric P. Xing (ECCV (13), 2018)

SCAN: Structure Correcting Adversarial Network for Organ Segmentation in Chest X-Rays. - Wei Dai 003; Nanqing Dong; Zeya Wang; Xiaodan Liang; Hao Zhang 025; Eric P. Xing (DLMIA/ML-CDS@MICCAI, 2018)

Symbolic Graph Reasoning Meets Convolutions. - Xiaodan Liang; Zhiting Hu; Hao Zhang 025; Liang Lin; Eric P. Xing (NeurIPS, 2018)

Cavs: An Efficient Runtime System for Dynamic Neural Networks. - Shizhen Xu; Hao Zhang 025; Graham Neubig; Wei Dai 003; Jin Kyu Kim; Zhijie Deng; Qirong Ho; Guangwen Yang; Eric P. Xing (USENIX ATC, 2018)

AutoLoss: Learning Discrete Schedules for Alternate Optimization. - Haowen Xu; Hao Zhang 025; Zhiting Hu; Xiaodan Liang; Ruslan Salakhutdinov; Eric P. Xing (CoRR, 2018)

Toward Understanding the Impact of Staleness in Distributed Machine Learning. - Wei Dai 003; Yi Zhou 017; Nanqing Dong; Hao Zhang 025; Eric P. Xing (ICLR (Poster), 2019)

AutoLoss: Learning Discrete Schedule for Alternate Optimization. - Haowen Xu; Hao Zhang 025; Zhiting Hu; Xiaodan Liang; Ruslan Salakhutdinov; Eric P. Xing (ICLR (Poster), 2019)

AutoSync: Learning to Synchronize for Data-Parallel Distributed Deep Learning. - Hao Zhang 025; Yuan Li 032; Zhijie Deng; Xiaodan Liang; Lawrence Carin; Eric P. Xing (NeurIPS, 2020)

Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning. - Aurick Qiao; Willie Neiswanger; Qirong Ho; Hao Zhang 025; Gregory R. Ganger; Eric P. Xing (CoRR, 2020)

BayesAdapter: Being Bayesian, Inexpensively and Robustly, via Bayeisan Fine-tuning. - Zhijie Deng; Xiao Yang; Hao Zhang 025; Yinpeng Dong; Jun Zhu 001 (CoRR, 2020)

Ada-Segment: Automated Multi-loss Adaptation for Panoptic Segmentation. - Gengwei Zhang; Yiming Gao 004; Hang Xu 004; Hao Zhang 025; Zhenguo Li; Xiaodan Liang (AAAI, 2021)

TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models. - Zhuohan Li 001; Siyuan Zhuang; Shiyuan Guo; Danyang Zhuo; Hao Zhang 025; Dawn Song; Ion Stoica (ICML, 2021)

Simple and Automatic Distributed Machine Learning on Ray. - Hao Zhang 025; Zhuohan Li 001; Lianmin Zheng; Ion Stoica (KDD, 2021)

Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learning. - Aurick Qiao; Sang Keun Choe; Suhas Jayaram Subramanya; Willie Neiswanger; Qirong Ho; Hao Zhang 025; Gregory R. Ganger; Eric P. Xing (OSDI, 2021)

Machine Learning Parallelism Could Be Adaptive, Composable and Automated. - Hao Zhang 025 (2021)

AMP: Automatically Finding Model Parallel Strategies with Heterogeneity Awareness. - Dacheng Li; Hongyi Wang 001; Eric P. Xing; Hao Zhang 025 (NeurIPS, 2022)

Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning. - Lianmin Zheng; Zhuohan Li 001; Hao Zhang 025; Yonghao Zhuang 001; Zhifeng Chen; Yanping Huang; Yida Wang 003; Yuanzhong Xu; Danyang Zhuo; Eric P. Xing; Joseph E. Gonzalez; Ion Stoica (OSDI, 2022)

Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learning. - Lianmin Zheng; Zhuohan Li 001; Hao Zhang 025; Yonghao Zhuang 001; Zhifeng Chen; Yanping Huang; Yida Wang 003; Yuanzhong Xu; Danyang Zhuo; Joseph E. Gonzalez; Ion Stoica (CoRR, 2022)

MPCFormer: fast, performant and private Transformer inference with MPC. - Dacheng Li; Rulin Shao; Hongyi Wang 001; Han Guo; Eric P. Xing; Hao Zhang 025 (CoRR, 2022)

DNB: A Joint Learning Framework for Deep Bayesian Nonparametric Clustering. - Zeya Wang; Yang Ni; Baoyu Jing; Deqing Wang; Hao Zhang 025; Eric P. Xing (IEEE Trans. Neural Networks Learn. Syst., 2022)

MPCFORMER: Fast, Performant and Provate Transformer Inference with MPC. - Dacheng Li; Hongyi Wang 001; Rulin Shao; Han Guo; Eric P. Xing; Hao Zhang 025 (ICLR, 2023)

On Optimizing the Communication of Model Parallelism. - Yonghao Zhuang 001; Lianmin Zheng; Zhuohan Li 001; Eric P. Xing; Qirong Ho; Joseph Gonzalez 001; Ion Stoica; Hao Zhang 025; Hexu Zhao (MLSys, 2023)

Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena. - Lianmin Zheng; Wei-Lin Chiang; Ying Sheng 007; Siyuan Zhuang; Zhanghao Wu; Yonghao Zhuang 001; Zi Lin; Zhuohan Li 001; Dacheng Li; Eric P. Xing; Hao Zhang 025; Joseph E. Gonzalez; et al. (NeurIPS, 2023)

AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving. - Zhuohan Li 001; Lianmin Zheng; Yinmin Zhong; Vincent Liu 001; Ying Sheng 007; Xin Jin 008; Yanping Huang; Zhifeng Chen; Hao Zhang 025; Joseph E. Gonzalez; Ion Stoica (OSDI, 2023)

Efficient Memory Management for Large Language Model Serving with PagedAttention. - Woosuk Kwon; Zhuohan Li 001; Siyuan Zhuang; Ying Sheng 007; Lianmin Zheng; Cody Hao Yu; Joseph Gonzalez 001; Hao Zhang 025; Ion Stoica (SOSP, 2023)

LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers. - Dacheng Li; Rulin Shao; Anze Xie; Eric P. Xing; Joseph E. Gonzalez; Ion Stoica; Xuezhe Ma; Hao Zhang 025 (CoRR, 2023)

AdaMoE: Token-Adaptive Routing with Null Experts for Mixture-of-Experts Language Models. - Zihao Zeng; Yibo Miao; Hongcheng Gao; Hao Zhang 025; Zhijie Deng (EMNLP (Findings), 2024)

LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset. - Lianmin Zheng; Wei-Lin Chiang; Ying Sheng 007; Tianle Li; Siyuan Zhuang; Zhanghao Wu; Yonghao Zhuang 001; Zhuohan Li 001; Zi Lin; Eric P. Xing; Joseph E. Gonzalez; Ion Stoica; et al. (ICLR, 2024)

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference. - Wei-Lin Chiang; Lianmin Zheng; Ying Sheng 007; Anastasios Nikolas Angelopoulos; Tianle Li; Dacheng Li; Banghua Zhu; Hao Zhang 025; Michael I. Jordan; Joseph E. Gonzalez; Ion Stoica (ICML, 2024)

MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving. - Jiangfei Duan; Runyu Lu; Haojie Duanmu; Xiuhong Li; Xingcheng Zhang; Dahua Lin; Ion Stoica; Hao Zhang 025 (ICML, 2024)

Break the Sequential Dependency of LLM Inference Using Lookahead Decoding. - Yichao Fu; Peter Bailis; Ion Stoica; Hao Zhang 025 (ICML, 2024)

Online Speculative Decoding. - Xiaoxuan Liu; Lanxiang Hu; Peter Bailis; Alvin Cheung; Zhijie Deng; Ion Stoica; Hao Zhang 025 (ICML, 2024)

Efficient LLM Scheduling by Learning to Rank. - Yichao Fu; Siqi Zhu; Runlong Su; Aurick Qiao; Ion Stoica; Hao Zhang 025 (NeurIPS, 2024)

Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length. - Xuezhe Ma; Xiaomeng Yang; Wenhan Xiong; Beidi Chen; Lili Yu; Hao Zhang 025; Jonathan May; Luke Zettlemoyer; Omer Levy; Chunting Zhou (NeurIPS, 2024)

DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving. - Yinmin Zhong; Shengyu Liu; Junda Chen; Jianbo Hu; Yibo Zhu; Xuanzhe Liu; Xin Jin 008; Hao Zhang 025 (OSDI, 2024)

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving. - Jiangfei Duan; Runyu Lu; Haojie Duanmu; Xiuhong Li; Xingcheng Zhang; Dahua Lin; Ion Stoica; Hao Zhang 025 (CoRR, 2024)

Toward Inference-optimal Mixture-of-Expert Large Language Models. - Longfei Yun; Yonghao Zhuang 001; Yao Fu; Eric P. Xing; Hao Zhang 025 (CoRR, 2024)

Optimizing Speculative Decoding for Serving Large Language Models Using Goodput. - Xiaoxuan Liu; Cade Daniel; Langxiang Hu; Woosuk Kwon; Zhuohan Li 001; Xiangxi Mo; Alvin Cheung; Zhijie Deng; Ion Stoica; Hao Zhang 025 (CoRR, 2024)

MPC-Minimized Secure LLM Inference. - Deevashwer Rathee; Dacheng Li; Ion Stoica; Hao Zhang 025; Raluca A. Popa (CoRR, 2024)

Specifications: The missing link to making the development of LLM systems an engineering discipline. - Ion Stoica; Matei Zaharia; Joseph Gonzalez 001; Ken Goldberg; Koushik Sen; Hao Zhang 025; Anastasios Angelopoulos; Shishir G. Patil; Lingjiao Chen; Wei-Lin Chiang; Jared Quincy Davis (CoRR, 2024)

Efficiently Serving LLM Reasoning Programs with Certaindex. - Yichao Fu; Junda Chen; Siqi Zhu; Zheyu Fu; Zhongdongming Dai; Aurick Qiao; Hao Zhang 025 (CoRR, 2024)

TrimLLM: Progressive Layer Dropping for Domain-Specific LLMs. - Lanxiang Hu; Tajana Rosing; Hao Zhang 025 (ACL (1), 2025)

Scaling Long Context Training Data by Long-Distance Referrals. - Yonghao Zhuang 001; Lanxiang Hu; Longfei Yun; Souvik Kundu 009; Zhengzhong Liu 001; Eric P. Xing; Hao Zhang 025 (ICLR, 2025)

GameArena: Evaluating LLM Reasoning through Live Computer Games. - Lanxiang Hu; Qiyu Li; Anze Xie; Nan Jiang; Ion Stoica; Haojian Jin; Hao Zhang 025 (ICLR, 2025)

Fast Video Generation with Sliding Tile Attention. - Peiyuan Zhang; Yongqi Chen; Runlong Su; Hangliang Ding; Ion Stoica; Zhenghong Liu; Hao Zhang 025 (CoRR, 2025)

Efficient-vDiT: Efficient Video Diffusion Transformers With Attention Tile. - Hangliang Ding; Dacheng Li; Runlong Su; Peiyuan Zhang; Zhijie Deng; Ion Stoica; Hao Zhang 025 (CoRR, 2025)

VSA: Faster Video Diffusion with Trainable Sparse Attention. - Peiyuan Zhang; Haofeng Huang; Yongqi Chen; Will Lin; Zhengzhong Liu 001; Ion Stoica; Eric Xing; Hao Zhang 025 (CoRR, 2025)

lmgame-Bench: How Good are LLMs at Playing Games? - Lanxiang Hu; Mingjia Huo; Yuxuan Zhang; Haoyang Yu; Eric P. Xing; Ion Stoica; Tajana Rosing; Haojian Jin; Hao Zhang 025 (CoRR, 2025)