Basis Technology at TAC 2012 Entity Linking. - James Clarke; Yuval Merhav; Ghalib Suleiman; Shuai Zheng 004; David Murgatroyd (TAC, 2012)

Flexible navigation in smartphones and tablets using scalable storyboards. - Shuai Zheng 004; Luis Herranz; Shuqiang Jiang (ICMR, 2013)

Accurate Integration of Aerosol Predictions by Smoothing on a Manifold. - Shuai Zheng 004; James T. Kwok (AAAI, 2014)

Fast Distributed Asynchronous SGD with Variance Reduction. - Ruiliang Zhang; Shuai Zheng 004; James T. Kwok (CoRR, 2015)

Fast Nonsmooth Regularized Risk Minimization with Continuation. - Shuai Zheng 004; Ruiliang Zhang; James T. Kwok (AAAI, 2016)

Asynchronous Distributed Semi-Stochastic Gradient Optimization. - Ruiliang Zhang; Shuai Zheng 004; James T. Kwok (AAAI, 2016)

Fast-and-Light Stochastic ADMM. - Shuai Zheng 004; James T. Kwok (IJCAI, 2016)

Follow the Moving Leader in Deep Learning. - Shuai Zheng 004; James T. Kwok (ICML, 2017)

Conditional Image-Text Embedding Networks. - Bryan A. Plummer; Paige Kordas; M. Hadi Kiapour; Shuai Zheng 004; Robinson Piramuthu; Svetlana Lazebnik (ECCV (12), 2018)

Lightweight Stochastic Optimization for Minimizing Finite Sums with Infinite Data. - Shuai Zheng 004; James Tin-Yau Kwok (ICML, 2018)

ModaNet: A Large-scale Street Fashion Dataset with Polygon Annotations. - Shuai Zheng 004; Fan Yang 076; M. Hadi Kiapour; Robinson Piramuthu (ACM Multimedia, 2018)

Communication-Efficient Distributed Blockwise Momentum SGD with Error-Feedback. - Shuai Zheng 004; Ziyue Huang; James T. Kwok (NeurIPS, 2019)

Give Me a Hint! Navigating Image Databases Using Human-in-the-Loop Feedback. - Bryan A. Plummer; M. Hadi Kiapour; Shuai Zheng 004; Robinson Piramuthu (WACV, 2019)

Blockwise Adaptivity: Faster Training and Better Generalization in Deep Learning. - Shuai Zheng 004; James T. Kwok (CoRR, 2019)

GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. - Jian Guo; He He 001; Tong He 002; Leonard Lausen; Mu Li 003; Haibin Lin; Xingjian Shi; Chenguang Wang 001; Junyuan Xie; Sheng Zha; Aston Zhang; Hang Zhang 005; et al. (CoRR, 2019)

CSER: Communication-efficient SGD with Error Reset. - Cong Xie; Shuai Zheng 004; Oluwasanmi Koyejo; Indranil Gupta; Mu Li 003; Haibin Lin (NeurIPS, 2020)

Accelerated Large Batch Optimization of BERT Pretraining in 54 minutes. - Shuai Zheng 004; Haibin Lin; Sheng Zha; Mu Li 003 (CoRR, 2020)

GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing. - Jian Guo; He He 001; Tong He 002; Leonard Lausen; Mu Li 003; Haibin Lin; Xingjian Shi; Chenguang Wang 001; Junyuan Xie; Sheng Zha; Aston Zhang; Hang Zhang 005; et al. (J. Mach. Learn. Res., 2020)

Removing Batch Normalization Boosts Adversarial Training. - Haotao Wang; Aston Zhang; Shuai Zheng 004; Xingjian Shi; Mu Li 003; Zhangyang Wang (ICML, 2022)

Partial and Asymmetric Contrastive Learning for Out-of-Distribution Detection in Long-Tailed Recognition. - Haotao Wang; Aston Zhang; Yi Zhu 001; Shuai Zheng 004; Mu Li 003; Alex J. Smola; Zhangyang Wang (ICML, 2022)

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (KDD, 2022)

DCAF-BERT: A Distilled Cachable Adaptable Factorized Model For Improved Ads CTR Prediction. - Aashiq Muhamed; Jaspreet Singh; Shuai Zheng 004; Iman Keivanloo; Sujan Perera; James Mracek; Yi Xu 011; Qingjun Cui; Santosh Rajagopalan; Belinda Zeng; Trishul Chilimbi (WWW (Companion Volume), 2022)

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (CoRR, 2022)

SMILE: Scaling Mixture-of-Experts with Efficient Bi-level Routing. - Chaoyang He 001; Shuai Zheng 004; Aston Zhang; George Karypis; Trishul Chilimbi; Mahdi Soltanolkotabi; Salman Avestimehr (CoRR, 2022)

SPT: Semi-Parametric Prompt Tuning for Multitask Prompted Learning. - M. Saiful Bari; Aston Zhang; Shuai Zheng 004; Xingjian Shi; Yi Zhu 001; Shafiq Joty; Mu Li 003 (CoRR, 2022)

MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud. - Zhen Zhang 063; Shuai Zheng 004; Yida Wang 003; Justin Chiu; George Karypis; Trishul Chilimbi; Mu Li 003; Xin Jin 008 (Proc. VLDB Endow., 2022)

Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition. - Shuhuai Ren; Aston Zhang; Yi Zhu 001; Shuai Zhang; Shuai Zheng 004; Mu Li 003; Alexander J. Smola; Xu Sun 001 (NeurIPS, 2023)

GEMINI: Fast Failure Recovery in Distributed Training with In-Memory Checkpoints. - Zhuang Wang; Zhen Jia 001; Shuai Zheng 004; Zhen Zhang 063; Xinwei Fu; T. S. Eugene Ng; Yida Wang 003 (SOSP, 2023)

Decoupled Model Schedule for Deep Learning Training. - Hongzheng Chen; Cody Hao Yu; Shuai Zheng 004; Zhen Zhang 063; Zhiru Zhang; Yida Wang 003 (CoRR, 2023)

Slapo: A Schedule Language for Progressive Optimization of Large Deep Learning Model Training. - Hongzheng Chen; Cody Hao Yu; Shuai Zheng 004; Zhen Zhang 063; Zhiru Zhang; Yida Wang 003 (ASPLOS (2), 2024)

DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines. - Chenyu Jiang 002; Zhen Jia 001; Shuai Zheng 004; Yida Wang 003; Chuan Wu 001 (EuroSys, 2024)

Lancet: Accelerating Mixture-of-Experts Training via Whole Graph Computation-Communication Overlapping. - Chenyu Jiang 002; Ye Tian; Zhen Jia 001; Shuai Zheng 004; Chuan Wu 001; Yida Wang 003 (MLSys, 2024)

DISTMM: Accelerating Distributed Multimodal Model Training. - Jun Huang; Zhen Zhang 063; Shuai Zheng 004; Feng Qin; Yida Wang 003 (NSDI, 2024)