Jiaao He

According to our database, Jiaao He authored at least 15 papers between 2019 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

mTuner: Accelerating Parameter-Efficient Fine-Tuning on Multi-GPU Servers with Elastic Tensor.

Kezhao Huang, Siqi Zhu, Mingshu Zhai, Liyan Zheng, Kinman Lei, Jiaao He, Yuyang Jin, Jidong Zhai

Proceedings of the 2025 USENIX Annual Technical Conference, 2025

HypeReca: Distributed Heterogeneous In-Memory Embedding Database for Training Recommender Models.

Jiaao He, Shengqi Chen, Kezhao Huang, Jidong Zhai

Proceedings of the 2025 USENIX Annual Technical Conference, 2025

UltraAttn: Efficiently Parallelizing Attention through Hierarchical Context-Tiling.

Haoyu Yang, Zan Zong, Yuyang Jin, Kinman Lei, Jiaao He, Qigang Yang, Jidong Zhai

Proceedings of the International Conference for High Performance Computing, 2025

DeltaFormer: Unlock the state space of Transformer.

Mingyu Xu, Tenglong Ao, Jiaao He, Jianqiao Lu, Guang Shi, Mingwu Zheng

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

2024

FastDecode: High-Throughput GPU-Efficient LLM Serving using Heterogeneous Pipelines.

Jiaao He, Jidong Zhai

CoRR, 2024

POSTER: Pattern-Aware Sparse Communication for Scalable Recommendation Model Training.

Jiaao He, Shengqi Chen, Jidong Zhai

Proceedings of the 29th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming, 2024

2023

SmartMoE: Efficiently Training Sparsely-Activated Models through Combining Offline and Online Parallelization.

Mingshu Zhai, Jiaao He, Zixuan Ma, Zan Zong, Runqing Zhang, Jidong Zhai

Proceedings of the 2023 USENIX Annual Technical Conference, 2023

2022

BaGuaLu: targeting brain scale pretrained models with over 37 million cores.

Zixuan Ma, Jiaao He, Jiezhong Qiu, Huanqi Cao, Yuanwei Wang, Zhenbo Sun, Liyan Zheng, Haojie Wang, Shizhi Tang, Tianyu Zheng, Junyang Lin, Guanyu Feng, Zeqiang Huang, Jie Gao, Aohan Zeng, Jianwei Zhang, Runxin Zhong, Tianhui Shi, Sha Liu, Weimin Zheng, Jie Tang, Hongxia Yang, Xin Liu, Jidong Zhai, Wenguang Chen

Proceedings of the PPoPP '22: 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Seoul, Republic of Korea, April 2, 2022

FasterMoE: modeling and optimizing training of large-scale dynamic pre-trained models.

Jiaao He, Jidong Zhai, Tiago Antunes, Haojie Wang, Fuwen Luo, Shangfeng Shi, Qin Li

Proceedings of the PPoPP '22: 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Seoul, Republic of Korea, April 2, 2022

Efficiently emulating high-bitwidth computation with low-bitwidth hardware.

Zixuan Ma, Haojie Wang, Guanyu Feng, Chen Zhang, Lei Xie, Jiaao He, Shengqi Chen, Jidong Zhai

Proceedings of the ICS '22: 2022 International Conference on Supercomputing, Virtual Event, June 28, 2022

2021

Critique of "Planetary Normal Mode Computation: Parallel Algorithms, Performance, and Reproducibility" by SCC Team From Tsinghua University.

Chen Zhang, Chenggang Zhao, Jiaao He, Shengqi Chen, Liyan Zheng, Kezhao Huang, Wentao Han, Jidong Zhai

IEEE Trans. Parallel Distributed Syst., 2021

FastMoE: A Fast Mixture-of-Expert Training System.

Jiaao He, Jiezhong Qiu, Aohan Zeng, Zhilin Yang, Jidong Zhai, Jie Tang

CoRR, 2021

2020

Prague: High-Performance Heterogeneity-Aware Asynchronous Decentralized Training.

Qinyi Luo, Jiaao He, Youwei Zhuo, Xuehai Qian

Proceedings of the ASPLOS '20: Architectural Support for Programming Languages and Operating Systems, 2020

2019

Student Cluster Competition 2018, Team Tsinghua University: Reproducing performance of multi-physics simulations of the Tsunamigenic 2004 Sumatra megathrust earthquake on the Intel Skylake Architecture.

Jiaao He, Chenggang Zhao, Jiping Yu, Xinjian Yu, Liyan Zheng, Chenyao Lou, Shizhi Tang, Wentao Han, Jidong Zhai

Parallel Comput., 2019

Heterogeneity-Aware Asynchronous Decentralized Training.

Qinyi Luo, Jiaao He, Youwei Zhuo, Xuehai Qian

CoRR, 2019