Training Transformers with 4-bit Integers. - Haocheng Xi; Changhao Li; Jianfei Chen; Jun Zhu (NeurIPS, 2023)

Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization. - Haocheng Xi; Yuxiang Chen; Kang Zhao; Kai Jun Teh; Jianfei Chen; Jun Zhu (ICML, 2024)

T-Rex: Text-assisted Retrosynthesis Prediction. - Yifeng Liu 004; Hanwen Xu; Tangqi Fang; Haocheng Xi; Zixuan Liu 001; Sheng Zhang 012; Hoifung Poon; Sheng Wang 012 (CoRR, 2024)

Jetfire: Efficient and Accurate Transformer Pretraining with INT8 Data Flow and Per-Block Quantization. - Haocheng Xi; Yuxiang Chen; Kang Zhao; Kaijun Zheng; Jianfei Chen; Jun Zhu (CoRR, 2024)

COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training. - Haocheng Xi; Han Cai; Ligeng Zhu; Yao Lu 006; Kurt Keutzer; Jianfei Chen; Song Han 003 (CoRR, 2024)

NVILA: Efficient Frontier Visual Language Models. - Zhijian Liu; Ligeng Zhu; Baifeng Shi; Zhuoyang Zhang; Yuming Lou; Shang Yang; Haocheng Xi; Shiyi Cao; Yuxian Gu; Dacheng Li; Xiuyu Li; Yunhao Fang; et al. (CoRR, 2024)

NVILA: Efficient Frontier Visual Language Models. - Zhijian Liu; Ligeng Zhu; Baifeng Shi; Zhuoyang Zhang; Yuming Lou; Shang Yang; Haocheng Xi; Shiyi Cao; Yuxian Gu; Dacheng Li; Xiuyu Li; Haotian Tang; et al. (CVPR, 2025)

COAT: Compressing Optimizer states and Activations for Memory-Efficient FP8 Training. - Haocheng Xi; Han Cai; Ligeng Zhu; Yao Lu 006; Kurt Keutzer; Jianfei Chen; Song Han 003 (ICLR, 2025)

Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity. - Haocheng Xi; Shuo Yang; Yilong Zhao; Chenfeng Xu; Muyang Li; Xiuyu Li; Yujun Lin 001; Han Cai; Jintao Zhang; Dacheng Li; Jianfei Chen; Ion Stoica; et al. (CoRR, 2025)

QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache. - Rishabh Tiwari; Haocheng Xi; Aditya Tomar; Coleman Hooper; Sehoon Kim 001; Maxwell Horton; Mahyar Najibi; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (CoRR, 2025)

SpargeAttn: Accurate Sparse Attention Accelerating Any Model Inference. - Jintao Zhang; Chendong Xiang; Haofeng Huang; Jia Wei; Haocheng Xi; Jun Zhu; Jianfei Chen (CoRR, 2025)

Oscillation-Reduced MXFP4 Training for Vision Transformers. - Yuxiang Chen; Haocheng Xi; Jun Zhu; Jianfei Chen (CoRR, 2025)

Sparse VideoGen2: Accelerate Video Generation with Sparse Attention via Semantic-Aware Permutation. - Shuo Yang; Haocheng Xi; Yilong Zhao; Muyang Li; Jintao Zhang; Han Cai; Yujun Lin 001; Xiuyu Li; Chenfeng Xu; Kelly Peng; Jianfei Chen; Song Han 003; et al. (CoRR, 2025)

Radial Attention: O(n log n) Sparse Attention with Energy Decay for Long Video Generation. - Xingyang Li; Muyang Li; Tianle Cai; Haocheng Xi; Shuo Yang; Yujun Lin 001; Lvmin Zhang; Songlin Yang; Jinbo Hu; Kelly Peng; Maneesh Agrawala; Ion Stoica; et al. (CoRR, 2025)

XQuant: Breaking the Memory Wall for LLM Inference with KV Cache Rematerialization. - Aditya Tomar; Coleman Hooper; Minjae Lee; Haocheng Xi; Rishabh Tiwari; Wonjun Kang; Luca Manolache; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (CoRR, 2025)