Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation. - Yichen Zhu; Ning Liu 007; Zhiyuan Xu; Xin Liu 086; Weibin Meng; Louis Wang; Zhicai Ou; Jian Tang 008 (NeurIPS, 2022)

BaGuaLu: targeting brain scale pretrained models with over 37 million cores. - Zixuan Ma; Jiaao He; Jiezhong Qiu; Huanqi Cao; Yuanwei Wang; Zhenbo Sun; Liyan Zheng 001; Haojie Wang; Shizhi Tang; Tianyu Zheng; Junyang Lin; Guanyu Feng; et al. (PPoPP, 2022)

Adaptive distribution calibration for few-shot learning via optimal transport. - Xin Liu 086; Kairui Zhou; Pengbo Yang; Liping Jing; Jian Yu 001 (Inf. Sci., 2022)

Recognizable Information Bottleneck. - Yilin Lyu; Xin Liu 086; Mingyang Song; Xinyue Wang; Yaxin Peng; Tieyong Zeng; Liping Jing (IJCAI, 2023)

ByteTransformer: A High-Performance Transformer Boosted for Variable-Length Inputs. - Yujia Zhai; Chengquan Jiang; Leyuan Wang; Xiaoying Jia 001; Shang Zhang; Zizhong Chen; Xin Liu 086; Yibo Zhu (IPDPS, 2023)

Improving Zero-shot Visual Question Answering via Large Language Models with Reasoning Question Prompts. - Yunshi Lan; Xiang Li 067; Xin Liu 086; Yang Li 218; Wei Qin; Weining Qian (ACM Multimedia, 2023)

Not All Tasks Are Equal: A Parameter-Efficient Task Reweighting Method for Few-Shot Learning. - Xin Liu 086; Yilin Lyu; Liping Jing; Tieyong Zeng; Jian Yu 001 (ECML/PKDD (2), 2023)

vMF Loss: Exploring a Scattered Intra-class Hypersphere for Few-Shot Learning. - Xin Liu 086; Shijing Wang; Kairui Zhou; Yilin Lyu; Mingyang Song; Liping Jing; Tieyong Zeng; Jian Yu 001 (ECML/PKDD (2), 2023)

MuxFlow: Efficient and Safe GPU Sharing in Large-Scale Production Deep Learning Clusters. - Yihao Zhao; Xin Liu 086; Shufan Liu; Xiang Li 067; Yibo Zhu; Gang Huang 001; Xuanzhe Liu; Xin Jin 008 (CoRR, 2023)

Query-Relevant Images Jailbreak Large Multi-Modal Models. - Xin Liu 086; Yichen Zhu; Yunshi Lan; Chao Yang 026; Yu Qiao 001 (CoRR, 2023)

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models. - Xin Liu 086; Yichen Zhu; Jindong Gu; Yunshi Lan; Chao Yang 026; Yu Qiao 001 (ECCV (56), 2024)

Safety of Multimodal Large Language Models on Images and Text. - Xin Liu 086; Yichen Zhu; Yunshi Lan; Chao Yang 026; Yu Qiao 001 (IJCAI, 2024)

MegaScale: Scaling Large Language Model Training to More Than 10, 000 GPUs. - Ziheng Jiang; Haibin Lin; Yinmin Zhong; Qi Huang; Yangrui Chen; Zhi Zhang; Yanghua Peng; Xiang Li 067; Cong Xie; Shibiao Nong; Yulu Jia; Sun He; et al. (NSDI, 2024)

MuxFlow: efficient GPU sharing in production-level clusters with more than 10000 GPUs. - Xuanzhe Liu; Yihao Zhao; Shufan Liu; Xiang Li 067; Yibo Zhu; Xin Liu 086; Xin Jin 008 (Sci. China Inf. Sci., 2024)

Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Models. - Minjie Zhu; Yichen Zhu; Xin Liu 086; Ning Liu 007; Zhiyuan Xu; Chaomin Shen 001; Yaxin Peng; Zhicai Ou; Feifei Feng; Jian Tang 008 (CoRR, 2024)

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation. - Chao Jin; Zili Zhang; Xuanlin Jiang; Fangyue Liu; Xin Liu 086; Xuanzhe Liu; Xin Jin 008 (CoRR, 2024)

FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion. - Li-Wen Chang; Wenlei Bao; Qi Hou; Chengquan Jiang; Ningxin Zheng; Yinmin Zhong; Xuanrun Zhang; Zuquan Song; Ziheng Jiang; Haibin Lin; Xin Jin 008; Xin Liu 086 (CoRR, 2024)

MMRo: Are Multimodal LLMs Eligible as the Brain for In-Home Robotics? - Jinming Li; Yichen Zhu; Zhiyuan Xu; Jindong Gu; Minjie Zhu; Xin Liu 086; Ning Liu 007; Yaxin Peng; Feifei Feng; Jian Tang 008 (CoRR, 2024)

ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference. - Hanshi Sun; Li-Wen Chang; Wenlei Bao; Size Zheng 001; Ningxin Zheng; Xin Liu 086; Harry Dong; Yuejie Chi; Beidi Chen (CoRR, 2024)

A Comprehensive Overhaul of Multimodal Assistant with Small Language Models. - Minjie Zhu; Yichen Zhu; Ning Liu 007; Xin Liu 086; Zhiyuan Xu; Chaomin Shen 001; Yaxin Peng (AAAI, 2025)

Understanding Stragglers in Large Model Training Using What-if Analysis. - Jinkun Lin; Ziheng Jiang; Zuquan Song; Sida Zhao; Menghan Yu; Zhanghan Wang; Chenyuan Wang; Zuocheng Shi; Xiang Shi; Wei Jia; Zherui Liu; Shuguang Wang; et al. (OSDI, 2025)

Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts. - Shulai Zhang; Ningxin Zheng; Haibin Lin; Ziheng Jiang; Wenlei Bao; Chengquan Jiang; Qi Hou; Weihao Cui; Size Zheng 001; Li-Wen Chang; Quan Chen 002; Xin Liu 086 (CoRR, 2025)

TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives. - Size Zheng 001; Jin Fang; Xuegui Zheng; Qi Hou; Wenlei Bao; Ningxin Zheng; Ziheng Jiang; Dongyang Wang; Jianxi Ye; Haibin Lin; Li-Wen Chang; Xin Liu 086 (CoRR, 2025)

MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism. - Ruidong Zhu; Ziheng Jiang; Chao Jin; Peng Wu; Cesar A. Stuardo; Dongyang Wang; Xinlei Zhang; Huaping Zhou; Haoran Wei; Yang Cheng; Jianzhe Xiao; Xinyi Zhang; et al. (CoRR, 2025)

Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler. - Size Zheng 001; Wenlei Bao; Qi Hou; Xuegui Zheng; Jin Fang; Chenhui Huang; Tianqi Li; Haojie Duanmu; Renze Chen; Ruifan Xu; Yifan Guo; Ningxin Zheng; et al. (CoRR, 2025)

MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production. - Chao Jin; Ziheng Jiang; Zhihao Bai; Zheng Zhong; Juncai Liu; Xiang Li 067; Ningxin Zheng; Xi Wang; Cong Xie; Qi Huang; Wen Heng; Yiyuan Ma; et al. (CoRR, 2025)

SwiftSpec: Ultra-Low Latency LLM Decoding by Scaling Asynchronous Speculative Decoding. - Ziyi Zhang; Ziheng Jiang; Chengquan Jiang; Menghan Yu; Size Zheng 001; Haibin Lin; Henry Hoffmann; Xin Liu 086 (CoRR, 2025)

Cannikin: No Lagger of SLO in Concurrent Multiple LoRA LLM Serving. - Ruidong Zhu; Ziyue Jiang 002; Zhi Zhang; Xin Liu 086; Xuanzhe Liu; Xin Jin 008 (IEEE Trans. Parallel Distributed Syst., 2025)