Profiling and optimizing deep learning inference on mobile GPUs. - Shiqi Jiang 002; Lihao Ran; Ting Cao 003; Yusen Xu; Yunxin Liu 001 (APSys, 2020)

To Bridge Neural Network Design and Real-World Performance: A Behaviour Study for Neural Networks. - Xiaohu Tang 003; Shihao Han; Li Lyna Zhang; Ting Cao 003; Yunxin Liu 001 (MLSys, 2021)

AsyMo: scalable and efficient deep-learning inference on asymmetric mobile CPUs. - Manni Wang; Shaohua Ding; Ting Cao 003; Yunxin Liu 001; Fengyuan Xu (MobiCom, 2021)

nn-Meter: towards accurate latency prediction of deep-learning model inference on diverse edge devices. - Li Lyna Zhang; Shihao Han; Jianyu Wei; Ningxin Zheng; Ting Cao 003; Yuqing Yang 001; Yunxin Liu 001 (MobiSys, 2021)

nn-METER: Towards Accurate Latency Prediction of DNN Inference on Diverse Edge Devices. - Li Lyna Zhang; Shihao Han; Jianyu Wei; Ningxin Zheng; Ting Cao 003; Yunxin Liu 001 (GetMobile Mob. Comput. Commun., 2021)

SwiftPruner: Reinforced Evolutionary Pruning for Efficient Ad Relevance. - Li Lyna Zhang; Youkow Homma; Yujing Wang; Min Wu; Mao Yang 004; Ruofei Zhang; Ting Cao 003; Wei Shen (CIKM, 2022)

Romou: rapidly generate high-performance tensor kernels for mobile GPUs. - Rendong Liang; Ting Cao 003; Jicheng Wen; Manni Wang; Yang Wang 053; Jianhua Zou; Yunxin Liu 001 (MobiCom, 2022)

MobiDepth: real-time depth estimation using on-device dual cameras. - Jinrui Zhang; Huan Yang; Ju Ren 001; Deyu Zhang; Bangwen He; Ting Cao 003; Yuanchun Li 003; Yaoxue Zhang; Yunxin Liu 001 (MobiCom, 2022)

CoDL: efficient CPU-GPU co-execution for deep learning inference on mobile devices. - Fucheng Jia; Deyu Zhang; Ting Cao 003; Shiqi Jiang 002; Yunxin Liu 001; Ju Ren 001; Yaoxue Zhang (MobiSys, 2022)

Turbo: Opportunistic Enhancement for Edge Video Analytics. - Yan Lu 006; Shiqi Jiang 002; Ting Cao 003; Yuanchao Shu (SenSys, 2022)

Hyperion: A Generic and Distributed Mobile Offloading Framework on OpenCL. - Ziyan Fu; Ju Ren 001; Yunxin Liu 001; Ting Cao 003; Deyu Zhang; Yuezhi Zhou; Yaoxue Zhang (SenSys, 2022)

Understanding and Optimizing Deep Learning Cold-Start Latency on Edge Devices. - Rongjie Yi; Ting Cao 003; Ao Zhou 001; Xiao Ma 009; Shangguang Wang; Mengwei Xu 001 (CoRR, 2022)

Adam Accumulation to Reduce Memory Footprints of Both Activations and Gradients for Large-Scale DNN Training. - Yijia Zhang; Yibo Han; Shijie Cao; Guohao Dai; Youshan Miao; Ting Cao 003; Fan Yang 024; Ningyi Xu (ECAI, 2023)

ElasticViT: Conflict-aware Supernet Training for Deploying Fast Vision Transformer on Diverse Mobile Devices. - Chen Tang; Li Lyna Zhang; Huiqiang Jiang; Jiahang Xu; Ting Cao 003; Quanlu Zhang; Yuqing Yang 001; Zhi Wang; Mao Yang 004 (ICCV, 2023)

SpaceEvo: Hardware-Friendly Search Space Design for Efficient INT8 Inference. - Xudong Wang; Li Lyna Zhang; Jiahang Xu; Quanlu Zhang; Yujing Wang; Yuqing Yang 001; Ningxin Zheng; Ting Cao 003; Mao Yang 004 (ICCV, 2023)

Constraint-aware and Ranking-distilled Token Pruning for Efficient Transformer Inference. - Junyan Li; Li Lyna Zhang; Jiahang Xu; Yujing Wang; Shaoguang Yan; Yunqing Xia; Yuqing Yang 001; Ting Cao 003; Hao Sun 015; Weiwei Deng; Qi Zhang 066; Mao Yang 004 (KDD, 2023)

Efficient GPU Kernels for N: M-Sparse Weights in Deep Learning. - Bin Lin; Ningxin Zheng; Lei Wang 222; Shijie Cao; Lingxiao Ma; Quanlu Zhang; Yi Zhu; Ting Cao 003; Jilong Xue; Yuqing Yang 001; Fan Yang 024 (MLSys, 2023)

LUT-NN: Empower Efficient Neural Network Inference with Centroid Learning and Table Lookup. - Xiaohu Tang 003; Yang Wang 053; Ting Cao 003; Li Lyna Zhang; Qi Chen 009; Deng Cai 001; Yunxin Liu 001; Mao Yang 004 (MobiCom, 2023)

NN-Stretch: Automatic Neural Network Branching for Parallel Inference on Heterogeneous Multi-Processors. - Jianyu Wei; Ting Cao 003; Shijie Cao; Shiqi Jiang 002; Shaowei Fu; Mao Yang 004; Yanyong Zhang; Yunxin Liu 001 (MobiSys, 2023)

Boosting DNN Cold Inference on Edge Devices. - Rongjie Yi; Ting Cao 003; Ao Zhou 001; Xiao Ma 009; Shangguang Wang; Mengwei Xu 001 (MobiSys, 2023)

LUT-NN: Towards Unified Neural Network Inference by Table Lookup. - Xiaohu Tang 003; Yang Wang 053; Ting Cao 003; Li Lyna Zhang; Qi Chen 009; Deng Cai 001; Yunxin Liu 001; Mao Yang 004 (CoRR, 2023)

Gamify Stencil Dwarf on Cloud for Democratizing Scientific Computing. - Kun Li 016; Zhichun Li; Yuetao Chen; Zixuan Wang; Yiwei Zhang; Liang Yuan; Haipeng Jia; Yunquan Zhang; Ting Cao 003; Mao Yang 004 (CoRR, 2023)

Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models. - Yijia Zhang; Lingran Zhao; Shijie Cao; Wenqiang Wang; Ting Cao 003; Fan Yang 024; Mao Yang 004; Shanghang Zhang; Ningyi Xu (CoRR, 2023)

Accelerating In-Browser Deep Learning Inference on Diverse Edge Clients through Just-in-Time Kernel Optimizations. - Fucheng Jia; Shiqi Jiang 002; Ting Cao 003; Wei Cui; Tianrui Xia; Xu Cao; Yuanchun Li 003; Deyu Zhang; Ju Ren 001; Yunxin Liu 001; Lili Qiu; Mao Yang 004 (CoRR, 2023)

BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation. - Dayou Du; Yijia Zhang; Shijie Cao; Jiaqi Guo; Ting Cao 003; Xiaowen Chu 001; Ningyi Xu (ACL (1), 2024)

AFPQ: Asymmetric Floating Point Quantization for LLMs. - Yijia Zhang; Sicheng Zhang; Shijie Cao; Dayou Du; Jianyu Wei; Ting Cao 003; Ningyi Xu (ACL (Findings), 2024)

PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization. - Cong Li 008; Zhe Zhou 002; Yang Wang 053; Fan Yang 093; Ting Cao 003; Mao Yang 004; Yun Liang 001; Guangyu Sun 003 (ASPLOS (2), 2024)

Hybrid SLM and LLM for Edge-Cloud Collaborative Inference. - Zixu Hao; Huiqiang Jiang; Shiqi Jiang 002; Ju Ren 001; Ting Cao 003 (EdgeFM@MobiSys, 2024)

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models. - Yifei Liu; Jicheng Wen; Yang Wang 053; Shengyu Ye; Li Lyna Zhang; Ting Cao 003; Cheng Li 001; Mao Yang 004 (EMNLP, 2024)

Integer or Floating Point? New Outlooks for Low-Bit Quantization on Large Language Models. - Yijia Zhang; Lingran Zhao; Shijie Cao; Sicheng Zhang; Wenqiang Wang; Ting Cao 003; Fan Yang 024; Mao Yang 004; Shanghang Zhang; Ningyi Xu (ICME, 2024)

Pre-gated MoE: An Algorithm-System Co-Design for Fast and Scalable Mixture-of-Expert Inference. - Ranggi Hwang; Jianyu Wei; Shijie Cao; Changho Hwang; Xiaohu Tang 003; Ting Cao 003; Mao Yang 004 (ISCA, 2024)

FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices. - Xiangyu Li; Yuanchun Li 003; Yuanzhe Li; Ting Cao 003; Yunxin Liu 001 (MobiCom, 2024)

Empowering In-Browser Deep Learning Inference on Edge Through Just-In-Time Kernel Optimization. - Fucheng Jia; Shiqi Jiang 002; Ting Cao 003; Wei Cui; Tianrui Xia; Xu Cao; Yuanchun Li 003; Qipeng Wang; Deyu Zhang; Ju Ren 001; Yunxin Liu 001; Lili Qiu; et al. (MobiSys, 2024)

Poster: Design of Elastic Deep Neural Network Candidate Spaces for Inference on Diverse Devices. - Jeongho Won; Ting Cao 003; Huiqiang Jiang; Junehwa Song (MobiSys, 2024)

LitePred: Transferable and Scalable Latency Prediction for Hardware-Aware Neural Architecture Search. - Chengquan Feng; Li Lyna Zhang; Yuanchi Liu; Jiahang Xu; Chengruidong Zhang; Zhiyuan Wang; Ting Cao 003; Mao Yang 004; Haisheng Tan (NSDI, 2024)

Ladder: Enabling Efficient Low-Precision Deep Learning Computing through Hardware-aware Tensor Transformation. - Lei Wang 222; Lingxiao Ma; Shijie Cao; Quanlu Zhang; Jilong Xue; Yining Shi 001; Ningxin Zheng; Ziming Miao; Fan Yang 024; Ting Cao 003; Yuqing Yang 001; Mao Yang 004 (OSDI, 2024)

ConvStencil: Transform Stencil Computation to Matrix Multiplication on Tensor Cores. - Yuetao Chen; Kun Li 016; Yuhao Wang; Donglin Bai; Lei Wang 222; Lingxiao Ma; Liang Yuan; Yunquan Zhang; Ting Cao 003; Mao Yang 004 (PPoPP, 2024)

Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity. - Tuowei Wang; Kun Li 016; Zixu Hao; Donglin Bai; Ju Ren 001; Yaoxue Zhang; Ting Cao 003; Mao Yang 004 (SC, 2024)

LoRAStencil: Low-Rank Adaptation of Stencil Computation on Tensor Cores. - Yiwei Zhang; Kun Li 016; Liang Yuan; Jiawen Cheng; Yunquan Zhang; Ting Cao 003; Mao Yang 004 (SC, 2024)

Exploring the Impact of In-Browser Deep Learning Inference on Quality of User Experience and Performance. - Qipeng Wang; Shiqi Jiang 002; Zhenpeng Chen; Xu Cao; Yuanchun Li 003; Aoyu Li; Ying Zhang 012; Yun Ma 002; Ting Cao 003; Xuanzhe Liu (CoRR, 2024)

Advancing Multi-Modal Sensing Through Expandable Modality Alignment. - Shenghong Dai; Shiqi Jiang 002; Yifan Yang 004; Ting Cao 003; Mo Li 001; Suman Banerjee 001; Lili Qiu (CoRR, 2024)

LUT Tensor Core: Lookup Table Enables Efficient Low-Bit LLM Inference Acceleration. - Zhiwen Mo; Lei Wang 222; Jianyu Wei; Zhichen Zeng 002; Shijie Cao; Lingxiao Ma; Naifeng Jing; Ting Cao 003; Jilong Xue; Fan Yang 024; Mao Yang 004 (CoRR, 2024)

SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs. - Yizhao Gao 002; Zhichen Zeng 002; Dayou Du; Shijie Cao; Hayden Kwok-Hay So; Ting Cao 003; Fan Yang 024; Mao Yang 004 (CoRR, 2024)

Making Every Frame Matter: Continuous Video Understanding for Large Models via Adaptive State Modeling. - Hao Wu 067; Donglin Bai; Shiqi Jiang 002; Qianxi Zhang; Yifan Yang 004; Ting Cao 003; Fengyuan Xu (CoRR, 2024)

Ripple: Accelerating LLM Inference on Smartphones with Correlation-Aware Neuron Management. - Tuowei Wang; Ruwen Fan; Minxing Huang; Zixu Hao; Kun Li 016; Ting Cao 003; Youyou Lu; Yaoxue Zhang; Ju Ren 001 (CoRR, 2024)

Matryoshka: Optimization of Dynamic Diverse Quantum Chemistry Systems via Elastic Parallelism Transformation. - Tuowei Wang; Kun Li 016; Donglin Bai; Fusong Ju; Leo Xia; Ting Cao 003; Ju Ren 001; Yaoxue Zhang; Mao Yang 004 (CoRR, 2024)

HiMoDepth: Efficient Training-Free High-Resolution On-Device Depth Perception. - Jinrui Zhang; Huan Yang; Ju Ren 001; Deyu Zhang; Bangwen He; Youngki Lee 001; Ting Cao 003; Yuanchun Li 003; Yaoxue Zhang; Yunxin Liu 001 (IEEE Trans. Mob. Comput., 2024)

T-MAC: CPU Renaissance via Table Lookup for Low-Bit LLM Deployment on Edge. - Jianyu Wei; Shijie Cao; Ting Cao 003; Lingxiao Ma; Lei Wang 222; Yanyong Zhang; Mao Yang 004 (EuroSys, 2025)

LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Accelerator. - Guoyu Li; Shengyu Ye; Chunyun Chen; Yang Wang 053; Fan Yang 024; Ting Cao 003; Cheng Liu; Mohamed M. Sabry Aly; Mao Yang 004 (HPCA, 2025)

LUT Tensor Core: A Software-Hardware Co-Design for LUT-Based Low-Bit LLM Inference. - Zhiwen Mo; Lei Wang 222; Jianyu Wei; Zhichen Zeng 002; Shijie Cao; Lingxiao Ma; Naifeng Jing; Ting Cao 003; Jilong Xue; Fan Yang 024; Mao Yang 004 (ISCA, 2025)

FlashFFTStencil: Bridging Fast Fourier Transforms to Memory-Efficient Stencil Computations on Tensor Core Units. - Haozhi Han; Kun Li 016; Wei Cui; Donglin Bai; Yiwei Zhang; Liang Yuan; Yifeng Chen; Yunquan Zhang; Ting Cao 003; Mao Yang 004 (PPoPP, 2025)

Jigsaw: Toward Conflict-free Vectorized Stencil Computation by Tessellating Swizzled Registers. - Yiwei Zhang; Kun Li 016; Liang Yuan; Haozhi Han; Yunquan Zhang; Ting Cao 003; Mao Yang 004 (PPoPP, 2025)

Babel: A Scalable Pre-trained Model for Multi-Modal Sensing via Expandable Modality Alignment. - Shenghong Dai; Shiqi Jiang 002; Yifan Yang 004; Ting Cao 003; Mo Li 001; Suman Banerjee 001; Lili Qiu (SenSys, 2025)

JENGA: Enhancing LLM Long-Context Fine-tuning with Contextual Token Sparsity. - Tuowei Wang; Xingyu Chen; Kun Li 016; Ting Cao 003; Ju Ren 001; Yaoxue Zhang (USENIX ATC, 2025)

PUDTune: Multi-Level Charging for High-Precision Calibration in Processing-Using-DRAM. - Tatsuya Kubo; Daichi Tokuda; Lei Qu; Ting Cao 003; Shinya Takamaeda-Yamazaki (IEEE Comput. Archit. Lett., 2025)

Dissecting Bit-Level Scaling Laws in Quantizing Vision Generative Models. - Xin Ding; Shijie Cao; Ting Cao 003; Zhibo Chen 012 (CoRR, 2025)

LeMo: Enabling LEss Token Involvement for MOre Context Fine-tuning. - Tuowei Wang; Xingyu Chen; Kun Li 016; Ting Cao 003; Ju Ren 001; Yaoxue Zhang (CoRR, 2025)

LUT-DLA: Lookup Table as Efficient Extreme Low-Bit Deep Learning Accelerator. - Guoyu Li; Shengyu Ye; Chunyun Chen; Yang Wang 053; Fan Yang 024; Ting Cao 003; Cheng Li 001; Mohamed M. Sabry; Mao Yang 004 (CoRR, 2025)

Anatomizing Deep Learning Inference in Web Browsers. - Qipeng Wang; Shiqi Jiang 002; Zhenpeng Chen; Xu Cao; Yuanchun Li 003; Aoyu Li; Yun Ma 002; Ting Cao 003; Xuanzhe Liu (ACM Trans. Softw. Eng. Methodol., 2025)

StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognition. - Xin Ding; Hao Wu 067; Yifan Yang 004; Shiqi Jiang 002; Donglin Bai; Zhibo Chen 012; Ting Cao 003 (CoRR, 2025)

Advancing Mobile GUI Agents: A Verifier-Driven Approach to Practical Deployment. - Gaole Dai; Shiqi Jiang 002; Ting Cao 003; Yuanchun Li 003; Yuqing Yang 001; Rui Tan 001; Mo Li 001; Lili Qiu (CoRR, 2025)

BitDecoding: Unlocking Tensor Cores for Long-Context LLMs Decoding with Low-Bit KV Cache. - Dayou Du; Shijie Cao; Jianyi Cheng; Ting Cao 003; Mao Yang 004 (CoRR, 2025)

MVDRAM: Enabling GeMV Execution in Unmodified DRAM for Low-Bit LLM Acceleration. - Tatsuya Kubo; Daichi Tokuda; Tomoya Nagatani; Masayuki Usui; Lei Qu; Ting Cao 003; Shinya Takamaeda-Yamazaki (CoRR, 2025)

Scaling Up On-Device LLMs via Active-Weight Swapping Between DRAM and Flash. - Fucheng Jia; Zewen Wu; Shiqi Jiang 002; Huiqiang Jiang; Qianxi Zhang; Yuqing Yang 001; Yunxin Liu 001; Ju Ren 001; Deyu Zhang; Ting Cao 003 (CoRR, 2025)

Empowering Agentic Video Analytics Systems with Video Language Models. - Yuxuan Yan; Shiqi Jiang 002; Ting Cao 003; Yifan Yang 004; Qianqian Yang 002; Yuanchao Shu; Yuqing Yang 001; Lili Qiu (CoRR, 2025)

Zoomer: Adaptive Image Focus Optimization for Black-box MLLM. - Jiaxu Qian; Chendong Wang; Yifan Yang 004; Chaoyun Zhang; Huiqiang Jiang; Xufang Luo; Yu Kang 006; Qingwei Lin; Anlan Zhang; Shiqi Jiang 002; Ting Cao 003; Tianjun Mao; et al. (CoRR, 2025)

SwarmThinkers: Learning Physically Consistent Atomic KMC Transitions at Scale. - Qi Li; Kun Li 016; Haozhi Han; Honghui Shang; Xinfu He; Yunquan Zhang; Hong An; Ting Cao 003; Mao Yang 004 (CoRR, 2025)

SeerAttention-R: Sparse Attention Adaptation for Long Reasoning. - Yizhao Gao 002; Shuming Guo; Shijie Cao; Yuqing Xia; Yu Cheng; Lei Wang 222; Lingxiao Ma; Yutao Sun; Tianzhu Ye; Li Dong 004; Hayden Kwok-Hay So; Yu Hua; et al. (CoRR, 2025)

SparStencil: Retargeting Sparse Tensor Cores to Scientific Stencil Computations via Structured Sparsity Transformation. - Qi Li; Kun Li 016; Haozhi Han; Liang Yuan; Junshi Chen; Yunquan Zhang; Yifeng Chen; Hong An; Ting Cao 003; Mao Yang 004 (CoRR, 2025)

ProRe: A Proactive Reward System for GUI Agents via Reasoner-Actor Collaboration. - Gaole Dai; Shiqi Jiang 002; Ting Cao 003; Yuqing Yang 001; Yuanchun Li 003; Rui Tan 001; Mo Li 001; Lili Qiu (CoRR, 2025)

Scaling LLM Test-Time Compute with Mobile NPU on Smartphones. - Zixu Hao; Jianyu Wei; Tuowei Wang; Minxing Huang; Huiqiang Jiang; Shiqi Jiang 002; Ting Cao 003; Ju Ren 001 (CoRR, 2025)

AdaNav: Adaptive Reasoning with Uncertainty for Vision-Language Navigation. - Xin Ding; Jianyu Wei; Yifan Yang 004; Shiqi Jiang 002; Qianxi Zhang; Hao Wu 067; Fucheng Jia; Liang Mi; Yuxuan Yan; Weijun Wang 001; Yunxin Liu 001; Zhibo Chen 001; et al. (CoRR, 2025)

Efficient and Adaptive Diffusion Model Inference Through Lookup Table on Mobile Devices. - Qipeng Wang; Shiqi Jiang 002; Yifan Yang 004; Ruiqi Liu 001; Yuanchun Li 003; Ting Cao 003; Xuanzhe Liu (IEEE Trans. Mob. Comput., 2025)

Video-in-the-Loop: Span-Grounded Long Video QA with Interleaved Reasoning. - Chendong Wang; Donglin Bai; Yifan Yang 004; Xiao Jin; Anlan Zhang; Rui Wang 095; Shiqi Jiang 002; Yuqing Yang 001; Hao Wu 067; Qi Dai 001; Chong Luo 001; Ting Cao 003; et al. (CoRR, 2025)