ParaTra: A Parallel Transformer Inference Framework for Concurrent Service Provision in Edge Computing. - Fenglong Cai; Dong Yuan 001; Mengwei Xie; Wei He 020; Lanju Kong; Wei Guo 017; Yali Jiang; Lizhen Cui (ICWS, 2023)

Edge-LLM: A Collaborative Framework for Large Language Model Serving in Edge Computing. - Fenglong Cai; Dong Yuan 001; Zhe Yang; Lizhen Cui (ICWS, 2024)

AutoMP: A Tool to Automate Performance Testing for Model Placement on GPUs. - Zhe Yang; Wei He 020; Fenglong Cai; Yonghui Xu; Wei Guo 017; Lizhen Cui (ISPA, 2024)

FastPTM: Fast weights loading of pre-trained models for parallel inference service provisioning. - Fenglong Cai; Dong Yuan 001; Zhe Yang; Yonghui Xu; Wei He 020; Wei Guo 017; Lizhen Cui (Parallel Comput., 2024)