Efficiently Programming Large Language Models using SGLang. - Lianmin Zheng; Liangsheng Yin; Zhiqiang Xie; Jeff Huang 001; Chuyue Sun; Cody Hao Yu; Shiyi Cao; Christos Kozyrakis; Ion Stoica; Joseph E. Gonzalez; Clark W. Barrett; Ying Sheng 007 (CoRR, 2023)

SGLang: Efficient Execution of Structured Language Model Programs. - Lianmin Zheng; Liangsheng Yin; Zhiqiang Xie; Chuyue Sun; Jeff Huang 001; Cody Hao Yu; Shiyi Cao; Christos Kozyrakis; Ion Stoica; Joseph E. Gonzalez; Clark W. Barrett; Ying Sheng 007 (NeurIPS, 2024)

Locality-aware Fair Scheduling in LLM Serving. - Shiyi Cao; Yichuan Wang; Ziming Mao; Pin-Lun Hsu; Liangsheng Yin; Tian Xia; Dacheng Li; Shu Liu; Yineng Zhang; Yang Zhou; Ying Sheng 007; Joseph Gonzalez 001; et al. (CoRR, 2025)