CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers. - Longwei Zou; Qingyang Wang; Han Zhao; Jiangang Kong; Yi Yang; Yangdong Deng (CoRR, 2024)

InstCache: A Predictive Cache for LLM Serving. - Longwei Zou; Tingfeng Liu; Kai Chen; Jiangang Kong; Yangdong Deng (CoRR, 2024)