CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers. - Longwei Zou; Qingyang Wang; Han Zhao; Jiangangkong Jiangangkong; Yi Yang; Yangdong Deng (ACL (1), 2024)

A Multi-Level Framework for Accelerating Training Transformer Models. - Longwei Zou; Han Zhang; Yangdong Deng (ICLR, 2024)

CQIL: Inference Latency Optimization with Concurrent Computation of Quasi-Independent Layers. - Longwei Zou; Qingyang Wang; Han Zhao; Jiangang Kong; Yi Yang; Yangdong Deng (CoRR, 2024)

InstCache: A Predictive Cache for LLM Serving. - Longwei Zou; Tingfeng Liu; Kai Chen; Jiangang Kong; Yangdong Deng (CoRR, 2024)