Towards Coarse-to-Fine Evaluation of Inference Efficiency for Large Language Models. - Yushuo Chen; Tianyi Tang; Erge Xiang; Linjiang Li; Wayne Xin Zhao; Jing Wang; Yunpeng Chai; Ji-Rong Wen (CoRR, 2024)