Optimizing Speculative Decoding for Serving Large Language Models Using Goodput. - Xiaoxuan Liu; Cade Daniel; Langxiang Hu; Woosuk Kwon; Zhuohan Li 001; Xiangxi Mo; Alvin Cheung; Zhijie Deng; Ion Stoica; Hao Zhang 025 (CoRR, 2024)