Sequoia: Scalable and Robust Speculative Decoding. - Zhuoming Chen; Avner May; Ruslan Svirschevski; Yuhsun Huang; Max Ryabinin; Zhihao Jia; Beidi Chen (NeurIPS, 2024)

Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding. - Zhuoming Chen; Avner May; Ruslan Svirschevski; Yuhsun Huang; Max Ryabinin; Zhihao Jia; Beidi Chen (CoRR, 2024)