MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding. - Jian Chen; Vashisth Tiwari; Ranajoy Sadhukhan; Zhuoming Chen; Jinyuan Shi; Ian En-Hsu Yen; Beidi Chen (CoRR, 2024)

Energy Considerations of Large Language Model Inference and Efficiency Optimizations. - Jared Fernandez; Clara Na; Vashisth Tiwari; Yonatan Bisk; Sasha Luccioni; Emma Strubell (ACL (1), 2025)

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding. - Ranajoy Sadhukhan; Jian Chen; Zhuoming Chen; Vashisth Tiwari; Ruihang Lai; Jinyuan Shi; Ian En-Hsu Yen; Avner May; Tianqi Chen; Beidi Chen (ICLR, 2025)