Implicit Regularization Towards Rank Minimization in ReLU Networks. - Nadav Timor; Gal Vardi; Ohad Shamir (ALT, 2023)

StarCoder: may the source be with you! - Raymond Li; Loubna Ben Allal; Yangtian Zi; Niklas Muennighoff; Denis Kocetkov; Chenghao Mou; Marc Marone; Christopher Akiki; Jia Li 015; Jenny Chim; Qian Liu 012; Evgenii Zheltonozhskii; et al. (Trans. Mach. Learn. Res., 2023)

Dynamic Speculation Lookahead Accelerates Speculative Decoding of Large Language Models. - Jonathan Mamou; Oren Pereg; Daniel Korat; Moshe Berchansky; Nadav Timor; Moshe Wasserblat; Roy Schwartz 001 (ENLSP, 2024)

Distributed Speculative Inference of Large Language Models is Provably Faster. - Nadav Timor; Jonathan Mamou; Oren Pereg; Moshe Berchansky; Daniel Korat; Moshe Wasserblat; Tomer Galanti; Michal Gordon; David Harel (ENLSP, 2024)

Accelerating Speculative Decoding using Dynamic Speculation Length. - Jonathan Mamou; Oren Pereg; Daniel Korat; Moshe Berchansky; Nadav Timor; Moshe Wasserblat; Roy Schwartz 001 (CoRR, 2024)

Distributed Speculative Inference of Large Language Models. - Nadav Timor; Jonathan Mamou; Daniel Korat; Moshe Berchansky; Oren Pereg; Moshe Wasserblat; Tomer Galanti; Michal Gordon; David Harel (CoRR, 2024)

Distributed Speculative Inference (DSI): Speculation Parallelism for Provably Faster Lossless Language Model Inference. - Nadav Timor; Jonathan Mamou; Daniel Korat; Moshe Berchansky; Oren Pereg; Moshe Wasserblat; Tomer Galanti; Michal Gordon-Kiwkowitz; David Harel (ICLR, 2025)

Accelerating LLM Inference with Lossless Speculative Decoding Algorithms for Heterogeneous Vocabularies. - Nadav Timor; Jonathan Mamou; Daniel Korat; Moshe Berchansky; Oren Pereg; Gaurav Jain; Roy Schwartz 001; Moshe Wasserblat; David Harel (CoRR, 2025)

Out-of-Vocabulary Sampling Boosts Speculative Decoding. - Nadav Timor; Jonathan Mamou; Oren Pereg; Hongyang Zhang; David Harel (CoRR, 2025)