Which transformer architecture fits my data? A vocabulary bottleneck in self-attention. - Noam Wies; Yoav Levine; Daniel Jannai; Amnon Shashua (ICML, 2021)

The Inductive Bias of In-Context Learning: Rethinking Pretraining Example Design. - Yoav Levine; Noam Wies; Daniel Jannai; Dan Navon; Yedid Hoshen; Amnon Shashua (ICLR, 2022)

Standing on the Shoulders of Giant Frozen Language Models. - Yoav Levine; Itay Dalmedigos; Ori Ram; Yoel Zeldes; Daniel Jannai; Dor Muhlgay; Yoni Osin; Opher Lieber; Barak Lenz; Shai Shalev-Shwartz; Amnon Shashua; Kevin Leyton-Brown; et al. (CoRR, 2022)

Human or Not? A Gamified Approach to the Turing Test. - Daniel Jannai; Amos Meron; Barak Lenz; Yoav Levine; Yoav Shoham (CoRR, 2023)

Jamba-1.5: Hybrid Transformer-Mamba Models at Scale. - Barak Lenz; Alan Arazi; Amir Bergman; Avshalom Manevich; Barak Peleg; Ben Aviram; Chen Almagor; Clara Fridman; Dan Padnos; Daniel Gissin; Daniel Jannai; Dor Muhlgay; et al. (CoRR, 2024)

Jamba: Hybrid Transformer-Mamba Language Models. - Barak Lenz; Opher Lieber; Alan Arazi; Amir Bergman; Avshalom Manevich; Barak Peleg; Ben Aviram; Chen Almagor; Clara Fridman; Dan Padnos; Daniel Gissin; Daniel Jannai; et al. (ICLR, 2025)