The emergence of number and syntax units in LSTM language models. - Yair Lakretz; Germán Kruszewski; Theo Desbordes; Dieuwke Hupkes; Stanislas Dehaene; Marco Baroni (NAACL-HLT (1), 2019)

Can RNNs learn Recursive Nested Subject-Verb Agreements? - Yair Lakretz; Theo Desbordes; Jean-Rémi King; Benoît Crabbé; Maxime Oquab; Stanislas Dehaene (CoRR, 2021)

Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans. - Yair Lakretz; Theo Desbordes; Dieuwke Hupkes; Stanislas Dehaene (CoRR, 2021)

Can Transformers Process Recursive Nested Constructions, Like Humans? - Yair Lakretz; Théo Desbordes; Dieuwke Hupkes; Stanislas Dehaene (COLING, 2022)

Assessing the influence of attractor-verb distance on grammatical agreement in humans and language models. - Christos-Nikolaos Zacharopoulos; Théo Desbordes; Mathias Sablé-Meyer (EMNLP, 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)