Resurrecting Recurrent Neural Networks for Long Sequences. - Antonio Orvieto; Samuel L. Smith; Albert Gu; Anushan Fernando; Çaglar Gülçehre; Razvan Pascanu; Soham De (ICML, 2023)

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models. - Soham De; Samuel L. Smith; Anushan Fernando; Aleksandar Botev; George-Cristian Muraru; Albert Gu; Ruba Haroun; Leonard Berrada; Yutian Chen 001; Srivatsan Srinivasan; Guillaume Desjardins; Arnaud Doucet; et al. (CoRR, 2024)

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models. - Aleksandar Botev; Soham De; Samuel L. Smith; Anushan Fernando; George-Cristian Muraru; Ruba Haroun; Leonard Berrada; Razvan Pascanu; Pier Giuseppe Sessa; Robert Dadashi; Léonard Hussenot; Johan Ferret; et al. (CoRR, 2024)