Combining Recurrent, Convolutional, and Continuous-time Models with Linear State Space Layers. - Albert Gu; Isys Johnson; Karan Goel; Khaled Saab 002; Tri Dao; Atri Rudra; Christopher Ré (NeurIPS, 2021)

How to Train your HIPPO: State Space Models with Generalized Orthogonal Basis Projections. - Albert Gu; Isys Johnson; Aman Timalsina; Atri Rudra; Christopher Ré (ICLR, 2023)

Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture. - Daniel Y. Fu; Simran Arora; Jessica Grogan; Isys Johnson; Evan Sabri Eyuboglu; Armin W. Thomas; Benjamin Spector; Michael Poli; Atri Rudra; Christopher Ré (NeurIPS, 2023)

Zoology: Measuring and Improving Recall in Efficient Language Models. - Simran Arora; Sabri Eyuboglu; Aman Timalsina; Isys Johnson; Michael Poli; James Zou 001; Atri Rudra; Christopher Ré (ICLR, 2024)