An Empirical Study of Mamba-based Language Models. - Roger Waleffe; Wonmin Byeon; Duncan Riach; Brandon Norick; Vijay Korthikanti; Tri Dao; Albert Gu; Ali Hatamizadeh; Sudhakar Singh 003; Deepak Narayanan; Garvit Kulshreshtha; Vartika Singh; et al. (CoRR, 2024)