Falcon Mamba: The First Competitive Attention-free 7B Language Model. - Jingwei Zuo; Maksim Velikanov; Dhia Eddine Rhaiem; Ilyas Chahed; Younes Belkada; Guillaume Kunsch; Hakim Hacid (CoRR, 2024)

Falcon-H1: A Family of Hybrid-Head Language Models Redefining Efficiency and Performance. - Jingwei Zuo; Maksim Velikanov; Ilyas Chahed; Younes Belkada; Dhia Eddine Rhayem; Guillaume Kunsch; Hakim Hacid; Hamza Yous; Brahim Farhat; Ibrahim Khadraoui; Mugariya Farooq; Giulia Campesan; et al. (CoRR, 2025)