State-of-the-Art Arabic Language Modeling with Sparse MoE Fine-Tuning and Chain-of-Thought Distillation. - Navan Preet Singh; Anurag Garikipati; Ahmed Abulkhair; Jyani Akshay Jagdishbhai; Atul Yaduvanshi; Amarendra Chaudhary; Madalina G. Ciobanu; Qingqing Mao; Ritankar Das (CoRR, 2026)