Parameters vs FLOPs: Scaling Laws for Optimal Sparsity for Mixture-of-Experts Language Models. - Samira Abnar; Harshay Shah; Dan Busbridge; Alaaeldin Mohamed Elnouby Ali; Joshua M. Susskind; Vimal Thilak (CoRR, 2025)