Patch-level Routing in Mixture-of-Experts is Provably Sample-efficient for Convolutional Neural Networks. - Mohammed Nowaz Rabbani Chowdhury; Shuai Zhang 015; Meng Wang 003; Sijia Liu 001; Pin-Yu Chen (ICML, 2023)

A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts. - Mohammed Nowaz Rabbani Chowdhury; Meng Wang 003; Kaoutar El Maghraoui; Naigang Wang; Pin-Yu Chen; Christopher D. Carothers (ICML, 2024)