MoEs Are Stronger than You Think: Hyper-Parallel Inference Scaling with RoE. - Soheil Zibakhsh; Mohammad Samragh; Kumari Nishu; Lauren Hannah; Arnav Kundu; Minsik Cho (CoRR, 2025)

MoE-PHDS: One MoE checkpoint for flexible runtime sparsity. - Lauren. A Hannah; Soheil Zibakhsh; Kumari Nishu; Arnav Kundu; Mohammad Samragh Razlighi; Mehrdad Farajtabar; Minsik Cho (CoRR, 2025)