HyperRouter: Towards Efficient Training and Inference of Sparse Mixture of Experts. - Giang Do; Khiem Le; Quang Pham; TrungTin Nguyen; Thanh-Nam Doan; Bint T. Nguyen; Chenghao Liu; Savitha Ramasamy; Xiaoli Li 001; Steven C. H. Hoi (CoRR, 2023)