Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts. - Huy Nguyen; Pedram Akbarian; Fanqi Yan; Nhat Ho (ICLR, 2024)

Improving Computational Complexity in Statistical Models with Local Curvature Information. - Pedram Akbarian; Tongzheng Ren; Jiacheng Zhuo; Sujay Sanghavi; Nhat Ho (ICML, 2024)

Is Temperature Sample Efficient for Softmax Gaussian Mixture of Experts? - Huy Nguyen; Pedram Akbarian; Nhat Ho (ICML, 2024)

A General Theory for Softmax Gating Multinomial Logistic Mixture of Experts. - Huy Nguyen; Pedram Akbarian; TrungTin Nguyen; Nhat Ho (ICML, 2024)

Statistical Advantages of Perturbing Cosine Router in Sparse Mixture of Experts. - Huy Nguyen; Pedram Akbarian; Trang Pham; Trang Nguyen; Shujian Zhang; Nhat Ho (CoRR, 2024)

Quadratic Gating Functions in Mixture of Experts: A Statistical Insight. - Pedram Akbarian; Huy Nguyen; Xing Han; Nhat Ho (CoRR, 2024)

Understanding Expert Structures on Minimax Parameter Estimation in Contaminated Mixture of Experts. - Fanqi Yan; Huy Nguyen; Dung Le; Pedram Akbarian; Nhat Ho (CoRR, 2024)

Understanding Expert Structures on Minimax Parameter Estimation in Contaminated Mixture of Experts. - Fanqi Yan; Huy Nguyen; Le Quang Dung; Pedram Akbarian; Nhat Ho (AISTATS, 2025)

Statistical Advantages of Perturbing Cosine Router in Mixture of Experts. - Huy Nguyen; Pedram Akbarian; Huyen Trang Pham; Thien Trang Nguyen Vu; Shujian Zhang; Nhat Ho (ICLR, 2025)

Sigmoid Self-Attention is Better than Softmax Self-Attention: A Mixture-of-Experts Perspective. - Fanqi Yan; Huy Nguyen; Pedram Akbarian; Nhat Ho; Alessandro Rinaldo (CoRR, 2025)

On Minimax Estimation of Parameters in Softmax-Contaminated Mixture of Experts. - Fanqi Yan; Huy Nguyen; Dung Le; Pedram Akbarian; Nhat Ho; Alessandro Rinaldo (CoRR, 2025)