Elliptical Attention. - Stefan K. Nielsen; Laziz U. Abdullaev; Rachel S. Y. Teo; Tan Nguyen (NeurIPS, 2024)

MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts. - Rachel S. Y. Teo; Tan Nguyen (NeurIPS, 2024)

Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis. - Rachel S. Y. Teo; Tan Nguyen (NeurIPS, 2024)

Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis. - Rachel S. Y. Teo; Tan M. Nguyen (CoRR, 2024)

Elliptical Attention. - Stefan K. Nielsen; Laziz U. Abdullaev; Rachel S. Y. Teo; Tan M. Nguyen (CoRR, 2024)

MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts. - Rachel S. Y. Teo; Tan M. Nguyen (CoRR, 2024)

CAMEx: Curvature-aware Merging of Experts. - Viet Dung Nguyen; Minh Nguyen Hoang; Luc Q. Nguyen; Rachel S. Y. Teo; Tan Minh Nguyen; Linh Duy Tran (ICLR, 2025)

Tight Clusters Make Specialized Experts. - Stefan K. Nielsen; Rachel S. Y. Teo; Laziz U. Abdullaev; Tan Minh Nguyen (ICLR, 2025)

MoLEx: Mixture of Layer Experts for Fine-tuning with Sparse Upcycling. - Rachel S. Y. Teo; Tan Minh Nguyen (ICLR, 2025)

CAMEx: Curvature-aware Merging of Experts. - Dung V. Nguyen; Minh H. Nguyen; Luc Q. Nguyen; Rachel S. Y. Teo; Tan M. Nguyen; Linh Duy Tran (CoRR, 2025)

MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling. - Rachel S. Y. Teo; Tan M. Nguyen (CoRR, 2025)

The Blessing and Curse of Dimensionality in Safety Alignment. - Rachel S. Y. Teo; Laziz U. Abdullaev; Tan M. Nguyen (CoRR, 2025)