SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters. - Shwai He; Liang Ding 006; Daize Dong; Jeremy Zhang; Dacheng Tao (EMNLP (Findings), 2022)

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters. - Shwai He; Liang Ding 006; Daize Dong; Miao Zhang; Dacheng Tao (CoRR, 2022)

Cherry Hypothesis: Identifying the Cherry on the Cake for Dynamic Networks. - Shwai He; Liang Ding 006; Daize Dong; Boan Liu; Fuqiang Yu; Dacheng Tao (CoRR, 2022)

PAD-Net: An Efficient Framework for Dynamic Networks. - Shwai He; Liang Ding 006; Daize Dong; Boan Liu; Fuqiang Yu; Dacheng Tao (ACL (1), 2023)

SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution. - Shwai He; Chenbo Jiang; Daize Dong; Liang Ding 006 (WACV, 2023)

LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-Training. - Tong Zhu 002; Xiaoye Qu; Daize Dong; Jiacheng Ruan; Jingqi Tong; Conghui He; Yu Cheng 001 (EMNLP, 2024)

iDAT: inverse Distillation Adapter-Tuning. - Jiacheng Ruan; Jingsheng Gao; Mingye Xie; Daize Dong; Suncheng Xiang; Ting Liu 016; Yuzhuo Fu (ICME, 2024)

A Graph is Worth K Words: Euclideanizing Graph using Pure Transformer. - Zhangyang Gao; Daize Dong; Cheng Tan 012; Jun Xia 001; Bozhen Hu; Stan Z. Li (ICML, 2024)

Demystifying the Compression of Mixture-of-Experts Through a Unified Framework. - Shwai He; Daize Dong; Liang Ding 006; Ang Li (CoRR, 2024)

DLO: Dynamic Layer Operation for Efficient Vertical Scaling of LLMs. - Zhen Tan 001; Daize Dong; Xinyu Zhao; Jie Peng 002; Yu Cheng 001; Tianlong Chen 001 (CoRR, 2024)

LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training. - Xiaoye Qu; Daize Dong; Xuyang Hu; Tong Zhu 002; Weigao Sun; Yu Cheng 001 (CoRR, 2024)

Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts. - Tong Zhu 002; Daize Dong; Xiaoye Qu; Jiacheng Ruan; Wenliang Chen; Yu Cheng 001 (NAACL (Long Papers), 2025)

Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques. - Shwai He; Daize Dong; Liang Ding 006; Ang Li (Trans. Mach. Learn. Res., 2025)