HMoE: Heterogeneous Mixture of Experts for Language Modeling. - An Wang; Xingwu Sun; Ruobing Xie; Shuaipeng Li; Jiaqi Zhu 004; Zhen Yang; Pinxue Zhao; J. N. Han; Zhanhui Kang; Di Wang; Naoaki Okazaki; Cheng-Zhong Xu 001 (CoRR, 2024)

Lossless KV Cache Compression to 2%. - Zhen Yang; J. N. Han; Kan Wu; Ruobing Xie; An Wang; Xingwu Sun; Zhanhui Kang (CoRR, 2024)