Multi-Aspect Knowledge Distillation for Language Model with Low-rank Factorization. - Zihe Liu; Yulong Mao; Jinan Xu; Xinrui Peng; Kaiyu Huang (CoRR, 2026)