A Short Study on Compressing Decoder-Based Language Models. - Tianda Li; Yassir El Mesbahi; Ivan Kobyzev; Ahmad Rashid; Atif Mahmud; Nithin Anchuri; Habib Hajimolahoseini; Yang Liu; Mehdi Rezagholizadeh (CoRR, 2021)

RAIL-KD: RAndom Intermediate Layer Mapping for Knowledge Distillation. - Md. Akmal Haidar; Nithin Anchuri; Mehdi Rezagholizadeh; Abbas Ghaddar; Philippe Langlais; Pascal Poupart (NAACL-HLT (Findings), 2022)