A Short Study on Compressing Decoder-Based Language Models. - Tianda Li; Yassir El Mesbahi; Ivan Kobyzev; Ahmad Rashid; Atif Mahmud; Nithin Anchuri; Habib Hajimolahoseini; Yang Liu; Mehdi Rezagholizadeh (CoRR, 2021)

On the utility of enhancing BERT syntactic bias with Token Reordering Pretraining. - Yassir El Mesbahi; Atif Mahmud; Abbas Ghaddar; Mehdi Rezagholizadeh; Philippe Langlais; Prasanna Parthasarathi (CoNLL, 2023)

Language Models Inversely Scale on Piecewise Function Evaluation with Biased Examples. - Bradley C. A. Brown; Jordan Juravsky; Atif Mahmud; Wais Shahbaz; Ryan Ehrlich (Tiny Papers @ ICLR, 2023)