Explaining Sequence-Level Knowledge Distillation as Data-Augmentation for Neural Machine Translation. - Mitchell A. Gordon; Kevin Duh (CoRR, 2019)

Distill, Adapt, Distill: Training Small, In-Domain Models for Neural Machine Translation. - Mitchell A. Gordon; Kevin Duh (NGT@ACL, 2020)

Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning. - Mitchell A. Gordon; Kevin Duh; Nicholas Andrews (RepL4NLP@ACL, 2020)

Data and Parameter Scaling Laws for Neural Machine Translation. - Mitchell A. Gordon; Kevin Duh; Jared Kaplan (EMNLP (1), 2021)