Batch normalized recurrent neural networks. - César Laurent; Gabriel Pereyra; Philemon Brakel; Ying Zhang 033; Yoshua Bengio (ICASSP, 2016)

Regularizing Neural Networks by Penalizing Confident Output Distributions. - Gabriel Pereyra; George Tucker; Jan Chorowski; Lukasz Kaiser; Geoffrey E. Hinton (ICLR (Workshop), 2017)

Large scale distributed neural network training through online distillation. - Rohan Anil; Gabriel Pereyra; Alexandre Passos; Róbert Ormándi; George E. Dahl; Geoffrey E. Hinton (ICLR (Poster), 2018)

OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization. - Srinivasan Iyer 001; Xi Victoria Lin; Ramakanth Pasunuru; Todor Mihaylov; Daniel Simig; Ping Yu; Kurt Shuster 001; Tianlu Wang; Qing Liu; Punit Singh Koura; Xian Li 003; Brian O'Horo; et al. (CoRR, 2022)