Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer. - Colin Raffel; Noam Shazeer; Adam Roberts; Katherine Lee; Sharan Narang; Michael Matena; Yanqi Zhou; Wei Li 133; Peter J. Liu (J. Mach. Learn. Res., 2020)

Do Transformer Modifications Transfer Across Implementations and Applications? - Sharan Narang; Hyung Won Chung; Yi Tay; Liam Fedus; Thibault Févry; Michael Matena; Karishma Malkan; Noah Fiedel; Noam Shazeer; Zhenzhong Lan; Yanqi Zhou; Wei Li 133; et al. (EMNLP (1), 2021)

Merging Models with Fisher-Weighted Averaging. - Michael Matena; Colin Raffel (NeurIPS, 2022)

A Combinatorial Perspective on the Optimization of Shallow ReLU Networks. - Michael Matena; Colin Raffel (NeurIPS, 2022)

NPEFF: Non-Negative Per-Example Fisher Factorization. - Michael Matena; Colin Raffel (CoRR, 2023)