Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (KDD, 2022)

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (CoRR, 2022)

AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model. - Saleh Soltan; Shankar Ananthakrishnan; Jack FitzGerald; Rahul Gupta 001; Wael Hamza; Haidar Khan; Charith Peris; Stephen Rawls; Andy Rosenbaum; Anna Rumshisky; Chandana Satya Prakash; Mukund Sridhar; et al. (CoRR, 2022)

The Massively Multilingual Natural Language Understanding 2022 (MMNLU-22) Workshop and Competition. - Christopher Hench; Charith Peris; Jack FitzGerald; Kay Rottmann (CoRR, 2022)

MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages. - Jack FitzGerald; Christopher Hench; Charith Peris; Scott Mackie; Kay Rottmann; Ana Sanchez; Aaron Nash; Liam Urbach; Vishesh Kakarala; Richa Singh; Swetha Ranganath; Laurie Crist; et al. (ACL (1), 2023)

Controlling the Extraction of Memorized Data from Large Language Models via Prompt-Tuning. - Mustafa Özdayi; Charith Peris; Jack FitzGerald; Christophe Dupuy; Jimit Majmudar; Haidar Khan; Rahil Parikh; Rahul Gupta 001 (ACL (2), 2023)

MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources. - Dongkyu Lee; Chandana Satya Prakash; Jack FitzGerald; Jens Lehmann 001 (ACL (Findings), 2024)

QuAILoRA: Quantization-Aware Initialization for LoRA. - Neal Lawton; Aishwarya Padmakumar; Judith Gaspers; Jack FitzGerald; Anoop Kumar; Greg Ver Steeg; Aram Galstyan (ENLSP, 2024)

Wanda++: Pruning Large Language Models via Regional Gradients. - Yifan Yang; Kai Zhen; Bhavana Ganesh; Aram Galstyan; Goeric Huybrechts; Markus Müller; Jonas M. Kübler; Rupak Vignesh Swaminathan; Athanasios Mouchtaris; Sravan Babu Bodapati; Nathan Susanj; Zheng Zhang; et al. (ACL (Findings), 2025)

Document Haystack: A Long Context Multimodal Image/Document Understanding Vision LLM Benchmark. - Goeric Huybrechts; Srikanth Ronanki; Sai Muralidhar Jayanthi; Jack FitzGerald; Srinivasan Veeravanallur (CoRR, 2025)