Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (KDD, 2022)

Attention Fusion: a light yet efficient late fusion mechanism for task adaptation in NLU. - Jin Cao 003; Chandana Satya Prakash; Wael Hamza (NAACL-HLT (Findings), 2022)

Instilling Type Knowledge in Language Models via Multi-Task QA. - Shuyang Li; Mukund Sridhar; Chandana Satya Prakash; Jin Cao 003; Wael Hamza; Julian J. McAuley (NAACL-HLT (Findings), 2022)

Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (CoRR, 2022)

AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq Model. - Saleh Soltan; Shankar Ananthakrishnan; Jack FitzGerald; Rahul Gupta 001; Wael Hamza; Haidar Khan; Charith Peris; Stephen Rawls; Andy Rosenbaum; Anna Rumshisky; Chandana Satya Prakash; Mukund Sridhar; et al. (CoRR, 2022)

Sharing Encoder Representations across Languages, Domains and Tasks in Large-Scale Spoken Language Understanding. - Jonathan J. Hüser; Judith Gaspers; Thomas Gueudré; Chandana Satya Prakash; Jin Cao; Daniil Sorokin; Quynh Do; Nicolas Anastassacos; Tobias Falke; Turan Gojayev (ACL (industry), 2023)

MATTER: Memory-Augmented Transformer Using Heterogeneous Knowledge Sources. - Dongkyu Lee; Chandana Satya Prakash; Jack FitzGerald; Jens Lehmann 001 (ACL (Findings), 2024)