Alexa Teacher Model: Pretraining and Distilling Multi-Billion-Parameter Encoders for Natural Language Understanding Systems. - Jack FitzGerald; Shankar Ananthakrishnan; Konstantine Arkoudas; Davide Bernardi; Abhishek Bhagia; Claudio Delli Bovi; Jin Cao 003; Rakesh Chada; Amit Chauhan; Luoxin Chen; Anurag Dwarakanath; Satyam Dwivedi; et al. (CoRR, 2022)