Knowledge Distillation from Bert in Pre-Training and Fine-Tuning for Polyphone Disambiguation. - Hao Sun; Xu Tan 003; Jun-Wei Gan; Sheng Zhao; Dongxu Han; Hongzhi Liu 001; Tao Qin 001; Tie-Yan Liu (ASRU, 2019)

Token-Level Ensemble Distillation for Grapheme-to-Phoneme Conversion. - Hao Sun; Xu Tan 003; Jun-Wei Gan; Hongzhi Liu 001; Sheng Zhao; Tao Qin 001; Tie-Yan Liu (INTERSPEECH, 2019)