Further Boosting BERT-based Models by Duplicating Existing Layers: Some Intriguing Phenomena inside BERT. - Wei-Tsung Kao; Tsung-Han Wu; Po-Han Chi; Chun-Cheng Hsieh; Hung-yi Lee (CoRR, 2020)

Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation. - Po-Han Chi; Pei-Hung Chung; Tsung-Han Wu; Chun-Cheng Hsieh; Shang-wen Li 001; Hung-yi Lee (CoRR, 2020)

Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer. - Tsung-Han Wu; Chun-Cheng Hsieh; Yen-Hao Chen; Po-Han Chi; Hung-yi Lee (CoRR, 2020)

Audio Albert: A Lite Bert for Self-Supervised Learning of Audio Representation. - Po-Han Chi; Pei-Hung Chung; Tsung-Han Wu; Chun-Cheng Hsieh; Yen-Hao Chen; Shang-Wen Li 001; Hung-yi Lee (SLT, 2021)