Mockingjay: Unsupervised Speech Representation Learning with Deep Bidirectional Transformer Encoders. - Andy T. Liu; Shu-Wen Yang; Po-Han Chi; Po-Chun Hsu; Hung-yi Lee (ICASSP, 2020)

Further Boosting BERT-based Models by Duplicating Existing Layers: Some Intriguing Phenomena inside BERT. - Wei-Tsung Kao; Tsung-Han Wu; Po-Han Chi; Chun-Cheng Hsieh; Hung-yi Lee (CoRR, 2020)

Audio ALBERT: A Lite BERT for Self-supervised Learning of Audio Representation. - Po-Han Chi; Pei-Hung Chung; Tsung-Han Wu; Chun-Cheng Hsieh; Shang-wen Li 001; Hung-yi Lee (CoRR, 2020)

Hand-crafted Attention is All You Need? A Study of Attention on Self-supervised Audio Transformer. - Tsung-Han Wu; Chun-Cheng Hsieh; Yen-Hao Chen; Po-Han Chi; Hung-yi Lee (CoRR, 2020)

SUPERB: Speech Processing Universal PERformance Benchmark. - Shu-Wen Yang; Po-Han Chi; Yung-Sung Chuang; Cheng-I Jeff Lai; Kushal Lakhotia; Yist Y. Lin; Andy T. Liu; Jiatong Shi; Xuankai Chang; Guan-Ting Lin; Tzu-Hsien Huang; Wei-Cheng Tseng; et al. (Interspeech, 2021)

Audio Albert: A Lite Bert for Self-Supervised Learning of Audio Representation. - Po-Han Chi; Pei-Hung Chung; Tsung-Han Wu; Chun-Cheng Hsieh; Yen-Hao Chen; Shang-Wen Li 001; Hung-yi Lee (SLT, 2021)

SpeechNet: A Universal Modularized Model for Speech Processing Tasks. - Yi-Chen Chen; Po-Han Chi; Shu-Wen Yang; Kai-Wei Chang; Jheng-Hao Lin; Sung-Feng Huang; Da-Rong Liu; Chi-Liang Liu; Cheng-Kuang Lee; Hung-yi Lee (CoRR, 2021)

Leveraging Sequence Embedding and Convolutional Neural Network for Protein Function Prediction. - Wei-Cheng Tseng; Po-Han Chi; Jia-Hua Wu; Min Sun 001 (CoRR, 2021)

Few-shot Prompting Towards Controllable Response Generation. - Hsuan Su; Po-Han Chi; Shih-Cheng Huang; Ho-Lam Chung; Saurav Sahay; Shang-Tse Chen; Hung-Yi Lee (CoRR, 2022)

A Large-Scale Evaluation of Speech Foundation Models. - Shu-Wen Yang; Heng-Jui Chang; Zili Huang; Andy T. Liu; Cheng-I Lai; Haibin Wu; Jiatong Shi; Xuankai Chang; Hsiang-Sheng Tsai; Wen-Chin Huang; Tzu-hsun Feng; Po-Han Chi; et al. (IEEE ACM Trans. Audio Speech Lang. Process., 2024)