Improving Attention-based End-to-end ASR by Incorporating an N-gram Neural Network. - Junyi Ao; Tom Ko (ISCSLP, 2021)

SpeechT5: Unified-Modal Encoder-Decoder Pre-training for Spoken Language Processing. - Junyi Ao; Rui Wang 073; Long Zhou; Shujie Liu 001; Shuo Ren; Yu Wu 012; Tom Ko; Qing Li 001; Yu Zhang 006; Zhihua Wei 001; Yao Qian; Jinyu Li 001; et al. (CoRR, 2021)

SpeechT5: Unified-Modal Encoder-Decoder Pre-Training for Spoken Language Processing. - Junyi Ao; Rui Wang 073; Long Zhou; Chengyi Wang 002; Shuo Ren; Yu Wu 012; Shujie Liu 001; Tom Ko; Qing Li 001; Yu Zhang 006; Zhihua Wei 001; Yao Qian; et al. (ACL (1), 2022)

SpeechUT: Bridging Speech and Text with Hidden-Unit for Encoder-Decoder Based Speech-Text Pre-training. - Ziqiang Zhang; Long Zhou; Junyi Ao; Shujie Liu 001; Lirong Dai 001; Jinyu Li 001; Furu Wei (EMNLP, 2022)

Multi-View Self-Attention Based Transformer for Speaker Recognition. - Rui Wang 073; Junyi Ao; Long Zhou; Shujie Liu 001; Zhihua Wei 001; Tom Ko; Qing Li 001; Yu Zhang 006 (ICASSP, 2022)

Pre-Training Transformer Decoder for End-to-End ASR Model with Unpaired Speech Data. - Junyi Ao; Ziqiang Zhang; Long Zhou; Shujie Liu 001; Haizhou Li 001; Tom Ko; Lirong Dai 001; Jinyu Li 001; Yao Qian; Furu Wei (INTERSPEECH, 2022)

LightHuBERT: Lightweight and Configurable Speech Representation Learning with Once-for-All Hidden-Unit BERT. - Rui Wang 073; Qibing Bai; Junyi Ao; Long Zhou; Zhixiang Xiong; Zhihua Wei 001; Yu Zhang 006; Tom Ko; Haizhou Li 001 (INTERSPEECH, 2022)

The YiTrans Speech Translation System for IWSLT 2022 Offline Shared Task. - Ziqiang Zhang; Junyi Ao (IWSLT@ACL, 2022)

The YiTrans End-to-End Speech Translation System for IWSLT 2022 Offline Shared Task. - Ziqiang Zhang; Junyi Ao; Long Zhou; Shujie Liu 001; Furu Wei; Jinyu Li 001 (CoRR, 2022)

Token2vec: A Joint Self-Supervised Pre-Training Framework Using Unpaired Speech and Text. - Xianghu Yue; Junyi Ao; Xiaoxue Gao; Haizhou Li 001 (ICASSP, 2023)

Self-Supervised Acoustic Word Embedding Learning via Correspondence Transformer Encoder. - Jingru Lin; Xianghu Yue; Junyi Ao; Haizhou Li 001 (INTERSPEECH, 2023)

CoBERT: Self-Supervised Speech Representation Learning Through Code Representation Learning. - Chutong Meng; Junyi Ao; Tom Ko; Mingxuan Wang; Haizhou Li 001 (INTERSPEECH, 2023)

USED: Universal Speaker Extraction and Diarization. - Junyi Ao; Mehmet Sinan Yildirim; Meng Ge; Shuai Wang 016; Ruijie Tao; Yanmin Qian; Liqun Deng; Longshuai Xiao; Haizhou Li 001 (CoRR, 2023)

The NUS-HLT System for ICASSP2024 ICMC-ASR Grand Challenge. - Meng Ge; Yizhou Peng; Yidi Jiang; Jingru Lin; Junyi Ao; Mehmet Sinan Yildirim; Shuai Wang 016; Haizhou Li 001; Mengling Feng (CoRR, 2023)

SA-WavLM: Speaker-Aware Self-Supervised Pre-training for Mixture Speech. - Jingru Lin; Meng Ge; Junyi Ao; Liqun Deng; Haizhou Li 001 (INTERSPEECH, 2024)

SD-Eval: A Benchmark Dataset for Spoken Dialogue Understanding Beyond Words. - Junyi Ao; Yuancheng Wang; Xiaohai Tian; Dekun Chen; Jun Zhang 066; Lu Lu 015; Yuxuan Wang 002; Haizhou Li 001; Zhizheng Wu 001 (NeurIPS, 2024)

Text-Guided HuBERT: Self-Supervised Speech Pre-Training via Generative Adversarial Networks. - Duo Ma; Xianghu Yue; Junyi Ao; Xiaoxue Gao; Haizhou Li 001 (IEEE Signal Process. Lett., 2024)

Overview of the Amphion Toolkit (v0.2). - Jiaqi Li; Xueyao Zhang; Yuancheng Wang; Haorui He; Chaoren Wang; Li Wang; Huan Liao; Junyi Ao; Zeyu Xie; Yiqiao Huang; Junan Zhang; Zhizheng Wu 001 (CoRR, 2025)

Solla: Towards a Speech-Oriented LLM That Hears Acoustic Context. - Junyi Ao; Dekun Chen; Xiaohai Tian; Wenjie Feng 007; Jun Zhang 066; Lu Lu 015; Yuxuan Wang 002; Haizhou Li 001; Zhizheng Wu 001 (CoRR, 2025)