Fast-MD: Fast Multi-Decoder End-to-End Speech Translation with Non-Autoregressive Hidden Intermediates. - Hirofumi Inaguma; Siddharth Dalmia; Brian Yan; Shinji Watanabe 001 (ASRU, 2021)

Differentiable Allophone Graphs for Language-Universal Speech Recognition. - Brian Yan; Siddharth Dalmia; David R. Mortensen; Florian Metze; Shinji Watanabe 001 (Interspeech, 2021)

ESPnet-ST IWSLT 2021 Offline Speech Translation System. - Hirofumi Inaguma; Brian Yan; Siddharth Dalmia; Pengcheng Guo; Jiatong Shi; Kevin Duh; Shinji Watanabe 001 (IWSLT, 2021)

Searchable Hidden Intermediates for End-to-End Models of Decomposable Sequence Tasks. - Siddharth Dalmia; Brian Yan; Vikas Raunak; Florian Metze; Shinji Watanabe 001 (NAACL-HLT, 2021)

Token-level Sequence Labeling for Spoken Language Understanding using Compositional End-to-End Models. - Siddhant Arora; Siddharth Dalmia; Brian Yan; Florian Metze; Alan W. Black; Shinji Watanabe 001 (EMNLP (Findings), 2022)

BERT Meets CTC: New Formulation of End-to-End Speech Recognition with Pre-trained Masked Language Model. - Yosuke Higuchi; Brian Yan; Siddhant Arora; Tetsuji Ogawa; Tetsunori Kobayashi; Shinji Watanabe 001 (EMNLP (Findings), 2022)

ESPnet-SLU: Advancing Spoken Language Understanding Through ESPnet. - Siddhant Arora; Siddharth Dalmia; Pavel Denisov; Xuankai Chang; Yushi Ueda; Yifan Peng 003; Yuekai Zhang; Sujay Kumar; Karthik Ganesan 003; Brian Yan; Ngoc Thang Vu; Alan W. Black; et al. (ICASSP, 2022)

Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization. - Brian Yan; Chunlei Zhang; Meng Yu 003; Shi-Xiong Zhang 001; Siddharth Dalmia; Dan Berrebbi; Chao Weng; Shinji Watanabe 001; Dong Yu 001 (ICASSP, 2022)

Two-Pass Low Latency End-to-End Spoken Language Understanding. - Siddhant Arora; Siddharth Dalmia; Xuankai Chang; Brian Yan; Alan W. Black; Shinji Watanabe 001 (INTERSPEECH, 2022)

Combining Spectral and Self-Supervised Features for Low Resource Speech Recognition and Translation. - Dan Berrebbi; Jiatong Shi; Brian Yan; Osbel López-Francisco; Jonathan D. Amith; Shinji Watanabe 001 (INTERSPEECH, 2022)

ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding. - Yen-Ju Lu; Xuankai Chang; Chenda Li; Wangyou Zhang; Samuele Cornell; Zhaoheng Ni; Yoshiki Masuyama; Brian Yan; Robin Scheibler; Zhong-Qiu Wang 001; Yu Tsao 001; Yanmin Qian; et al. (INTERSPEECH, 2022)

CMU's IWSLT 2022 Dialect Speech Translation System. - Brian Yan; Patrick Fernandes; Siddharth Dalmia; Jiatong Shi; Yifan Peng 003; Dan Berrebbi; Xinyi Wang 001; Graham Neubig; Shinji Watanabe 001 (IWSLT@ACL, 2022)

ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. - Brian Yan; Jiatong Shi; Yun Tang 002; Hirofumi Inaguma; Yifan Peng 003; Siddharth Dalmia; Peter Polak; Patrick Fernandes; Dan Berrebbi; Tomoki Hayashi; Xiaohui Zhang 007; Zhaoheng Ni; et al. (ACL (demo), 2023)

Joint Prediction and Denoising for Large-Scale Multilingual Self-Supervised Learning. - William Chen; Jiatong Shi; Brian Yan; Dan Berrebbi; Wangyou Zhang; Yifan Peng 003; Xuankai Chang; Soumi Maiti; Shinji Watanabe 001 (ASRU, 2023)

Reproducing Whisper-Style Training Using An Open-Source Toolkit And Publicly Available Data. - Yifan Peng 003; Jinchuan Tian; Brian Yan; Dan Berrebbi; Xuankai Chang; Xinjian Li; Jiatong Shi; Siddhant Arora; William Chen; Roshan S. Sharma; Wangyou Zhang; Yui Sudo; et al. (ASRU, 2023)

CTC Alignments Improve Autoregressive Translation. - Brian Yan; Siddharth Dalmia; Yosuke Higuchi; Graham Neubig; Florian Metze; Alan W. Black; Shinji Watanabe 001 (EACL, 2023)

Joint Modelling of Spoken Language Understanding Tasks with Integrated Dialog History. - Siddhant Arora; Hayato Futami; Emiru Tsunoo; Brian Yan; Shinji Watanabe 001 (ICASSP, 2023)

A Study on the Integration of Pipeline and E2E SLU Systems for Spoken Semantic Parsing Toward Stop Quality Challenge. - Siddhant Arora; Hayato Futami; Shih-Lun Wu; Jessica Huynh; Yifan Peng 003; Yosuke Kashiwagi; Emiru Tsunoo; Brian Yan; Shinji Watanabe 001 (ICASSP, 2023)

Avoid Overthinking in Self-Supervised Models for Speech Recognition. - Dan Berrebbi; Brian Yan; Shinji Watanabe 001 (ICASSP, 2023)

Improving Massively Multilingual ASR with Auxiliary CTC Objectives. - William Chen; Brian Yan; Jiatong Shi; Yifan Peng 003; Soumi Maiti; Shinji Watanabe 001 (ICASSP, 2023)

The Pipeline System of ASR and NLU with MLM-based data Augmentation Toward Stop Low-Resource Challenge. - Hayato Futami; Jessica Huynh; Siddhant Arora; Shih-Lun Wu; Yosuke Kashiwagi; Yifan Peng 003; Brian Yan; Emiru Tsunoo; Shinji Watanabe 001 (ICASSP, 2023)

E-Branchformer-Based E2E SLU Toward Stop on-Device Challenge. - Yosuke Kashiwagi; Siddhant Arora; Hayato Futami; Jessica Huynh; Shih-Lun Wu; Yifan Peng 003; Brian Yan; Emiru Tsunoo; Shinji Watanabe 001 (ICASSP, 2023)

Align, Write, Re-Order: Explainable End-to-End Speech Translation via Operation Sequence Generation. - Motoi Omachi; Brian Yan; Siddharth Dalmia; Yuya Fujita; Shinji Watanabe 001 (ICASSP, 2023)

Towards Zero-Shot Code-Switched Speech Recognition. - Brian Yan; Matthew Wiesner; Ondrej Klejch; Preethi Jyothi; Shinji Watanabe 001 (ICASSP, 2023)

Bayes Risk CTC: Controllable CTC Alignment in Sequence-to-Sequence Tasks. - Jinchuan Tian; Brian Yan; Jianwei Yu 001; Chao Weng; Dong Yu 001; Shinji Watanabe 001 (ICLR, 2023)

Integrating Pretrained ASR and LM to Perform Sequence Generation for Spoken Language Understanding. - Siddhant Arora; Hayato Futami; Yosuke Kashiwagi; Emiru Tsunoo; Brian Yan; Shinji Watanabe 001 (INTERSPEECH, 2023)

Exploration of Efficient End-to-End ASR using Discretized Input from Self-Supervised Learning. - Xuankai Chang; Brian Yan; Yuya Fujita; Takashi Maekaku; Shinji Watanabe 001 (INTERSPEECH, 2023)

Tensor decomposition for minimization of E2E SLU model toward on-device processing. - Yosuke Kashiwagi; Siddhant Arora; Hayato Futami; Jessica Huynh; Shih-Lun Wu; Yifan Peng 003; Brian Yan; Emiru Tsunoo; Shinji Watanabe 001 (INTERSPEECH, 2023)

A Comparative Study on E-Branchformer vs Conformer in Speech Recognition, Translation, and Understanding Tasks. - Yifan Peng 003; Kwangyoun Kim; Felix Wu; Brian Yan; Siddhant Arora; William Chen; Jiyang Tang; Suwon Shon; Prashant Sridhar; Shinji Watanabe 001 (INTERSPEECH, 2023)

Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization. - Puyuan Peng; Brian Yan; Shinji Watanabe 001; David Harwath (INTERSPEECH, 2023)

Incremental Blockwise Beam Search for Simultaneous Speech Translation with Controllable Quality-Latency Tradeoff. - Peter Polák; Brian Yan; Shinji Watanabe 001; Alex Waibel; Ondrej Bojar (INTERSPEECH, 2023)

4D ASR: Joint modeling of CTC, Attention, Transducer, and Mask-Predict decoders. - Yui Sudo; Muhammad Shakeel 001; Brian Yan; Jiatong Shi; Shinji Watanabe 001 (INTERSPEECH, 2023)

Bayes Risk Transducer: Transducer with Controllable Alignment Prediction. - Jinchuan Tian; Jianwei Yu 001; Hangting Chen; Brian Yan; Chao Weng; Dong Yu 001; Shinji Watanabe 001 (INTERSPEECH, 2023)

CMU's IWSLT 2023 Simultaneous Speech Translation System. - Brian Yan; Jiatong Shi; Soumi Maiti; William Chen; Xinjian Li; Yifan Peng 003; Siddhant Arora; Shinji Watanabe 001 (IWSLT@ACL, 2023)

Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing (espnet-v.202310). - Yen-Ju Lu; Xuankai Chang; Chenda Li; Wangyou Zhang; Samuele Cornell; Zhaoheng Ni; Yoshiki Masuyama; Brian Yan; Robin Scheibler; Zhong-Qiu Wang 001; Yu Tsao 001; Yanmin Qian; et al. (Zenodo, 2023)

Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing. - Yen-Ju Lu; Xuankai Chang; Chenda Li; Wangyou Zhang; Samuele Cornell; Zhaoheng Ni; Yoshiki Masuyama; Brian Yan; Robin Scheibler; Zhong-Qiu Wang 001; Yu Tsao 001; Yanmin Qian; et al. (J. Open Source Softw., 2023)

Exploring Speech Recognition, Translation, and Understanding with Discrete Speech Units: A Comparative Study. - Xuankai Chang; Brian Yan; Kwanghee Choi; Jee-Weon Jung; Yichen Lu; Soumi Maiti; Roshan S. Sharma; Jiatong Shi; Jinchuan Tian; Shinji Watanabe 001; Yuya Fujita; Takashi Maekaku; et al. (ICASSP, 2024)

Enhancing End-to-End Conversational Speech Translation Through Target Language Context Utilization. - Amir Hussein; Brian Yan; Antonios Anastasopoulos; Shinji Watanabe 001; Sanjeev Khudanpur (ICASSP, 2024)

Speech Collage: Code-Switched Audio Generation by Collaging Monolingual Corpora. - Amir Hussein; Dorsa Zeinali; Ondrej Klejch; Matthew Wiesner; Brian Yan; Shammur Absar Chowdhury; Ahmed Ali 002; Shinji Watanabe 001; Sanjeev Khudanpur (ICASSP, 2024)

Cross-Modal Multi-Tasking for Speech-to-Text Translation via Hard Parameter Sharing. - Brian Yan; Xuankai Chang; Antonios Anastasopoulos; Yuya Fujita; Shinji Watanabe 001 (ICASSP, 2024)

OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer. - Yifan Peng 003; Jinchuan Tian; William Chen; Siddhant Arora; Brian Yan; Yui Sudo; Muhammad Shakeel 001; Kwanghee Choi; Jiatong Shi; Xuankai Chang; Jee-weon Jung; Shinji Watanabe 001 (INTERSPEECH, 2024)

Floras 50: A Massively Multilingual Multitask Benchmark for Long-Form Conversational Speech. - William Chen; Brian Yan; Chih-Chen Chen; Shinji Watanabe 001 (SLT, 2024)

4D ASR: Joint Beam Search Integrating CTC, Attention, Transducer, and Mask Predict Decoders. - Yui Sudo; Muhammad Shakeel 001; Yosuke Fukumoto; Brian Yan; Jiatong Shi; Yifan Peng 003; Shinji Watanabe 001 (CoRR, 2024)

CMU's IWSLT 2024 Simultaneous Speech Translation System. - Xi Xu; Siqi Ouyang; Brian Yan; Patrick Fernandes; William Chen; Lei Li 005; Graham Neubig; Shinji Watanabe 001 (CoRR, 2024)

Improving Multilingual ASR in the Wild Using Simple N-best Re-ranking. - Brian Yan; Vineel Pratap; Shinji Watanabe 001; Michael Auli (ICASSP, 2025)

OWLS: Scaling Laws for Multilingual Speech Recognition and Translation Models. - William Chen; Jinchuan Tian; Yifan Peng 003; Brian Yan; Chao-Han Huck Yang; Shinji Watanabe 001 (CoRR, 2025)