Confused or not Confused?: Disentangling Brain Activity from EEG Data Using Bidirectional LSTM Recurrent Neural Networks. - Zhaoheng Ni; Ahmet Cem Yuksel; Xiuyan Ni; Michael I. Mandel; Lei Xie 006 (BCB, 2017)

A Sep2Tree Model for Recognizing Synthetic Bach Chorales. - Xiuyan Ni; Weicheng Ma; Zhaoheng Ni; Robert M. Haralick (ICMC, 2017)

Unusable Spoken Response Detection with BLSTM Neural Networks. - Zhaoheng Ni; Rutuja Ubale; Yao Qian; Michael I. Mandel; Su-Youn Yoon; Abhinav Misra; David Suendermann-Oeft (ISCSLP, 2018)

Sound Signal Processing with Seq2Tree Network. - Weicheng Ma; Kai Cao 005; Zhaoheng Ni; Peter Chin 001; Xiang Li 066 (LREC, 2018)

Onssen: an open-source speech separation and enhancement library. - Zhaoheng Ni; Michael I. Mandel (CoRR, 2019)

Mask-Dependent Phase Estimation for Monaural Speaker Separation. - Zhaoheng Ni; Michael I. Mandel (ICASSP, 2020)

Enhancement of Spatial Clustering-Based Time-Frequency Masks using LSTM Neural Networks. - Félix Grèzes; Zhaoheng Ni; Viet Anh Trinh; Michael I. Mandel (CoRR, 2020)

Improved MVDR Beamforming Using LSTM Speech Models to Clean Spatial Clustering Masks. - Zhaoheng Ni; Félix Grèzes; Viet Anh Trinh; Michael I. Mandel (CoRR, 2020)

Combining Spatial Clustering with LSTM Speech Models for Multichannel Speech Enhancement. - Félix Grèzes; Zhaoheng Ni; Viet Anh Trinh; Michael I. Mandel (CoRR, 2020)

WPD++: An Improved Neural Beamformer for Simultaneous Speech Separation and Dereverberation. - Zhaoheng Ni; Yong Xu 004; Meng Yu 003; Bo Wu 011; Shi-Xiong Zhang 001; Dong Yu 001; Michael I. Mandel (SLT, 2021)

TorchAudio: Building Blocks for Audio and Speech Processing. - Yao-Yuan Yang; Moto Hira; Zhaoheng Ni; Anjali Chourdia; Artyom Astafurov; Caroline Chen; Ching-Feng Yeh; Christian Puhrsch; David Pollack; Dmitriy Genzel; Donny Greenberg; Edward Z. Yang; et al. (CoRR, 2021)

Towards Low-Distortion Multi-Channel Speech Enhancement: The ESPNET-Se Submission to the L3DAS22 Challenge. - Yen-Ju Lu; Samuele Cornell; Xuankai Chang; Wangyou Zhang; Chenda Li; Zhaoheng Ni; Zhong-Qiu Wang 001; Shinji Watanabe 001 (ICASSP, 2022)

Torchaudio: Building Blocks for Audio and Speech Processing. - Yao-Yuan Yang; Moto Hira; Zhaoheng Ni; Artyom Astafurov; Caroline Chen; Christian Puhrsch; David Pollack; Dmitriy Genzel; Donny Greenberg; Edward Z. Yang; Jason Lian; Jeff Hwang; et al. (ICASSP, 2022)

Time-Frequency Attention for Monaural Speech Enhancement. - Qiquan Zhang; Qi Song; Zhaoheng Ni; Aaron Nicolson; Haizhou Li 001 (ICASSP, 2022)

ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding. - Yen-Ju Lu; Xuankai Chang; Chenda Li; Wangyou Zhang; Samuele Cornell; Zhaoheng Ni; Yoshiki Masuyama; Brian Yan; Robin Scheibler; Zhong-Qiu Wang 001; Yu Tsao 001; Yanmin Qian; et al. (INTERSPEECH, 2022)

ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. - Brian Yan; Jiatong Shi; Yun Tang 002; Hirofumi Inaguma; Yifan Peng 003; Siddharth Dalmia; Peter Polak; Patrick Fernandes; Dan Berrebbi; Tomoki Hayashi; Xiaohui Zhang 007; Zhaoheng Ni; et al. (ACL (demo), 2023)

TorchAudio 2.1: Advancing Speech Recognition, Self-Supervised Learning, and Audio Processing Components for Pytorch. - Jeff Hwang; Moto Hira; Caroline Chen; Xiaohui Zhang 007; Zhaoheng Ni; Guangzhi Sun; Pingchuan Ma 001; Ruizhe Huang; Vineel Pratap; Yuekai Zhang; Anurag Kumar 003; Chin-Yun Yu; et al. (ASRU, 2023)

Torchaudio-Squim: Reference-Less Speech Quality and Intelligibility Measures in Torchaudio. - Anurag Kumar 003; Ke Tan 001; Zhaoheng Ni; Pranay Manocha; Xiaohui Zhang 007; Ethan Henderson; Buye Xu (ICASSP, 2023)

Ripple Sparse Self-Attention for Monaural Speech Enhancement. - Qiquan Zhang; Hongxu Zhu; Qi Song; Xinyuan Qian 001; Zhaoheng Ni; Haizhou Li 001 (ICASSP, 2023)

Reducing Barriers to Self-Supervised Learning: HuBERT Pre-training with Academic Compute. - William Chen; Xuankai Chang; Yifan Peng 003; Zhaoheng Ni; Soumi Maiti; Shinji Watanabe 001 (INTERSPEECH, 2023)

Enhance audio generation controllability through representation similarity regularization. - Yangyang Shi; Gaël Le Lan; Varun Nagaraja; Zhaoheng Ni; Xinhao Mei; Ernie Chang; Forrest N. Iandola; Yang Liu; Vikas Chandra (CoRR, 2023)

TorchAudio 2.1: Advancing speech recognition, self-supervised learning, and audio processing components for PyTorch. - Jeff Hwang; Moto Hira; Caroline Chen; Xiaohui Zhang 007; Zhaoheng Ni; Guangzhi Sun; Pingchuan Ma 001; Ruizhe Huang; Vineel Pratap; Yuekai Zhang; Anurag Kumar 003; Chin-Yun Yu; et al. (CoRR, 2023)

A Time-Frequency Attention Module for Neural Speech Enhancement. - Qiquan Zhang; Xinyuan Qian 001; Zhaoheng Ni; Aaron Nicolson; Eliathamby Ambikairajah; Haizhou Li 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2023)

Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing (espnet-v.202310). - Yen-Ju Lu; Xuankai Chang; Chenda Li; Wangyou Zhang; Samuele Cornell; Zhaoheng Ni; Yoshiki Masuyama; Brian Yan; Robin Scheibler; Zhong-Qiu Wang 001; Yu Tsao 001; Yanmin Qian; et al. (Zenodo, 2023)

Software Design and User Interface of ESPnet-SE++: Speech Enhancement for Robust Speech Processing. - Yen-Ju Lu; Xuankai Chang; Chenda Li; Wangyou Zhang; Samuele Cornell; Zhaoheng Ni; Yoshiki Masuyama; Brian Yan; Robin Scheibler; Zhong-Qiu Wang 001; Yu Tsao 001; Yanmin Qian; et al. (J. Open Source Softw., 2023)

On the Open Prompt Challenge in Conditional Audio Generation. - Ernie Chang; Sidd Srinivasan; Mahi Luthra; Pin-Jie Lin; Varun Nagaraja; Forrest N. Iandola; Zechun Liu; Zhaoheng Ni; Changsheng Zhao 002; Yangyang Shi; Vikas Chandra (ICASSP, 2024)

Less Peaky and More Accurate CTC Forced Alignment by Label Priors. - Ruizhe Huang; Xiaohui Zhang 007; Zhaoheng Ni; Li Sun 010; Moto Hira; Jeff Hwang; Vimal Manohar; Vineel Pratap; Matthew Wiesner; Shinji Watanabe 001; Daniel Povey; Sanjeev Khudanpur (ICASSP, 2024)

Stack-and-Delay: A New Codebook Pattern for Music Generation. - Gaël Le Lan; Varun Nagaraja; Ernie Chang; David Kant; Zhaoheng Ni; Yangyang Shi; Forrest N. Iandola; Vikas Chandra (ICASSP, 2024)

Folding Attention: Memory and Power Optimization for On-Device Transformer-Based Streaming Speech Recognition. - Yang Li 183; Liangzhen Lai; Yuan Shangguan; Forrest N. Iandola; Zhaoheng Ni; Ernie Chang; Yangyang Shi; Vikas Chandra (ICASSP, 2024)

An Empirical Study on the Impact of Positional Encoding in Transformer-Based Monaural Speech Enhancement. - Qiquan Zhang; Meng Ge; Hongxu Zhu; Eliathamby Ambikairajah; Qi Song; Zhaoheng Ni; Haizhou Li 001 (ICASSP, 2024)

URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement. - Wangyou Zhang; Robin Scheibler; Kohei Saijo; Samuele Cornell; Chenda Li; Zhaoheng Ni; Jan Pirklbauer; Marvin Sach; Shinji Watanabe 001; Tim Fingscheidt; Yanmin Qian (INTERSPEECH, 2024)

Foleygen: Visually-Guided Audio Generation. - Xinhao Mei; Varun Nagaraja; Gaël Le Lan; Zhaoheng Ni; Ernie Chang; Yangyang Shi; Vikas Chandra (MLSP, 2024)

Massively Multilingual Forced Aligner Leveraging Self-Supervised Discrete Units. - Hirofumi Inaguma; Ilia Kulikov; Zhaoheng Ni; Sravya Popuri; Paden Tomasello (SLT, 2024)

Serialized Speech Information Guidance with Overlapped Encoding Separation for Multi-Speaker Automatic Speech Recognition. - Hao Shi; Yuan Gao 040; Zhaoheng Ni; Tatsuya Kawahara (SLT, 2024)

Data Efficient Reflow for Few Step Audio Generation. - Lemeng Wu; Zhaoheng Ni; Bowen Shi; Gaël Le Lan; Anurag Kumar 003; Varun Nagaraja; Xinhao Mei; Yunyang Xiong; Bilge Soran; Raghuraman Krishnamoorthi; Wei-Ning Hsu; Yangyang Shi; et al. (SLT, 2024)

URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement. - Wangyou Zhang; Robin Scheibler; Kohei Saijo; Samuele Cornell; Chenda Li; Zhaoheng Ni; Anurag Kumar 003; Jan Pirklbauer; Marvin Sach; Shinji Watanabe 001; Tim Fingscheidt; Yanmin Qian (CoRR, 2024)

High Fidelity Text-Guided Music Generation and Editing via Single-Stage Flow Matching. - Gaël Le Lan; Bowen Shi; Zhaoheng Ni; Sidd Srinivasan; Anurag Kumar 003; Brian Ellis; David Kant; Varun Nagaraja; Ernie Chang; Wei-Ning Hsu; Yangyang Shi; Vikas Chandra (CoRR, 2024)

SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text. - Haohe Liu; Gaël Le Lan; Xinhao Mei; Zhaoheng Ni; Anurag Kumar 003; Varun Nagaraja; Wenwu Wang 001; Mark D. Plumbley; Yangyang Shi; Vikas Chandra (CoRR, 2024)

Scaling Speech Technology to 1, 000+ Languages. - Vineel Pratap; Andros Tjandra; Bowen Shi; Paden Tomasello; Arun Babu; Sayani Kundu; Ali Elkahky; Zhaoheng Ni; Apoorv Vyas; Maryam Fazel-Zarandi; Alexei Baevski; Yossi Adi; et al. (J. Mach. Learn. Res., 2024)

Adapting Whisper for Code-Switching through Encoding Refining and Language-Aware Decoding. - Jiahui Zhao; Hao Shi; Chenrui Cui; Tianrui Wang; Hexin Liu; Zhaoheng Ni; Lingxuan Ye; Longbiao Wang (ICASSP, 2025)

Lessons Learned from the URGENT 2024 Speech Enhancement Challenge. - Wangyou Zhang; Kohei Saijo; Samuele Cornell; Robin Scheibler; Chenda Li; Zhaoheng Ni; Anurag Kumar 003; Marvin Sach; Wei Wang 010; Yihui Fu; Shinji Watanabe 001; Tim Fingscheidt; et al. (CoRR, 2025)

Less is More: Data Curation Matters in Scaling Speech Enhancement. - Chenda Li; Wangyou Zhang; Wei Wang 010; Robin Scheibler; Kohei Saijo; Samuele Cornell; Yihui Fu; Marvin Sach; Zhaoheng Ni; Anurag Kumar 003; Tim Fingscheidt; Shinji Watanabe 001; et al. (CoRR, 2025)

URGENT-PK: Perceptually-Aligned Ranking Model Designed for Speech Enhancement Competition. - Jiahe Wang; Chenda Li; Wei Wang 010; Wangyou Zhang; Samuele Cornell; Marvin Sach; Robin Scheibler; Kohei Saijo; Yihui Fu; Zhaoheng Ni; Anurag Kumar 003; Tim Fingscheidt; et al. (CoRR, 2025)