Zexu Pan

According to our database, Zexu Pan authored at least 47 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

MeMo: Attentional Momentum for Real-time Audio-visual Speaker Extraction under Impaired Visual Conditions.

Junjie Li, Wenxuan Wu, Shuai Wang, Zexu Pan, Kong Aik Lee, Helen Meng, Haizhou Li

CoRR, July, 2025

ClearerVoice-Studio: Bridging Advanced Speech Processing Research and Practical Deployment.

Shengkui Zhao, Zexu Pan, Bin Ma

CoRR, June, 2025

Online Audio-Visual Autoregressive Speaker Extraction.

Zexu Pan, Wupeng Wang, Shengkui Zhao, Chong Zhang, Kun Zhou, Yukun Ma, Bin Ma

CoRR, June, 2025

M3ANet: Multi-scale and Multi-Modal Alignment Network for Brain-Assisted Target Speaker Extraction.

Cunhang Fan, Ying Chen, Jian Zhou, Zexu Pan, Jingjing Zhang, Youdian Gao, Xiaoke Yang, Zhengqi Wen, Zhao Lv

CoRR, June, 2025

Plug-and-Play Co-Occurring Face Attention for Robust Audio-Visual Speaker Extraction.

Zexu Pan, Shengkui Zhao, Tingting Wang, Kun Zhou, Yukun Ma, Chong Zhang, Bin Ma

CoRR, May, 2025

Causal Self-supervised Pretrained Frontend with Predictive Code for Speech Separation.

Wupeng Wang, Zexu Pan, Xinke Li, Shuai Wang, Haizhou Li

CoRR, April, 2025

Context-Aware Two-Step Training Scheme for Domain Invariant Speech Separation.

Wupeng Wang, Zexu Pan, Jingru Lin, Shuai Wang, Haizhou Li

CoRR, March, 2025

InspireMusic: Integrating Super Resolution and Large Language Model for High-Fidelity Long-Form Music Generation.

Chong Zhang, Yukun Ma, Qian Chen, Wen Wang, Shengkui Zhao, Zexu Pan, Hao Wang, Chongjia Ni, Trung Hieu Nguyen, Kun Zhou, Yidi Jiang, Chaohong Tan, Zhifu Gao, Zhihao Du, Bin Ma

CoRR, March, 2025

Conditional Latent Diffusion-Based Speech Enhancement via Dual Context Learning.

Shengkui Zhao, Zexu Pan, Kun Zhou, Yukun Ma, Chong Zhang, Bin Ma

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

HiFi-SR: A Unified Generative Transformer-Convolutional Adversarial Network for High-Fidelity Speech Super-Resolution.

Shengkui Zhao, Kun Zhou, Zexu Pan, Yukun Ma, Chong Zhang, Bin Ma

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

SSM2Mel: State Space Model to Reconstruct Mel Spectrogram from the EEG.

Cunhang Fan, Sheng Zhang, Jingjing Zhang, Zexu Pan, Zhao Lv

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

Improved Feature Extraction Network for Neuro-Oriented Target Speaker Extraction.

Cunhang Fan, Youdian Gao, Zexu Pan, Jingjing Zhang, Hongyu Zhang, Jie Zhang, Zhao Lv

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

Speech Separation for Low-Resource Languages.

Marvin Borsdorf, Zexu Pan, Pascal Himmelmann, Haizhou Li, Tanja Schultz

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

2024

Hierarchical Edge Refinement Network for Guided Depth Map Super-Resolution.

Shuo Zhang, Zexu Pan, Yichang Lv, Youfang Lin

IEEE Trans. Computational Imaging, 2024

Speech Separation With Pretrained Frontend to Minimize Domain Mismatch.

Wupeng Wang, Zexu Pan, Xinke Li, Shuai Wang, Haizhou Li

IEEE ACM Trans. Audio Speech Lang. Process., 2024

NeuroHeed: Neuro-Steered Speaker Extraction Using EEG Signals.

Zexu Pan, Marvin Borsdorf, Siqi Cai, Tanja Schultz, Haizhou Li

IEEE ACM Trans. Audio Speech Lang. Process., 2024

pTSE-T: Presentation Target Speaker Extraction using Unaligned Text Cues.

Ziyang Jiang, Xinyuan Qian, Jiahe Lei, Zexu Pan, Wei Xue, Xu-Cheng Yin

CoRR, 2024

Emotional Dimension Control in Language Model-Based Text-to-Speech: Spanning a Broad Spectrum of Human Emotions.

Kun Zhou, You Zhang, Shengkui Zhao, Hao Wang, Zexu Pan, Dianwen Ng, Chong Zhang, Chongjia Ni, Yukun Ma, Trung Hieu Nguyen, Jia Qi Yip, Bin Ma

CoRR, 2024

TF-Locoformer: Transformer with Local Modeling by Convolution for Speech Separation and Enhancement.

Kohei Saijo, Gordon Wichern, François G. Germain, Zexu Pan, Jonathan Le Roux

Proceedings of the 18th International Workshop on Acoustic Signal Enhancement, 2024

Ensemble Deep Learning Models for EEG-Based Auditory Attention Decoding.

Peng Zhao, Ruicong Wang, Zijie Lin, Zexu Pan, Haizhou Li, Xueyi Zhang

Proceedings of the 14th IEEE International Symposium on Chinese Spoken Language Processing, 2024

Enhanced Reverberation as Supervision for Unsupervised Speech Separation.

Kohei Saijo, Gordon Wichern, François G. Germain, Zexu Pan, Jonathan Le Roux

Proceedings of the 25th Annual Conference of the International Speech Communication Association, 2024

PARIS: Pseudo-AutoRegressIve Siamese Training for Online Speech Separation.

Zexu Pan, Gordon Wichern, François G. Germain, Kohei Saijo, Jonathan Le Roux

Proceedings of the 25th Annual Conference of the International Speech Communication Association, 2024

wTIMIT2mix: A Cocktail Party Mixtures Database to Study Target Speaker Extraction for Normal and Whispered Speech.

Marvin Borsdorf, Zexu Pan, Haizhou Li, Tanja Schultz

Proceedings of the 25th Annual Conference of the International Speech Communication Association, 2024

GLMB 3D Speaker Tracking with Video-Assisted Multi-Channel Audio Optimization Functions.

Xinyuan Qian, Zexu Pan, Qiquan Zhang, Kainan Chen, Shoufeng Lin

Proceedings of the IEEE International Conference on Acoustics, 2024

Late Audio-Visual Fusion for in-the-Wild Speaker Diarization.

Zexu Pan, Gordon Wichern, François G. Germain, Aswin Shanmugam Subramanian, Jonathan Le Roux

Proceedings of the IEEE International Conference on Acoustics, 2024

NeuroHeed+: Improving Neuro-Steered Speaker Extraction with Joint Auditory Attention Detection.

Zexu Pan, Gordon Wichern, François G. Germain, Sameer Khurana, Jonathan Le Roux

Proceedings of the IEEE International Conference on Acoustics, 2024

NIIRF: Neural IIR Filter Field for HRTF Upsampling and Personalization.

Yoshiki Masuyama, Gordon Wichern, François G. Germain, Zexu Pan, Sameer Khurana, Chiori Hori, Jonathan Le Roux

Proceedings of the IEEE International Conference on Acoustics, 2024

Audio-Visual Active Speaker Extraction for Sparsely Overlapped Multi-Talker Speech.

Junjie Li, Ruijie Tao, Zexu Pan, Meng Ge, Shuai Wang, Haizhou Li

Proceedings of the IEEE International Conference on Acoustics, 2024

LOCSELECT: Target Speaker Localization with an Auditory Selective Hearing Mechanism.

Yu Chen, Xinyuan Qian, Zexu Pan, Kainan Chen, Haizhou Li

Proceedings of the IEEE International Conference on Acoustics, 2024

Generation or Replication: Auscultating Audio Latent Diffusion Models.

Dimitrios Bralios, Gordon Wichern, François G. Germain, Zexu Pan, Sameer Khurana, Chiori Hori, Jonathan Le Roux

Proceedings of the IEEE International Conference on Acoustics, 2024

Restoring Speaking Lips from Occlusion for Audio-Visual Speech Recognition.

Jiadong Wang, Zexu Pan, Malu Zhang, Robby T. Tan, Haizhou Li

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Time-Domain Speech Separation Networks With Graph Encoding Auxiliary.

Tingting Wang, Zexu Pan, Meng Ge, Zhen Yang, Haizhou Li

IEEE Signal Process. Lett., 2023

Speaker Extraction with Detection of Presence and Absence of Target Speakers.

Ke Zhang, Marvin Borsdorf, Zexu Pan, Haizhou Li, Yangjie Wei, Yi Wang

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Rethinking the Visual Cues in Audio-Visual Speaker Extraction.

Junjie Li, Meng Ge, Zexu Pan, Rui Cao, Longbiao Wang, Jianwu Dang, Shiliang Zhang

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Target Active Speaker Detection with Audio-visual Cues.

Yidi Jiang, Ruijie Tao, Zexu Pan, Haizhou Li

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

ImagineNet: Target Speaker Extraction with Intermittent Visual Cue Through Embedding Inpainting.

Zexu Pan, Wupeng Wang, Marvin Borsdorf, Haizhou Li

Proceedings of the IEEE International Conference on Acoustics, 2023

Scenario-Aware Audio-Visual TF-Gridnet for Target Speech Extraction.

Zexu Pan, Gordon Wichern, Yoshiki Masuyama, François G. Germain, Sameer Khurana, Chiori Hori, Jonathan Le Roux

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

2022

Selective Listening by Synchronizing Speech With Lips.

Zexu Pan, Ruijie Tao, Chenglin Xu, Haizhou Li

IEEE ACM Trans. Audio Speech Lang. Process., 2022

USEV: Universal Speaker Extraction With Visual Cue.

Zexu Pan, Meng Ge, Haizhou Li

IEEE ACM Trans. Audio Speech Lang. Process., 2022

Speaker Extraction With Co-Speech Gestures Cue.

Zexu Pan, Xinyuan Qian, Haizhou Li

IEEE Signal Process. Lett., 2022

Towards End-to-end Speaker Diarization in the Wild.

Zexu Pan, Gordon Wichern, François G. Germain, Aswin Shanmugam Subramanian, Jonathan Le Roux

CoRR, 2022

A Hybrid Continuity Loss to Reduce Over-Suppression for Time-domain Target Speaker Extraction.

Zexu Pan, Meng Ge, Haizhou Li

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

VCSE: Time-Domain Visual-Contextual Speaker Extraction Network.

Junjie Li, Meng Ge, Zexu Pan, Longbiao Wang, Jianwu Dang

Proceedings of the 23rd Annual Conference of the International Speech Communication Association, 2022

2021

Is Someone Speaking?: Exploring Long-term Temporal Features for Audio-visual Active Speaker Detection.

Ruijie Tao, Zexu Pan, Rohan Kumar Das, Xinyuan Qian, Mike Zheng Shou, Haizhou Li

Proceedings of the MM '21: ACM Multimedia Conference, Virtual Event, China, October 20, 2021

Multi-Target DoA Estimation with an Audio-Visual Fusion Mechanism.

Xinyuan Qian, Maulik C. Madhavi, Zexu Pan, Jiadong Wang, Haizhou Li

Proceedings of the IEEE International Conference on Acoustics, 2021

Muse: Multi-Modal Target Speaker Extraction with Visual Cues.

Zexu Pan, Ruijie Tao, Chenglin Xu, Haizhou Li

Proceedings of the IEEE International Conference on Acoustics, 2021

2020

Multi-Modal Attention for Speech Emotion Recognition.

Zexu Pan, Zhaojie Luo, Jichen Yang, Haizhou Li

Proceedings of the 21st Annual Conference of the International Speech Communication Association, 2020