Modeling DCT parameterized F0 trajectory at intonation phrase level with DNN or decision tree. - Xiang Yin 002; Ming Lei; Yao Qian; Frank K. Soong; Lei He 005; Zhen-Hua Ling; Li-Rong Dai 001 (INTERSPEECH, 2014)

Multi-speaker modeling and speaker adaptation for DNN-based TTS synthesis. - Yuchen Fan; Yao Qian; Frank K. Soong; Lei He 005 (ICASSP, 2015)

Word embedding for recurrent neural network based TTS synthesis. - Peilu Wang; Yao Qian; Frank K. Soong; Lei He 005; Hai Zhao (ICASSP, 2015)

Sequence generation error (SGE) minimization based deep neural networks training for text-to-speech synthesis. - Yuchen Fan; Yao Qian; Frank K. Soong; Lei He 005 (INTERSPEECH, 2015)

Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network. - Peilu Wang; Yao Qian; Frank K. Soong; Lei He 005; Hai Zhao (CoRR, 2015)

A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding. - Peilu Wang; Yao Qian; Frank K. Soong; Lei He 005; Hai Zhao (CoRR, 2015)

Unsupervised speaker adaptation for DNN-based TTS synthesis. - Yuchen Fan; Yao Qian; Frank K. Soong; Lei He 005 (ICASSP, 2016)

Speaker and language factorization in DNN-based TTS synthesis. - Yuchen Fan; Yao Qian; Frank K. Soong; Lei He 005 (ICASSP, 2016)

Learning Distributed Word Representations For Bidirectional LSTM Recurrent Neural Network. - Peilu Wang; Yao Qian; Frank K. Soong; Lei He 005; Hai Zhao (HLT-NAACL, 2016)

Modeling F0 trajectories in hierarchically structured deep neural networks. - Xiang Yin 002; Ming Lei; Yao Qian; Frank K. Soong; Lei He 005; Zhen-Hua Ling; Li-Rong Dai 001 (Speech Commun., 2016)

A New Glottal Neural Vocoder for Speech Synthesis. - Yang Cui; Xi Wang 016; Lei He 005; Frank K. Soong (INTERSPEECH, 2018)

Frame Selection in SI-DNN Phonetic Space with WaveNet Vocoder for Voice Conversion without Parallel Training Data. - Feng-Long Xie; Frank K. Soong; Xi Wang 016; Lei He 005; Haifeng Li 001 (ISCSLP, 2018)

Modeling Multi-speaker Latent Space to Improve Neural TTS: Quick Enrolling New Speaker and Enhancing Premium Voice. - Yan Deng; Lei He 005; Frank K. Soong (CoRR, 2018)

Learning Latent Representations for Style Control and Transfer in End-to-end Speech Synthesis. - Yajie Zhang; Shifeng Pan; Lei He 005; Zhen-Hua Ling (ICASSP, 2019)

A New GAN-Based End-to-End TTS Training Algorithm. - Haohan Guo; Frank K. Soong; Lei He 005; Lei Xie 001 (INTERSPEECH, 2019)

Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS. - Haohan Guo; Frank K. Soong; Lei He 005; Lei Xie 001 (INTERSPEECH, 2019)

Robust Sequence-to-Sequence Acoustic Modeling with Stepwise Monotonic Attention for Neural TTS. - Mutian He 001; Yan Deng; Lei He 005 (INTERSPEECH, 2019)

Forward-Backward Decoding for Regularizing End-to-End TTS. - Yibin Zheng; Xi Wang 016; Lei He 005; Shifeng Pan; Frank K. Soong; Zhengqi Wen; Jianhua Tao 001 (INTERSPEECH, 2019)

Feature reinforcement with word embedding and parsing information in neural TTS. - Huaiping Ming; Lei He 005; Haohan Guo; Frank K. Soong (CoRR, 2019)

Using Personalized Speech Synthesis and Neural Language Generator for Rapid Speaker Adaptation. - Yan Huang 028; Lei He 005; Wenning Wei; William Gale; Jinyu Li 001; Yifan Gong 001 (ICASSP, 2020)

Adaptation of RNN Transducer with Text-To-Speech Technology for Keyword Spotting. - Eva Sharma; Guoli Ye; Wenning Wei; Rui Zhao 017; Yao Tian; Jian Wu 027; Lei He 005; Ed Lin; Yifan Gong 001 (ICASSP, 2020)

Improving Prosody with Linguistic and Bert Derived Features in Multi-Speaker Based Mandarin Chinese Neural TTS. - Yujia Xiao; Lei He 005; Huaiping Ming; Frank K. Soong (ICASSP, 2020)

Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator. - Yan Huang 028; Jinyu Li 001; Lei He 005; Wenning Wei; William Gale; Yifan Gong 001 (INTERSPEECH, 2020)

An Efficient Subband Linear Prediction for LPCNet-Based Neural Synthesis. - Yang Cui; Xi Wang 016; Lei He 005; Frank K. Soong (INTERSPEECH, 2020)

Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability. - Jinyu Li 001; Rui Zhao 017; Zhong Meng; Yanqing Liu; Wenning Wei; Sarangarajan Parthasarathy; Vadim Mazalov; Zhenghao Wang; Lei He 005; Sheng Zhao; Yifan Gong 001 (INTERSPEECH, 2020)

On Early-stop Clustering for Speaker Diarization. - Liping Chen; Kong-Aik Lee; Lei He 005; Frank K. Soong (Odyssey, 2020)

Conversational End-to-End TTS for Voice Agent. - Haohan Guo; Shaofei Zhang; Frank K. Soong; Lei He 005; Lei Xie 001 (CoRR, 2020)

s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis. - Xi Wang 016; Huaiping Ming; Lei He 005; Frank K. Soong (CoRR, 2020)

On Addressing Practical Challenges for RNN-Transducer. - Rui Zhao 017; Jian Xue; Jinyu Li 001; Wenning Wei; Lei He 005; Yifan Gong 001 (ASRU, 2021)

DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021. - Yanqing Liu; Zhihang Xu; Gang Wang 001; Kuan Chen; Bohan Li 003; Xu Tan 003; Jinzhu Li; Lei He 005; Sheng Zhao (Blizzard Challenge, 2021)

Speech Bert Embedding for Improving Prosody in Neural TTS. - Liping Chen; Yan Deng; Xi Wang 016; Frank K. Soong; Lei He 005 (ICASSP, 2021)

Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS. - Yan Deng; Rui Zhao 017; Zhong Meng; Xie Chen 001; Bing Liu; Jinyu Li 001; Yifan Gong 001; Lei He 005 (Interspeech, 2021)

Cross-Speaker Style Transfer with Prosody Bottleneck in Neural Speech Synthesis. - Shifeng Pan; Lei He 005 (Interspeech, 2021)

Conversational End-to-End TTS for Voice Agents. - Haohan Guo; Shaofei Zhang; Frank K. Soong; Lei He 005; Lei Xie 001 (SLT, 2021)

Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesis. - Mutian He 001; Jingzhou Yang; Lei He 005; Frank K. Soong (CoRR, 2021)

Exploring Machine Speech Chain for Domain Adaptation and Few-Shot Speaker Adaptation. - Fengpeng Yue; Yan Deng; Lei He 005; Tom Ko (CoRR, 2021)

Cycle consistent network for end-to-end style transfer TTS training. - Liumeng Xue; Shifeng Pan; Lei He 005; Lei Xie 001; Frank K. Soong (Neural Networks, 2021)

Infergrad: Improving Diffusion Models for Vocoder by Considering Inference in Training. - Zehua Chen; Xu Tan 003; Ke Wang; Shifeng Pan; Danilo P. Mandic; Lei He 005; Sheng Zhao (ICASSP, 2022)

Improving Fastspeech TTS with Efficient Self-Attention and Compact Feed-Forward Network. - Yujia Xiao; Xi Wang 016; Lei He 005; Frank K. Soong (ICASSP, 2022)

Prosodyspeech: Towards Advanced Prosody Model for Neural Text-to-Speech. - Yuanhao Yi; Lei He 005; Shifeng Pan; Xi Wang 016; Yujia Xiao (ICASSP, 2022)

Exploring Machine Speech Chain For Domain Adaptation. - Fengpeng Yue; Yan Deng; Lei He 005; Tom Ko; Yu Zhang 006 (ICASSP, 2022)

Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge. - Mutian He 001; Jingzhou Yang; Lei He 005; Frank K. Soong (INTERSPEECH, 2022)

DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders. - Yanqing Liu; Ruiqing Xue; Lei He 005; Xu Tan 003; Sheng Zhao (INTERSPEECH, 2022)

AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios. - Yihan Wu; Xu Tan 003; Bohan Li 003; Lei He 005; Sheng Zhao; Ruihua Song; Tao Qin 001; Tie-Yan Liu (INTERSPEECH, 2022)

Self-supervised Context-aware Style Representation for Expressive Speech Synthesis. - Yihan Wu; Xi Wang 016; Shaofei Zhang; Lei He 005; Ruihua Song; Jian-Yun Nie (INTERSPEECH, 2022)

SoftSpeech: Unsupervised Duration Model in FastSpeech 2. - Yuanhao Yi; Lei He 005; Shifeng Pan; Xi Wang 016; Yuchao Zhang (INTERSPEECH, 2022)

BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis. - Yichong Leng; Zehua Chen; Junliang Guo; Haohe Liu; Jiawei Chen 008; Xu Tan 003; Danilo P. Mandic; Lei He 005; Xiangyang Li 001; Tao Qin 001; Sheng Zhao; Tie-Yan Liu (NeurIPS, 2022)

ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speech. - Zehua Chen; Yihan Wu; Yichong Leng; Jiawei Chen 008; Haohe Liu; Xu Tan 003; Yang Cui; Ke Wang; Lei He 005; Sheng Zhao; Jiang Bian 002; Danilo P. Mandic (CoRR, 2022)

VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing. - Yihan Wu; Junliang Guo; Xu Tan 003; Chen Zhang 020; Bohan Li 003; Ruihua Song; Lei He 005; Sheng Zhao; Arul Menezes; Jiang Bian 002 (AAAI, 2023)

MuLanTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2023. - Zhihang Xu; Shaofei Zhang; Xi Wang 016; Jiajun Zhang; Wenning Wei; Lei He 005; Sheng Zhao (Blizzard Challenge, 2023)

Prosody-Aware Speecht5 for Expressive Neural TTS. - Yan Deng; Long Zhou; Yuanhao Yi; Shujie Liu 001; Lei He 005 (ICASSP, 2023)

Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation. - Kun Wei; Long Zhou; Ziqiang Zhang; Liping Chen; Shujie Liu 001; Lei He 005; Jinyu Li 001; Furu Wei (ICASSP, 2023)

LeanSpeech: The Microsoft Lightweight Speech Synthesis System for Limmits Challenge 2023. - Chen Zhang 020; Shubham Bansal; Aakash Lakhera; Jinzhu Li; Gang Wang 001; Sandeepkumar Satpal; Sheng Zhao; Lei He 005 (ICASSP, 2023)

Large-Scale Automatic Audiobook Creation. - Brendan Walsh; Mark Hamilton; Greg Newby; Xi Wang 016; Serena Ruan; Sheng Zhao; Lei He 005; Shaofei Zhang; Eric Dettinger; William T. Freeman; Markus Weimer (INTERSPEECH, 2023)

ContextSpeech: Expressive and Efficient Text-to-Speech for Paragraph Reading. - Yujia Xiao; Shaofei Zhang; Xi Wang 016; Xu Tan 003; Lei He 005; Sheng Zhao; Frank K. Soong; Tan Lee 001 (INTERSPEECH, 2023)

AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models. - Yuancheng Wang; Zeqian Ju; Xu Tan 003; Lei He 005; Zhizheng Wu 001; Jiang Bian 002; Sheng Zhao (NeurIPS, 2023)

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers. - Chengyi Wang 002; Sanyuan Chen; Yu Wu 012; Ziqiang Zhang; Long Zhou; Shujie Liu 001; Zhuo Chen 006; Yanqing Liu; Huaming Wang; Jinyu Li 001; Lei He 005; Sheng Zhao; et al. (CoRR, 2023)

FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model. - Ruiqing Xue; Yanqing Liu; Lei He 005; Xu Tan 003; Linquan Liu; Edward Lin; Sheng Zhao (CoRR, 2023)

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling. - Ziqiang Zhang; Long Zhou; Chengyi Wang 002; Sanyuan Chen; Yu Wu 012; Shujie Liu 001; Zhuo Chen 006; Yanqing Liu; Huaming Wang; Jinyu Li 001; Lei He 005; Sheng Zhao; et al. (CoRR, 2023)

NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers. - Kai Shen; Zeqian Ju; Xu Tan 003; Yanqing Liu; Yichong Leng; Lei He 005; Tao Qin 001; Sheng Zhao; Jiang Bian 002 (CoRR, 2023)

PromptTTS 2: Describing and Generating Voices with Text Prompt. - Yichong Leng; Zhifang Guo; Kai Shen; Xu Tan 003; Zeqian Ju; Yanqing Liu; Yufei Liu; Dongchao Yang; Leying Zhang; Kaitao Song; Lei He 005; Xiang-Yang Li 001; et al. (CoRR, 2023)

Stylespeech: Self-Supervised Style Enhancing with VQ-VAE-Based Pre-Training for Expressive Audiobook Speech Synthesis. - Xueyuan Chen; Xi Wang 016; Shaofei Zhang; Lei He 005; Zhiyong Wu 001; Xixin Wu; Helen Meng (ICASSP, 2024)

PromptTTS 2: Describing and Generating Voices with Text Prompt. - Yichong Leng; Zhifang Guo; Kai Shen; Zeqian Ju; Xu Tan 003; Eric Liu; Yufei Liu; Dongchao Yang; Leying Zhang; Kaitao Song; Lei He 005; Xiangyang Li 001; et al. (ICLR, 2024)

NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers. - Kai Shen; Zeqian Ju; Xu Tan 003; Eric Liu; Yichong Leng; Lei He 005; Tao Qin 001; Sheng Zhao; Jiang Bian 002 (ICLR, 2024)

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models. - Zeqian Ju; Yuancheng Wang; Kai Shen; Xu Tan 003; Detai Xin; Dongchao Yang; Eric Liu; Yichong Leng; Kaitao Song; Siliang Tang; Zhizheng Wu 001; Tao Qin 001; et al. (ICML, 2024)

Contrastive Context-Speech Pretraining for Expressive Text-to-Speech Synthesis. - Yujia Xiao; Xi Wang 016; Xu Tan 003; Lei He 005; Xinfa Zhu; Sheng Zhao; Tan Lee 001 (ACM Multimedia, 2024)

UniStyle: Unified Style Modeling for Speaking Style Captioning and Stylistic Speech Synthesis. - Xinfa Zhu; Wenjie Tian; Xinsheng Wang; Lei He 005; Yujia Xiao; Xi Wang 016; Xu Tan 003; Sheng Zhao; Lei Xie 001 (ACM Multimedia, 2024)

CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversations. - Leying Zhang; Yao Qian; Long Zhou; Shujie Liu 001; Dongmei Wang; Xiaofei Wang 009; Midia Yousefi; Yanmin Qian; Jinyu Li 001; Lei He 005; Sheng Zhao; Michael Zeng 001 (NeurIPS, 2024)

NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models. - Zeqian Ju; Yuancheng Wang; Kai Shen; Xu Tan 003; Detai Xin; Dongchao Yang; Yanqing Liu; Yichong Leng; Kaitao Song; Siliang Tang; Zhizheng Wu 001; Tao Qin 001; et al. (CoRR, 2024)

NaturalSpeech: End-to-End Text-to-Speech Synthesis With Human-Level Quality. - Xu Tan 003; Jiawei Chen 008; Haohe Liu; Jian Cong; Chen Zhang 020; Yanqing Liu; Xi Wang 016; Yichong Leng; Yuanhao Yi; Lei He 005; Sheng Zhao; Tao Qin 001; et al. (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

Drop the Beat! Freestyler for Accompaniment Conditioned Rapping Voice Generation. - Ziqian Ning; Shuai Wang 016; Yuepeng Jiang; Jixun Yao; Lei He 005; Shifeng Pan; Jie Ding; Lei Xie 001 (AAAI, 2025)

PodAgent: A Comprehensive Framework for Podcast Generation. - Yujia Xiao; Lei He 005; Haohan Guo; Fenglong Xie; Tan Lee 001 (ACL (Findings), 2025)

ZSVC: Zero-shot Style Voice Conversion with Disentangled Latent Diffusion Models and Adversarial Training. - Xinfa Zhu; Lei He 005; Yujia Xiao; Xi Wang 016; Xu Tan 003; Sheng Zhao; Lei Xie 001 (ICASSP, 2025)

Exploring the Potential of Large Multimodal Models as Effective Alternatives for Pronunciation Assessment. - Ke Wang; Lei He 005; Kun Liu; Yan Deng; Wenning Wei; Sheng Zhao (CoRR, 2025)

Next Tokens Denoising for Speech Synthesis. - Yanqing Liu; Ruiqing Xue; Chong Zhang; Yufei Liu; Gang Wang 001; Bohan Li 003; Yao Qian; Lei He 005; Shujie Liu 001; Sheng Zhao (CoRR, 2025)