Lei He

According to our database, Lei He authored at least 58 papers between 2014 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

NaturalSpeech 2: Latent Diffusion Models are Natural and Zero-Shot Speech and Singing Synthesizers.

Kai Shen, Zeqian Ju, Xu Tan, Yanqing Liu, Yichong Leng, Lei He, Tao Qin, Sheng Zhao, Jiang Bian

CoRR, 2023

AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models.

Yuancheng Wang, Zeqian Ju, Xu Tan, Lei He, Zhizheng Wu, Jiang Bian, Sheng Zhao

CoRR, 2023

Speak Foreign Languages with Your Own Voice: Cross-Lingual Neural Codec Language Modeling.

Ziqiang Zhang, Long Zhou, Chengyi Wang, Sanyuan Chen, Yu Wu, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

CoRR, 2023

FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model.

Ruiqing Xue, Yanqing Liu, Lei He, Xu Tan, Linquan Liu, Edward Lin, Sheng Zhao

CoRR, 2023

Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers.

Chengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei

CoRR, 2023

LeanSpeech: The Microsoft Lightweight Speech Synthesis System for Limmits Challenge 2023.

Chen Zhang, Shubham Bansal, Aakash Lakhera, Jinzhu Li, Gang Wang, Sandeepkumar Satpal, Sheng Zhao, Lei He

Proceedings of the IEEE International Conference on Acoustics, 2023

Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation.

Kun Wei, Long Zhou, Ziqiang Zhang, Liping Chen, Shujie Liu, Lei He, Jinyu Li, Furu Wei

Proceedings of the IEEE International Conference on Acoustics, 2023

Prosody-Aware Speecht5 for Expressive Neural TTS.

Yan Deng, Long Zhou, Yuanhao Yi, Shujie Liu, Lei He

Proceedings of the IEEE International Conference on Acoustics, 2023

VideoDubber: Machine Translation with Speech-Aware Length Control for Video Dubbing.

Yihan Wu, Junliang Guo, Xu Tan, Chen Zhang, Bohan Li, Ruihua Song, Lei He, Sheng Zhao, Arul Menezes, Jiang Bian

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

ResGrad: Residual Denoising Diffusion Probabilistic Models for Text to Speech.

Zehua Chen, Yihan Wu, Yichong Leng, Jiawei Chen, Haohe Liu, Xu Tan, Yang Cui, Ke Wang, Lei He, Sheng Zhao, Jiang Bian, Danilo P. Mandic

CoRR, 2022

BinauralGrad: A Two-Stage Conditional Diffusion Probabilistic Model for Binaural Audio Synthesis.

Yichong Leng, Zehua Chen, Junliang Guo, Haohe Liu, Jiawei Chen, Xu Tan, Danilo P. Mandic, Lei He, Xiang-Yang Li, Tao Qin, Sheng Zhao, Tie-Yan Liu

CoRR, 2022

NaturalSpeech: End-to-End Text to Speech Synthesis with Human-Level Quality.

Xu Tan, Jiawei Chen, Haohe Liu, Jian Cong, Chen Zhang, Yanqing Liu, Xi Wang, Yichong Leng, Yuanhao Yi, Lei He, Frank K. Soong, Tao Qin, Sheng Zhao, Tie-Yan Liu

CoRR, 2022

SoftSpeech: Unsupervised Duration Model in FastSpeech 2.

Yuanhao Yi, Lei He, Shifeng Pan, Xi Wang, Yuchao Zhang

Proceedings of the Interspeech 2022, 2022

Self-supervised Context-aware Style Representation for Expressive Speech Synthesis.

Yihan Wu, Xi Wang, Shaofei Zhang, Lei He, Ruihua Song, Jian-Yun Nie

Proceedings of the Interspeech 2022, 2022

AdaSpeech 4: Adaptive Text to Speech in Zero-Shot Scenarios.

Yihan Wu, Xu Tan, Bohan Li, Lei He, Sheng Zhao, Ruihua Song, Tao Qin, Tie-Yan Liu

Proceedings of the Interspeech 2022, 2022

DelightfulTTS 2: End-to-End Speech Synthesis with Adversarial Vector-Quantized Auto-Encoders.

Yanqing Liu, Ruiqing Xue, Lei He, Xu Tan, Sheng Zhao

Proceedings of the Interspeech 2022, 2022

Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge.

Mutian He, Jingzhou Yang, Lei He, Frank K. Soong

Proceedings of the Interspeech 2022, 2022

Exploring Machine Speech Chain For Domain Adaptation.

Fengpeng Yue, Yan Deng, Lei He, Tom Ko, Yu Zhang

Proceedings of the IEEE International Conference on Acoustics, 2022

Prosodyspeech: Towards Advanced Prosody Model for Neural Text-to-Speech.

Yuanhao Yi, Lei He, Shifeng Pan, Xi Wang, Yujia Xiao

Proceedings of the IEEE International Conference on Acoustics, 2022

Improving Fastspeech TTS with Efficient Self-Attention and Compact Feed-Forward Network.

Yujia Xiao, Xi Wang, Lei He, Frank K. Soong

Proceedings of the IEEE International Conference on Acoustics, 2022

Infergrad: Improving Diffusion Models for Vocoder by Considering Inference in Training.

Zehua Chen, Xu Tan, Ke Wang, Shifeng Pan, Danilo P. Mandic, Lei He, Sheng Zhao

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

Cycle consistent network for end-to-end style transfer TTS training.

Liumeng Xue, Shifeng Pan, Lei He, Lei Xie, Frank K. Soong

Neural Networks, 2021

DelightfulTTS: The Microsoft Speech Synthesis System for Blizzard Challenge 2021.

Yanqing Liu, Zhihang Xu, Gang Wang, Kuan Chen, Bohan Li, Xu Tan, Jinzhu Li, Lei He, Sheng Zhao

CoRR, 2021

Exploring Machine Speech Chain for Domain Adaptation and Few-Shot Speaker Adaptation.

Fengpeng Yue, Yan Deng, Lei He, Tom Ko

CoRR, 2021

Multilingual Byte2Speech Models for Scalable Low-resource Speech Synthesis.

Mutian He, Jingzhou Yang, Lei He, Frank K. Soong

CoRR, 2021

Conversational End-to-End TTS for Voice Agents.

Haohan Guo, Shaofei Zhang, Frank K. Soong, Lei He, Lei Xie

Proceedings of the IEEE Spoken Language Technology Workshop, 2021

Cross-Speaker Style Transfer with Prosody Bottleneck in Neural Speech Synthesis.

Shifeng Pan, Lei He

Proceedings of the Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association, Brno, Czechia, 30 August, 2021

Improving RNN-T for Domain Scaling Using Semi-Supervised Training with Neural TTS.

Yan Deng, Rui Zhao, Zhong Meng, Xie Chen, Bing Liu, Jinyu Li, Yifan Gong, Lei He

Proceedings of the Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association, Brno, Czechia, 30 August, 2021

Speech Bert Embedding for Improving Prosody in Neural TTS.

Liping Chen, Yan Deng, Xi Wang, Frank K. Soong, Lei He

Proceedings of the IEEE International Conference on Acoustics, 2021

On Addressing Practical Challenges for RNN-Transducer.

Rui Zhao, Jian Xue, Jinyu Li, Wenning Wei, Lei He, Yifan Gong

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2021

2020

s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis.

Xi Wang, Huaiping Ming, Lei He, Frank K. Soong

CoRR, 2020

Conversational End-to-End TTS for Voice Agent.

Haohan Guo, Shaofei Zhang, Frank K. Soong, Lei He, Lei Xie

CoRR, 2020

On Early-stop Clustering for Speaker Diarization.

Liping Chen, Kong-Aik Lee, Lei He, Frank K. Soong

Proceedings of the Odyssey 2020: The Speaker and Language Recognition Workshop, 2020

Developing RNN-T Models Surpassing High-Performance Hybrid Models with Customization Capability.

Jinyu Li, Rui Zhao, Zhong Meng, Yanqing Liu, Wenning Wei, Sarangarajan Parthasarathy, Vadim Mazalov, Zhenghao Wang, Lei He, Sheng Zhao, Yifan Gong

Proceedings of the Interspeech 2020, 2020

An Efficient Subband Linear Prediction for LPCNet-Based Neural Synthesis.

Yang Cui, Xi Wang, Lei He, Frank K. Soong

Proceedings of the Interspeech 2020, 2020

Rapid RNN-T Adaptation Using Personalized Speech Synthesis and Neural Language Generator.

Yan Huang, Jinyu Li, Lei He, Wenning Wei, William Gale, Yifan Gong

Proceedings of the Interspeech 2020, 2020

Improving Prosody with Linguistic and Bert Derived Features in Multi-Speaker Based Mandarin Chinese Neural TTS.

Yujia Xiao, Lei He, Huaiping Ming, Frank K. Soong

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Adaptation of RNN Transducer with Text-To-Speech Technology for Keyword Spotting.

Eva Sharma, Guoli Ye, Wenning Wei, Rui Zhao, Yao Tian, Jian Wu, Lei He, Ed Lin, Yifan Gong

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

Using Personalized Speech Synthesis and Neural Language Generator for Rapid Speaker Adaptation.

Yan Huang, Lei He, Wenning Wei, William Gale, Jinyu Li, Yifan Gong

Proceedings of the 2020 IEEE International Conference on Acoustics, 2020

2019

Feature reinforcement with word embedding and parsing information in neural TTS.

Huaiping Ming, Lei He, Haohan Guo, Frank K. Soong

CoRR, 2019

Forward-Backward Decoding for Regularizing End-to-End TTS.

Yibin Zheng, Xi Wang, Lei He, Shifeng Pan, Frank K. Soong, Zhengqi Wen, Jianhua Tao

Proceedings of the Interspeech 2019, 2019

Robust Sequence-to-Sequence Acoustic Modeling with Stepwise Monotonic Attention for Neural TTS.

Mutian He, Yan Deng, Lei He

Proceedings of the Interspeech 2019, 2019

Exploiting Syntactic Features in a Parsed Tree to Improve End-to-End TTS.

Haohan Guo, Frank K. Soong, Lei He, Lei Xie

Proceedings of the Interspeech 2019, 2019

A New GAN-Based End-to-End TTS Training Algorithm.

Haohan Guo, Frank K. Soong, Lei He, Lei Xie

Proceedings of the Interspeech 2019, 2019

Learning Latent Representations for Style Control and Transfer in End-to-end Speech Synthesis.

Yajie Zhang, Shifeng Pan, Lei He, Zhen-Hua Ling

Proceedings of the IEEE International Conference on Acoustics, 2019

2018

Modeling Multi-speaker Latent Space to Improve Neural TTS: Quick Enrolling New Speaker and Enhancing Premium Voice.

Yan Deng, Lei He, Frank K. Soong

CoRR, 2018

Frame Selection in SI-DNN Phonetic Space with WaveNet Vocoder for Voice Conversion without Parallel Training Data.

Feng-Long Xie, Frank K. Soong, Xi Wang, Lei He, Haifeng Li

Proceedings of the 11th International Symposium on Chinese Spoken Language Processing, 2018

A New Glottal Neural Vocoder for Speech Synthesis.

Yang Cui, Xi Wang, Lei He, Frank K. Soong

Proceedings of the Interspeech 2018, 2018

2016

Modeling F0 trajectories in hierarchically structured deep neural networks.

Xiang Yin, Ming Lei, Yao Qian, Frank K. Soong, Lei He, Zhen-Hua Ling, Li-Rong Dai

Speech Commun., 2016

Learning Distributed Word Representations For Bidirectional LSTM Recurrent Neural Network.

Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao

Proceedings of the NAACL HLT 2016, 2016

Speaker and language factorization in DNN-based TTS synthesis.

Yuchen Fan, Yao Qian, Frank K. Soong, Lei He

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

Unsupervised speaker adaptation for DNN-based TTS synthesis.

Yuchen Fan, Yao Qian, Frank K. Soong, Lei He

Proceedings of the 2016 IEEE International Conference on Acoustics, 2016

2015

A Unified Tagging Solution: Bidirectional LSTM Recurrent Neural Network with Word Embedding.

Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao

CoRR, 2015

Part-of-Speech Tagging with Bidirectional Long Short-Term Memory Recurrent Neural Network.

Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao

CoRR, 2015

Sequence generation error (SGE) minimization based deep neural networks training for text-to-speech synthesis.

Yuchen Fan, Yao Qian, Frank K. Soong, Lei He

Proceedings of the INTERSPEECH 2015, 2015

Word embedding for recurrent neural network based TTS synthesis.

Peilu Wang, Yao Qian, Frank K. Soong, Lei He, Hai Zhao

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

Multi-speaker modeling and speaker adaptation for DNN-based TTS synthesis.

Yuchen Fan, Yao Qian, Frank K. Soong, Lei He

Proceedings of the 2015 IEEE International Conference on Acoustics, 2015

2014

Modeling DCT parameterized F0 trajectory at intonation phrase level with DNN or decision tree.

Xiang Yin, Ming Lei, Yao Qian, Frank K. Soong, Lei He, Zhen-Hua Ling, Li-Rong Dai

Proceedings of the INTERSPEECH 2014, 2014