Multilingual Neural Machine Translation with Knowledge Distillation. - Xu Tan 003; Yi Ren 006; Di He 001; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ICLR (Poster), 2019)

Almost Unsupervised Text to Speech and Automatic Speech Recognition. - Yi Ren 006; Xu Tan 003; Tao Qin 001; Sheng Zhao; Zhou Zhao 001; Tie-Yan Liu (ICML, 2019)

FastSpeech: Fast, Robust and Controllable Text to Speech. - Yi Ren 006; Yangjun Ruan; Xu Tan 003; Tao Qin 001; Sheng Zhao; Zhou Zhao 001; Tie-Yan Liu (NeurIPS, 2019)

A Study of Multilingual Neural Machine Translation. - Xu Tan 003; Yichong Leng; Jiale Chen 001; Yi Ren 006; Tao Qin 001; Tie-Yan Liu (CoRR, 2019)

SimulSpeech: End-to-End Simultaneous Speech to Text Translation. - Yi Ren 006; Jinglin Liu; Xu Tan 003; Chen Zhang 020; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ACL, 2020)

A Study of Non-autoregressive Model for Sequence Generation. - Yi Ren 006; Jinglin Liu; Xu Tan 003; Zhou Zhao 001; Sheng Zhao; Tie-Yan Liu (ACL, 2020)

Task-Level Curriculum Learning for Non-Autoregressive Neural Machine Translation. - Jinglin Liu; Yi Ren 006; Xu Tan 003; Chen Zhang 020; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (IJCAI, 2020)

MultiSpeech: Multi-Speaker Text to Speech with Transformer. - Mingjian Chen; Xu Tan 003; Yi Ren 006; Jin Xu 010; Hao Sun; Sheng Zhao; Tao Qin 001 (INTERSPEECH, 2020)

DeepSinger: Singing Voice Synthesis with Data Mined From the Web. - Yi Ren 006; Xu Tan 003; Tao Qin 001; Jian Luan 001; Zhou Zhao 001; Tie-Yan Liu (KDD, 2020)

LRSpeech: Extremely Low-Resource Speech Synthesis and Recognition. - Jin Xu 010; Xu Tan 003; Yi Ren 006; Tao Qin 001; Jian Li 015; Sheng Zhao; Tie-Yan Liu (KDD, 2020)

FastLR: Non-Autoregressive Lipreading Model with Integrate-and-Fire. - Jinglin Liu; Yi Ren 006; Zhou Zhao 001; Chen Zhang 020; Baoxing Huai; Jing Yuan 007 (ACM Multimedia, 2020)

PopMAG: Pop Music Accompaniment Generation. - Yi Ren 006; Jinzheng He; Xu Tan 003; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ACM Multimedia, 2020)

SongMASS: Automatic Song Writing with Pre-training and Alignment Constraint. - Zhonghao Sheng; Kaitao Song; Xu Tan 003; Yi Ren 006; Wei Ye 004; Shikun Zhang; Tao Qin 001 (AAAI, 2021)

UWSpeech: Speech to Speech Translation for Unwritten Languages. - Chen Zhang 020; Xu Tan 003; Yi Ren 006; Tao Qin 001; Kejun Zhang; Tie-Yan Liu (AAAI, 2021)

Denoispeech: Denoising Text to Speech with Frame-Level Noise Modeling. - Chen Zhang 020; Yi Ren 006; Xu Tan 003; Jinglin Liu; Kejun Zhang; Tao Qin 001; Sheng Zhao; Tie-Yan Liu (ICASSP, 2021)

FastSpeech 2: Fast and High-Quality End-to-End Text to Speech. - Yi Ren 006; Chenxu Hu; Xu Tan 003; Tao Qin 001; Sheng Zhao; Zhou Zhao 001; Tie-Yan Liu (ICLR, 2021)

FedSpeech: Federated Text-to-Speech with Continual Learning. - Ziyue Jiang 001; Yi Ren 006; Ming Lei; Zhou Zhao 001 (IJCAI, 2021)

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model. - Chenye Cui; Yi Ren 006; Jinglin Liu; Feiyang Chen; Rongjie Huang 001; Ming Lei; Zhou Zhao 001 (Interspeech, 2021)

WSRGlow: A Glow-Based Waveform Generative Model for Audio Super-Resolution. - Kexun Zhang; Yi Ren 006; Changliang Xu; Zhou Zhao 001 (Interspeech, 2021)

Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus. - Rongjie Huang 001; Feiyang Chen; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (ACM Multimedia, 2021)

PortaSpeech: Portable and High-Quality Generative Text-to-Speech. - Yi Ren 006; Jinglin Liu; Zhou Zhao 001 (NeurIPS, 2021)

DiffSinger: Diffusion Acoustic Model for Singing Voice Synthesis. - Jinglin Liu; Chengxi Li 002; Yi Ren 006; Feiyang Chen; Peng Liu; Zhou Zhao 001 (CoRR, 2021)

High-Speed and High-Quality Text-to-Lip Generation. - Jinglin Liu; Zhiying Zhu; Yi Ren 006; Zhou Zhao 001 (CoRR, 2021)

SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation. - Feiyang Chen; Rongjie Huang 001; Chenye Cui; Yi Ren 006; Jinglin Liu; Zhou Zhao 001; Nicholas Jing Yuan; Baoxing Huai (CoRR, 2021)

Flow-Based Unconstrained Lip to Speech Generation. - Jinzheng He; Zhou Zhao 001; Yi Ren 006; Jinglin Liu; Baoxing Huai; Nicholas Jing Yuan (AAAI, 2022)

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism. - Jinglin Liu; Chengxi Li 002; Yi Ren 006; Feiyang Chen; Zhou Zhao 001 (AAAI, 2022)

Parallel and High-Fidelity Text-to-Lip Generation. - Jinglin Liu; Zhiying Zhu; Yi Ren 006; Wencan Huang; Baoxing Huai; Nicholas Jing Yuan; Zhou Zhao 001 (AAAI, 2022)

Revisiting Over-Smoothness in Text to Speech. - Yi Ren 006; Xu Tan 003; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ACL (1), 2022)

Learning the Beauty in Songs: Neural Singing Voice Beautifier. - Jinglin Liu; Chengxi Li 002; Yi Ren 006; Zhiying Zhu; Zhou Zhao 001 (ACL (1), 2022)

Prosospeech: Enhancing Prosody with Quantized Vector Pre-Training in Text-To-Speech. - Yi Ren 006; Ming Lei; Zhiying Huang; Shiliang Zhang; Qian Chen 003; Zhijie Yan; Zhou Zhao 001 (ICASSP, 2022)

HiFiDenoise: High-Fidelity Denoising Text to Speech with Adversarial Networks. - Lichao Zhang; Yi Ren 006; Liqun Deng; Zhou Zhao 001 (ICASSP, 2022)

Pseudo Numerical Methods for Diffusion Models on Manifolds. - Luping Liu; Yi Ren 006; Zhijie Lin 001; Zhou Zhao 001 (ICLR, 2022)

FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis. - Rongjie Huang 001; Max W. Y. Lam; Jun Wang 091; Dan Su 002; Dong Yu 001; Yi Ren 006; Zhou Zhao 001 (IJCAI, 2022)

SyntaSpeech: Syntax-Aware Generative Adversarial Text-to-Speech. - Zhenhui Ye; Zhou Zhao 001; Yi Ren 006; Fei Wu 001 (IJCAI, 2022)

EditSinger: Zero-Shot Text-Based Singing Voice Editing System with Diverse Prosody Modeling. - Lichao Zhang; Zhou Zhao 001; Yi Ren 006; Liqun Deng (IJCAI, 2022)

SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation. - Rongjie Huang 001; Chenye Cui; Feiyang Chen; Yi Ren 006; Jinglin Liu; Zhou Zhao 001; Baoxing Huai; Zhefeng Wang 001 (ACM Multimedia, 2022)

ProDiff: Progressive Fast Diffusion Model for High-Quality Text-to-Speech. - Rongjie Huang 001; Zhou Zhao 001; Huadai Liu; Jinglin Liu; Chenye Cui; Yi Ren 006 (ACM Multimedia, 2022)

Video-Guided Curriculum Learning for Spoken Video Grounding. - Yan Xia 006; Zhou Zhao 001; Shangwei Ye; Yang Zhao 022; Haoyuan Li 002; Yi Ren 006 (ACM Multimedia, 2022)

A Study of Syntactic Multi-Modality in Non-Autoregressive Machine Translation. - Kexun Zhang; Rui Wang 028; Xu Tan 003; Junliang Guo; Yi Ren 006; Tao Qin 001; Tie-Yan Liu (NAACL-HLT, 2022)

GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech. - Rongjie Huang 001; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (NeurIPS, 2022)

Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech. - Ziyue Jiang 001; Su Zhe; Zhou Zhao 001; Qian Yang 006; Yi Ren 006; Jinglin Liu; Zhenhui Ye (NeurIPS, 2022)

M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus. - Lichao Zhang; Ruiqi Li; Shoutong Wang; Liqun Deng; Jinglin Liu; Yi Ren 006; Jinzheng He; Rongjie Huang 001; Jieming Zhu; Xiao Chen; Zhou Zhao 001 (NeurIPS, 2022)

MR-SVS: Singing Voice Synthesis with Multi-Reference Encoder. - Shoutong Wang; Jinglin Liu; Yi Ren 006; Zhen Wang; Changliang Xu; Zhou Zhao 001 (CoRR, 2022)

GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech Synthesis. - Rongjie Huang 001; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (CoRR, 2022)

VarietySound: Timbre-Controllable Video to Sound Generation via Unsupervised Information Disentanglement. - Chenye Cui; Yi Ren 006; Jinglin Liu; Rongjie Huang 001; Zhou Zhao 001 (CoRR, 2022)

Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection. - Luping Liu; Yi Ren 006; Xize Cheng; Zhou Zhao 001 (CoRR, 2022)

FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis. - Rongjie Huang 001; Yi Ren 006; Ziyue Jiang 001; Chenye Cui; Jinglin Liu; Zhou Zhao 001 (ACL (Findings), 2023)

AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation. - Rongjie Huang 001; Huadai Liu; Xize Cheng; Yi Ren 006; Linjun Li; Zhenhui Ye; Jinzheng He; Lichao Zhang; Jinglin Liu; Xiang Yin 006; Zhou Zhao 001 (ACL (1), 2023)

Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech. - Rongjie Huang 001; Chunlei Zhang; Yi Ren 006; Zhou Zhao 001; Dong Yu 001 (ACL (Findings), 2023)

FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models. - Ziyue Jiang 001; Qian Yang 006; Jialong Zuo; Zhenhui Ye; Rongjie Huang 001; Yi Ren 006; Zhou Zhao 001 (ACL (Findings), 2023)

CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training. - Zhenhui Ye; Rongjie Huang 001; Yi Ren 006; Ziyue Jiang 001; Jinglin Liu; Jinzheng He; Xiang Yin 006; Zhou Zhao 001 (ACL (1), 2023)

VarietySound: Timbre-Controllable Video to Sound Generation Via Unsupervised Information Disentanglement. - Chenye Cui; Zhou Zhao 001; Yi Ren 006; Jinglin Liu; Rongjie Huang 001; Feiyang Chen; Zhefeng Wang 001; Baoxing Huai; Fei Wu 001 (ICASSP, 2023)

Overview of the ICASSP 2023 General Meeting Understanding and Generation Challenge (MUG). - Qinglin Zhang; Chong Deng; Jiaqing Liu; Hai Yu; Qian Chen 003; Wen Wang 001; Zhijie Yan; Jinglin Liu; Yi Ren 006; Zhou Zhao 001 (ICASSP, 2023)

MUG: A General Meeting Understanding and Generation Benchmark. - Qinglin Zhang; Chong Deng; Jiaqing Liu; Hai Yu; Qian Chen 003; Wen Wang 001; Zhijie Yan; Jinglin Liu; Yi Ren 006; Zhou Zhao 001 (ICASSP, 2023)

Bag of Tricks for Unsupervised Text-to-Speech. - Yi Ren 006; Chen Zhang 020; Shuicheng Yan (ICLR, 2023)

TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation. - Rongjie Huang 001; Jinglin Liu; Huadai Liu; Yi Ren 006; Lichao Zhang; Jinzheng He; Zhou Zhao 001 (ICLR, 2023)

GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis. - Zhenhui Ye; Ziyue Jiang 001; Yi Ren 006; Jinglin Liu; Jinzheng He; Zhou Zhao 001 (ICLR, 2023)

Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models. - Rongjie Huang 001; Jiawei Huang 008; Dongchao Yang; Yi Ren 006; Luping Liu; Mingze Li; Zhenhui Ye; Jinglin Liu; Xiang Yin 006; Zhou Zhao 001 (ICML, 2023)

GenerTTS: Pronunciation Disentanglement for Timbre and Style Generalization in Cross-Lingual Text-to-Speech. - Yahuan Cong; Haoyu Zhang; Haopeng Lin; Shichao Liu 003; Chunfeng Wang; Yi Ren 006; Xiang Yin 006; Zejun Ma (INTERSPEECH, 2023)

StyleS2ST: Zero-shot Style Transfer for Direct Speech-to-speech Translation. - Kun Song; Yi Ren 006; Yi Lei; Chunfeng Wang; Kun Wei; Lei Xie 001; Xiang Yin 006; Zejun Ma (INTERSPEECH, 2023)

Unsupervised Video Domain Adaptation for Action Recognition: A Disentanglement Perspective. - Pengfei Wei 001; Lingdong Kong; Xinghua Qu; Yi Ren 006; Zhiqiang Xu 003; Jing Jiang 002; Xiang Yin 006 (NeurIPS, 2023)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. - Rongjie Huang 001; Mingze Li; Dongchao Yang; Jiatong Shi; Xuankai Chang; Zhenhui Ye; Yuning Wu 001; Zhiqing Hong; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Zhou Zhao 001; et al. (CoRR, 2023)

GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation. - Zhenhui Ye; Jinzheng He; Ziyue Jiang 001; Rongjie Huang 001; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation. - Jiawei Huang 008; Yi Ren 006; Rongjie Huang 001; Dongchao Yang; Zhenhui Ye; Chen Zhang 020; Jinglin Liu; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Detector Guidance for Multi-Object Text-to-Image Generation. - Luping Liu; Zijian Zhang 002; Yi Ren 006; Rongjie Huang 001; Xiang Yin 006; Zhou Zhao 001 (CoRR, 2023)

Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis. - Zhenhui Ye; Ziyue Jiang 001; Yi Ren 006; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias. - Ziyue Jiang 001; Yi Ren 006; Zhenhui Ye; Jinglin Liu; Chen Zhang 020; Qian Yang 006; Shengpeng Ji; Rongjie Huang 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Mega-TTS 2: Zero-Shot Text-to-Speech with Arbitrary Length Speech Prompts. - Ziyue Jiang 001; Jinglin Liu; Yi Ren 006; Jinzheng He; Chen Zhang 020; Zhenhui Ye; Pengfei Wei 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

C2G2: Controllable Co-speech Gesture Generation with Latent Diffusion Model. - Longbin Ji; Pengfei Wei 001; Yi Ren 006; Jinglin Liu; Chen Zhang 020; Xiang Yin 006 (CoRR, 2023)

EnchantDance: Unveiling the Potential of Music-Driven Dance Movement. - Bo Han; Yi Ren 006; Hao Peng; Teng Zhang; Zeyu Ling; Xiang Yin 006; Feilin Han (CoRR, 2023)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. - Rongjie Huang 001; Mingze Li; Dongchao Yang; Jiatong Shi; Xuankai Chang; Zhenhui Ye; Yuning Wu 001; Zhiqing Hong; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Yuexian Zou; et al. (AAAI, 2024)

Emotion Rendering for Conversational Speech Synthesis with Heterogeneous Graph-Based Context Modeling. - Rui Liu 008; Yifan Hu; Yi Ren 006; Xiang Yin 006; Haizhou Li 001 (AAAI, 2024)

Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis. - Ziyue Jiang 001; Jinglin Liu; Yi Ren 006; Jinzheng He; Zhenhui Ye; Shengpeng Ji; Qian Yang 006; Chen Zhang 020; Pengfei Wei 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; et al. (ICLR, 2024)

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Jiaqi Yang 008; Weichuang Li; Jiawei Huang 008; Ziyue Jiang 001; Jinzheng He; Rongjie Huang 001; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; et al. (ICLR, 2024)

Generative Expressive Conversational Speech Synthesis. - Rui Liu 008; Yifan Hu; Yi Ren 006; Xiang Yin 006; Haizhou Li 001 (ACM Multimedia, 2024)

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Ziyue Jiang 001; Jiawei Huang 008; Rongjie Huang 001; Jinglin Liu; Jinzheng He; Chen Zhang 020; Zehan Wang 001; Xize Cheng; Xiang Yin 006; et al. (NeurIPS, 2024)

The RoboDrive Challenge: Drive Anytime Anywhere in Any Condition. - Lingdong Kong; Shaoyuan Xie; Hanjiang Hu; Yaru Niu; Wei Tsang Ooi; Benoit R. Cottereau; Lai Xing Ng; Yuexin Ma; Wenwei Zhang; Liang Pan; Kai Chen 026; Ziwei Liu 002; et al. (CoRR, 2024)

MulliVC: Multi-lingual Voice Conversion With Cycle Consistency. - Jiawei Huang 008; Chen Zhang 020; Yi Ren 006; Ziyue Jiang 001; Zhenhui Ye; Jinglin Liu; Jinzheng He; Xiang Yin 006; Zhou Zhao 001 (CoRR, 2024)

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Ziyue Jiang 001; Jiawei Huang 008; Rongjie Huang 001; Jinglin Liu; Jinzheng He; Chen Zhang 020; Zehan Wang 001; Xize Chen; Xiang Yin 006; et al. (CoRR, 2024)

RefXVC: Cross-Lingual Voice Conversion With Enhanced Reference Leveraging. - Mingyang Zhang 003; Yi Zhou 020; Yi Ren 006; Chen Zhang 020; Xiang Yin 006; Haizhou Li 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

SDMuse: Stochastic Differential Music Editing and Generation via Hybrid Representation. - Chen Zhang 020; Yi Ren 006; Kejun Zhang; Shuicheng Yan (IEEE Trans. Multim., 2024)

Retinal vessels segmentation method based on dynamic threshold neural P systems with orientation feedback. - Can Jiang; Yi Ren 006; Bo Yang 054; Hong Peng 001; Xiaohui Luo (J. Membr. Comput., 2024)

Chain-Talker: Chain Understanding and Rendering for Empathetic Conversational Speech Synthesis. - Yifan Hu; Rui Liu 008; Yi Ren 006; Xiang Yin 006; Haizhou Li 001 (ACL (Findings), 2025)

HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation. - Qijun Gan; Yi Ren 006; Chen Zhang 020; Zhenhui Ye; Pan Xie; Xiang Yin 006; Zehuan Yuan; Bingyue Peng; Jianke Zhu (CoRR, 2025)

Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis. - Ziyue Jiang 001; Yi Ren 006; Ruiqi Li; Shengpeng Ji; Zhenhui Ye; Chen Zhang 020; Jionghao Bai; Xiaoda Yang; Jialong Zuo; Yu Zhang 126; Rui Liu 008; Xiang Yin 006; et al. (CoRR, 2025)