EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model. - Chenye Cui; Yi Ren 006; Jinglin Liu; Feiyang Chen; Rongjie Huang 001; Ming Lei; Zhou Zhao 001 (Interspeech, 2021)

Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus. - Rongjie Huang 001; Feiyang Chen; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (ACM Multimedia, 2021)

Bilateral Denoising Diffusion Models. - Max W. Y. Lam; Jun Wang 091; Rongjie Huang 001; Dan Su 002; Dong Yu 001 (CoRR, 2021)

SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation. - Feiyang Chen; Rongjie Huang 001; Chenye Cui; Yi Ren 006; Jinglin Liu; Zhou Zhao 001; Nicholas Jing Yuan; Baoxing Huai (CoRR, 2021)

FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis. - Rongjie Huang 001; Max W. Y. Lam; Jun Wang 091; Dan Su 002; Dong Yu 001; Yi Ren 006; Zhou Zhao 001 (IJCAI, 2022)

SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation. - Rongjie Huang 001; Chenye Cui; Feiyang Chen; Yi Ren 006; Jinglin Liu; Zhou Zhao 001; Baoxing Huai; Zhefeng Wang 001 (ACM Multimedia, 2022)

ProDiff: Progressive Fast Diffusion Model for High-Quality Text-to-Speech. - Rongjie Huang 001; Zhou Zhao 001; Huadai Liu; Jinglin Liu; Chenye Cui; Yi Ren 006 (ACM Multimedia, 2022)

GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech. - Rongjie Huang 001; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (NeurIPS, 2022)

M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus. - Lichao Zhang; Ruiqi Li; Shoutong Wang; Liqun Deng; Jinglin Liu; Yi Ren 006; Jinzheng He; Rongjie Huang 001; Jieming Zhu; Xiao Chen; Zhou Zhao 001 (NeurIPS, 2022)

GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech Synthesis. - Rongjie Huang 001; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (CoRR, 2022)

VarietySound: Timbre-Controllable Video to Sound Generation via Unsupervised Information Disentanglement. - Chenye Cui; Yi Ren 006; Jinglin Liu; Rongjie Huang 001; Zhou Zhao 001 (CoRR, 2022)

RMSSinger: Realistic-Music-Score based Singing Voice Synthesis. - Jinzheng He; Jinglin Liu; Zhenhui Ye; Rongjie Huang 001; Chenye Cui; Huadai Liu; Zhou Zhao 001 (ACL (Findings), 2023)

FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis. - Rongjie Huang 001; Yi Ren 006; Ziyue Jiang 001; Chenye Cui; Jinglin Liu; Zhou Zhao 001 (ACL (Findings), 2023)

AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation. - Rongjie Huang 001; Huadai Liu; Xize Cheng; Yi Ren 006; Linjun Li; Zhenhui Ye; Jinzheng He; Lichao Zhang; Jinglin Liu; Xiang Yin 006; Zhou Zhao 001 (ACL (1), 2023)

Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech. - Rongjie Huang 001; Chunlei Zhang; Yi Ren 006; Zhou Zhao 001; Dong Yu 001 (ACL (Findings), 2023)

FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models. - Ziyue Jiang 001; Qian Yang 006; Jialong Zuo; Zhenhui Ye; Rongjie Huang 001; Yi Ren 006; Zhou Zhao 001 (ACL (Findings), 2023)

AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment. - Ruiqi Li; Rongjie Huang 001; Lichao Zhang; Jinglin Liu; Zhou Zhao 001 (ACL (Findings), 2023)

Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation. - Linjun Li; Tao Jin 004; Xize Cheng; Ye Wang 018; Wang Lin; Rongjie Huang 001; Zhou Zhao 001 (ACL (Findings), 2023)

CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training. - Zhenhui Ye; Rongjie Huang 001; Yi Ren 006; Ziyue Jiang 001; Jinglin Liu; Jinzheng He; Xiang Yin 006; Zhou Zhao 001 (ACL (1), 2023)

ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer. - Huadai Liu; Rongjie Huang 001; Xuan Lin; Wenqiang Xu; Maozong Zheng; Hong Chen 002; Jinzheng He; Zhou Zhao 001 (EMNLP, 2023)

VarietySound: Timbre-Controllable Video to Sound Generation Via Unsupervised Information Disentanglement. - Chenye Cui; Zhou Zhao 001; Yi Ren 006; Jinglin Liu; Rongjie Huang 001; Feiyang Chen; Zhefeng Wang 001; Baoxing Huai; Fei Wu 001 (ICASSP, 2023)

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition. - Xize Cheng; Tao Jin 004; Rongjie Huang 001; Linjun Li; Wang Lin; Zehan Wang 001; Ye Wang 018; Huadai Liu; Aoxiong Yin; Zhou Zhao 001 (ICCV, 2023)

TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation. - Rongjie Huang 001; Jinglin Liu; Huadai Liu; Yi Ren 006; Lichao Zhang; Jinzheng He; Zhou Zhao 001 (ICLR, 2023)

Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models. - Rongjie Huang 001; Jiawei Huang 008; Dongchao Yang; Yi Ren 006; Luping Liu; Mingze Li; Zhenhui Ye; Jinglin Liu; Xiang Yin 006; Zhou Zhao 001 (ICML, 2023)

UniSinger: Unified End-to-End Singing Voice Synthesis With Cross-Modality Information Matching. - Zhiqing Hong; Chenye Cui; Rongjie Huang 001; Lichao Zhang; Jinglin Liu; Jinzheng He; Zhou Zhao 001 (ACM Multimedia, 2023)

InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Prompt. - Dongchao Yang; Songxiang Liu; Rongjie Huang 001; Guangzhi Lei; Chao Weng; Helen Meng; Dong Yu 001 (CoRR, 2023)

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition. - Xize Cheng; Linjun Li; Tao Jin 004; Rongjie Huang 001; Wang Lin; Zehan Wang 001; Huangdai Liu; Ye Wang 018; Aoxiong Yin; Zhou Zhao 001 (CoRR, 2023)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. - Rongjie Huang 001; Mingze Li; Dongchao Yang; Jiatong Shi; Xuankai Chang; Zhenhui Ye; Yuning Wu 001; Zhiqing Hong; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Zhou Zhao 001; et al. (CoRR, 2023)

GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation. - Zhenhui Ye; Jinzheng He; Ziyue Jiang 001; Rongjie Huang 001; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

HiFi-Codec: Group-residual Vector quantization for High Fidelity Audio Codec. - Dongchao Yang; Songxiang Liu; Rongjie Huang 001; Jinchuan Tian; Chao Weng; Yuexian Zou (CoRR, 2023)

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation. - Jiawei Huang 008; Yi Ren 006; Rongjie Huang 001; Dongchao Yang; Zhenhui Ye; Chen Zhang 020; Jinglin Liu; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Make-A-Voice: Unified Voice Synthesis With Discrete Representation. - Rongjie Huang 001; Chunlei Zhang; Yongqi Wang; Dongchao Yang; Luping Liu; Zhenhui Ye; Ziyue Jiang 001; Chao Weng; Zhou Zhao 001; Dong Yu 001 (CoRR, 2023)

Detector Guidance for Multi-Object Text-to-Image Generation. - Luping Liu; Zijian Zhang 002; Yi Ren 006; Rongjie Huang 001; Xiang Yin 006; Zhou Zhao 001 (CoRR, 2023)

Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias. - Ziyue Jiang 001; Yi Ren 006; Zhenhui Ye; Jinglin Liu; Chen Zhang 020; Qian Yang 006; Shengpeng Ji; Rongjie Huang 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

UniAudio: An Audio Foundation Model Toward Universal Audio Generation. - Dongchao Yang; Jinchuan Tian; Xu Tan 003; Rongjie Huang 001; Songxiang Liu; Xuankai Chang; Jiatong Shi; Sheng Zhao; Jiang Bian 002; Xixin Wu; Zhou Zhao 001; Shinji Watanabe 001; et al. (CoRR, 2023)

Chat-3D v2: Bridging 3D Scene and Large Language Models with Object Identifiers. - Haifeng Huang; Zehan Wang 001; Rongjie Huang 001; Luping Liu; Xize Cheng; Yang Zhao 022; Tao Jin 004; Zhou Zhao 001 (CoRR, 2023)

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation. - Xize Cheng; Rongjie Huang 001; Linjun Li; Tao Jin 004; Zehan Wang 001; Aoxiong Yin; Minglei Li; Xinyu Duan; Changpeng Yang; Zhou Zhao 001 (CoRR, 2023)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. - Rongjie Huang 001; Mingze Li; Dongchao Yang; Jiatong Shi; Xuankai Chang; Zhenhui Ye; Yuning Wu 001; Zhiqing Hong; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Yuexian Zou; et al. (AAAI, 2024)

StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis. - Yu Zhang 126; Rongjie Huang 001; Ruiqi Li; Jinzheng He; Yan Xia 006; Feiyang Chen; Xinyu Duan; Baoxing Huai; Zhou Zhao 001 (AAAI, 2024)

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation. - Xize Cheng; Rongjie Huang 001; Linjun Li; Zehan Wang 001; Tao Jin 004; Aoxiong Yin; Feiyang Chen; Xinyu Duan; Baoxing Huai; Zhou Zhao 001 (ACL (Findings), 2024)

Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment. - Zhiqing Hong; Rongjie Huang 001; Xize Cheng; Yongqi Wang; Ruiqi Li; Fuming You; Zhou Zhao 001; Zhimeng Zhang (ACL (1), 2024)

Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners. - Rongjie Huang 001; Chunlei Zhang; Yongqi Wang; Dongchao Yang; Jinchuan Tian; Zhenhui Ye; Luping Liu; Zehan Wang 001; Ziyue Jiang 001; Xuankai Chang; Jiatong Shi; Chao Weng; et al. (ACL (1), 2024)

Robust Singing Voice Transcription Serves Synthesis. - Ruiqi Li; Yu Zhang 126; Yongqi Wang; Zhiqing Hong; Rongjie Huang 001; Zhou Zhao 001 (ACL (1), 2024)

Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion. - Ruiqi Li; Rongjie Huang 001; Yongqi Wang; Zhiqing Hong; Zhou Zhao 001 (ACL (Findings), 2024)

Wav2SQL: Direct Generalizable Speech-To-SQL Parsing. - Huadai Liu; Rongjie Huang 001; Jinzheng He; Gang Sun 004; Ran Shen; Xize Cheng; Zhou Zhao 001 (ACL (Findings), 2024)

Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer. - Yongqi Wang; Jionghao Bai; Rongjie Huang 001; Ruiqi Li; Zhiqing Hong; Zhou Zhao 001 (ACL (Student Research Workshop), 2024)

TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control. - Yu Zhang 126; Ziyue Jiang 001; Ruiqi Li; Changhao Pan; Jinzheng He; Rongjie Huang 001; Chuxin Wang; Zhou Zhao 001 (EMNLP, 2024)

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Jiaqi Yang 008; Weichuang Li; Jiawei Huang 008; Ziyue Jiang 001; Jinzheng He; Rongjie Huang 001; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; et al. (ICLR, 2024)

FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion. - Zehan Wang 001; Ziang Zhang; Xize Cheng; Rongjie Huang 001; Luping Liu; Zhenhui Ye; Haifeng Huang; Yang Zhao 022; Tao Jin 004; Peng Gao 007; Zhou Zhao 001 (ICML, 2024)

InstructSpeech: Following Speech Editing Instructions via Large Language Models. - Rongjie Huang 001; Ruofan Hu; Yongqi Wang; Zehan Wang 001; Xize Cheng; Ziyue Jiang 001; Zhenhui Ye; Dongchao Yang; Luping Liu; Peng Gao 007; Zhou Zhao 001 (ICML, 2024)

UniAudio: Towards Universal Audio Generation with Large Language Models. - Dongchao Yang; Jinchuan Tian; Xu Tan 003; Rongjie Huang 001; Songxiang Liu; Haohan Guo; Xuankai Chang; Jiatong Shi; Sheng Zhao; Jiang Bian 002; Zhou Zhao 001; Xixin Wu; et al. (ICML, 2024)

VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation. - Rongjie Huang 001; Yongqi Wang; Ruofan Hu; Xiaoshan Xu; Zhiqing Hong; Dongchao Yang; Xize Cheng; Zehan Wang 001; Ziyue Jiang 001; Zhenhui Ye; Luping Liu; Siqi Zheng; et al. (ACM Multimedia, 2024)

AudioLCM: Efficient and High-Quality Text-to-Audio Generation with Minimal Inference Steps. - Huadai Liu; Rongjie Huang 001; Yang Liu 278; Hengyuan Cao; Jialei Wang; Xize Cheng; Siqi Zheng; Zhou Zhao 001 (ACM Multimedia, 2024)

Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt. - Yongqi Wang; Ruofan Hu; Rongjie Huang 001; Zhiqing Hong; Ruiqi Li; Wenrui Liu 003; Fuming You; Tao Jin 004; Zhou Zhao 001 (NAACL-HLT, 2024)

Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers. - Haifeng Huang; Yilun Chen; Zehan Wang 001; Rongjie Huang 001; Runsen Xu; Tai Wang; Luping Liu; Xize Cheng; Yang Zhao 022; Jiangmiao Pang; Zhou Zhao 001 (NeurIPS, 2024)

Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching. - Yongqi Wang; Wenxiang Guo; Rongjie Huang 001; Jiawei Huang 008; Zehan Wang 001; Fuming You; Ruiqi Li; Zhou Zhao 001 (NeurIPS, 2024)

UniAudio 1.5: Large Language Model-Driven Audio Codec is A Few-Shot Audio Task Learner. - Dongchao Yang; Haohan Guo; Yuanyuan Wang; Rongjie Huang 001; Xiang Li; Xu Tan 003; Xixin Wu; Helen Meng (NeurIPS, 2024)

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Ziyue Jiang 001; Jiawei Huang 008; Rongjie Huang 001; Jinglin Liu; Jinzheng He; Chen Zhang 020; Zehan Wang 001; Xize Cheng; Xiang Yin 006; et al. (NeurIPS, 2024)

MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence. - Fuming You; Minghui Fang 002; Li Tang; Rongjie Huang 001; Yongqi Wang; Zhou Zhao 001 (NeurIPS, 2024)

Extending Multi-modal Contrastive Representations. - Ziang Zhang; Zehan Wang 001; Luping Liu; Rongjie Huang 001; Xize Cheng; Zhenhui Ye; Wang Lin; Huadai Liu; Haifeng Huang; Yang Zhao 022; Tao Jin 004; Siqi Zheng; et al. (NeurIPS, 2024)

Lumina-Next : Making Lumina-T2X Stronger and Faster with Next-DiT. - Le Zhuo; Ruoyi Du; Han Xiao 010; Yangguang Li 001; Dongyang Liu; Rongjie Huang 001; Wenze Liu; Xiangyang Zhu; Fu-Yun Wang; Zhanyu Ma; Xu Luo; Zehan Wang 001; et al. (NeurIPS, 2024)

Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models. - Shengpeng Ji; Minghui Fang 002; Ziyue Jiang 001; Rongjie Huang 001; Jialong Zuo; Shulei Wang; Zhou Zhao 001 (CoRR, 2024)

Text-to-Song: Towards Controllable Music Generation Incorporating Vocals and Accompaniment. - Zhiqing Hong; Rongjie Huang 001; Xize Cheng; Yongqi Wang; Ruiqi Li; Fuming You; Zhou Zhao 001; Zhimeng Zhang (CoRR, 2024)

Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers. - Peng Gao 007; Le Zhuo; Dongyang Liu; Ruoyi Du; Xu Luo; Longtian Qiu; Yuhang Zhang; Chen Lin; Rongjie Huang 001; Shijie Geng; Renrui Zhang; Junlin Xi; et al. (CoRR, 2024)

Frieren: Efficient Video-to-Audio Generation with Rectified Flow Matching. - Yongqi Wang; Wenxiang Guo; Rongjie Huang 001; Jiawei Huang 008; Zehan Wang 001; Fuming You; Ruiqi Li; Zhou Zhao 001 (CoRR, 2024)

AudioLCM: Text-to-Audio Generation with Latent Consistency Models. - Huadai Liu; Rongjie Huang 001; Yang Liu 278; Hengyuan Cao; Jialei Wang; Xize Cheng; Siqi Zheng; Zhou Zhao 001 (CoRR, 2024)

ControlSpeech: Towards Simultaneous Zero-shot Speaker Cloning and Zero-shot Language Style Control With Decoupled Codec. - Shengpeng Ji; Jialong Zuo; Minghui Fang 002; Siqi Zheng; Qian Chen 003; Wen Wang 001; Ziyue Jiang 001; Hai Huang 013; Xize Cheng; Rongjie Huang 001; Zhou Zhao 001 (CoRR, 2024)

Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiT. - Le Zhuo; Ruoyi Du; Han Xiao 010; Yangguang Li 001; Dongyang Liu; Rongjie Huang 001; Wenze Liu; Lirui Zhao; Fu-Yun Wang; Zhanyu Ma; Xu Luo; Zehan Wang 001; et al. (CoRR, 2024)

Accompanied Singing Voice Synthesis with Fully Text-controlled Melody. - Ruiqi Li; Zhiqing Hong; Yongqi Wang; Lichao Zhang; Rongjie Huang 001; Siqi Zheng; Zhou Zhao 001 (CoRR, 2024)

OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces. - Zehan Wang 001; Ziang Zhang; Hang Zhang; Luping Liu; Rongjie Huang 001; Xize Cheng; Hengshuang Zhao; Zhou Zhao 001 (CoRR, 2024)

MEDIC: Zero-shot Music Editing with Disentangled Inversion Control. - Huadai Liu; Jialei Wang; Rongjie Huang 001; Yang Liu 278; Jiayang Xu; Zhou Zhao 001 (CoRR, 2024)

Integrating Audio, Visual, and Semantic Information for Enhanced Multimodal Speaker Diarization. - Luyao Cheng; Hui Wang 030; Siqi Zheng; Yafeng Chen; Rongjie Huang 001; Qinglin Zhang; Qian Chen 003; Xihao Li (CoRR, 2024)

SimpleSpeech 2: Towards Simple and Efficient Text-to-Speech with Flow-based Scalar Latent Transformer Diffusion Models. - Dongchao Yang; Rongjie Huang 001; Yuanyuan Wang; Haohan Guo; Dading Chong; Songxiang Liu; Xixin Wu; Helen Meng (CoRR, 2024)

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling. - Shengpeng Ji; Ziyue Jiang 001; Xize Cheng; Yifu Chen; Minghui Fang 002; Jialong Zuo; Qian Yang 006; Ruiqi Li; Ziang Zhang; Xiaoda Yang; Rongjie Huang 001; Yidi Jiang; et al. (CoRR, 2024)

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Ziyue Jiang 001; Jiawei Huang 008; Rongjie Huang 001; Jinglin Liu; Jinzheng He; Chen Zhang 020; Zehan Wang 001; Xize Chen; Xiang Yin 006; et al. (CoRR, 2024)

FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation. - Huadai Liu; Jialei Wang; Rongjie Huang 001; Yang Liu 278; Heng Lu; Wei Xue 002; Zhou Zhao 001 (CoRR, 2024)

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup. - Xize Cheng; Siqi Zheng; Zehan Wang 001; Minghui Fang 002; Ziang Zhang; Rongjie Huang 001; Ziyang Ma; Shengpeng Ji; Jialong Zuo; Tao Jin 004; Zhou Zhao 001 (CoRR, 2024)

InstructTTS: Modelling Expressive TTS in Discrete Latent Space With Natural Language Style Prompt. - Dongchao Yang; Songxiang Liu; Rongjie Huang 001; Chao Weng; Helen Meng (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching. - Wenxiang Guo; Yu Zhang 126; Changhao Pan; Rongjie Huang 001; Li Tang; Ruiqi Li; Zhiqing Hong; Yongqi Wang; Zhou Zhao 001 (AAAI, 2025)

FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation. - Huadai Liu; Jialei Wang; Rongjie Huang 001; Yang Liu 278; Heng Lu; Zhou Zhao 001; Wei Xue 002 (ACL (1), 2025)

NAT3DSound: 3D Spatial Sound Field Synthesis with Multi-Modal Non-Autoregressive Transformer. - Fuming You; Rongjie Huang 001; Boyang Zhang; Yongqi Wang; Zhiqing Hong; Zhimeng Zhang; Zhou Zhao 001 (ICASSP, 2025)

OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces. - Zehan Wang 001; Ziang Zhang; Minjie Hong; Hang Zhang; Luping Liu; Rongjie Huang 001; Xize Cheng; Shengpeng Ji; Tao Jin 004; Hengshuang Zhao; Zhou Zhao 001 (ICLR, 2025)

VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words? - Xize Cheng; Ruofan Hu; Xiaoda Yang; Jingyu Lu; Dongjie Fu; Zehan Wang 001; Shengpeng Ji; Rongjie Huang 001; Boyang Zhang; Tao Jin 004; Zhou Zhao 001 (ICLR, 2025)

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup. - Xize Cheng; Siqi Zheng; Zehan Wang 001; Minghui Fang 002; Ziang Zhang; Rongjie Huang 001; Shengpeng Ji; Jialong Zuo; Tao Jin 004; Zhou Zhao 001 (ICLR, 2025)

Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation. - Peng Gao 007; Le Zhuo; Dongyang Liu; Ruoyi Du; Xu Luo; Longtian Qiu; Yuhang Zhang; Rongjie Huang 001; Shijie Geng; Renrui Zhang; Junlin Xie; Wenqi Shao; et al. (ICLR, 2025)

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling. - Shengpeng Ji; Ziyue Jiang 001; Wen Wang 001; Yifu Chen; Minghui Fang 002; Jialong Zuo; Qian Yang 006; Xize Cheng; Zehan Wang 001; Ruiqi Li; Ziang Zhang; Xiaoda Yang; et al. (ICLR, 2025)

OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios. - Xize Cheng; Dongjie Fu; Xiaoda Yang; Minghui Fang 002; Ruofan Hu; Jingyu Lu; Jionghao Bai; Zehan Wang 001; Shengpeng Ji; Rongjie Huang 001; Linjun Li; Yu Chen; et al. (CoRR, 2025)

OmniAudio: Generating Spatial Audio from 360-Degree Video. - Huadai Liu; Tianyi Luo; Qikai Jiang; Kaicheng Luo; Peiwen Sun; Jialei Wang; Rongjie Huang 001; Qian Chen 003; Wen Wang 001; Xiangtai Li; Shiliang Zhang; Zhijie Yan; et al. (CoRR, 2025)

Unleashing the Power of Natural Audio Featuring Multiple Sound Sources. - Xize Cheng; Slytherin Wang; Zehan Wang 001; Rongjie Huang 001; Tao Jin 004; Zhou Zhao 001 (CoRR, 2025)

Versatile Framework for Song Generation with Prompt-based Control. - Yu Zhang 126; Wenxiang Guo; Changhao Pan; Zhiyuan Zhu; Ruiqi Li; Jingyu Lu; Rongjie Huang 001; Ruiyuan Zhang; Zhiqing Hong; Ziyue Jiang 001; Zhou Zhao 001 (CoRR, 2025)