An Empirical Study of Multilingual Spoken Term Detection. - Zejun Ma 001; Xiaorui Wang; Bo Xu 002 (INTERSPEECH, 2011)

Fusing Multiple Confidence Measures for Chinese Spoken Term Detection. - Zejun Ma 001; Xiaorui Wang; Bo Xu (INTERSPEECH, 2011)

Unsupervised training of subspace gaussian mixture models for conversational telephone speech recognition. - Zejun Ma 001; Xiaorui Wang; Bo Xu 002 (ICASSP, 2012)

Exponential Moving Average Model in Parallel Speech Recognition Training. - Xu Tian; Jun Zhang 066; Zejun Ma 001; Yi He; Juan Wei (CoRR, 2017)

Frame Stacking and Retaining for Recurrent Neural Network Acoustic Model. - Xu Tian; Jun Zhang 066; Zejun Ma 001; Yi He; Juan Wei (CoRR, 2017)

Deep LSTM for Large Vocabulary Continuous Speech Recognition. - Xu Tian; Jun Zhang 066; Zejun Ma 001; Yi He; Juan Wei; Peihao Wu; Wenchang Situ; Shuai Li; Yang Zhang 088 (CoRR, 2017)

A Unified Sequence-to-Sequence Front-End Model for Mandarin Text-to-Speech Synthesis. - Junjie Pan; Xiang Yin 006; Zhiling Zhang; Shichao Liu 003; Yang Zhang 088; Zejun Ma 001; Yuxuan Wang 002 (ICASSP, 2020)

A Hybrid Text Normalization System Using Multi-Head Self-Attention For Mandarin. - Junhui Zhang; Junjie Pan; Xiang Yin 006; Chen Li 042; Shichao Liu 003; Yang Zhang 088; Yuxuan Wang 002; Zejun Ma 001 (ICASSP, 2020)

Improving Accent Conversion with Reference Encoder and End-To-End Text-To-Speech. - Wenjie Li; Benlai Tang; Xiang Yin 006; Yushi Zhao; Wei Li 119; Kang Wang; Hao Huang; Yuxuan Wang 002; Zejun Ma 001 (CoRR, 2020)

Contrastive Unsupervised Learning for Audio Fingerprinting. - Zhesong Yu; Xingjian Du; Bilei Zhu; Zejun Ma 001 (CoRR, 2020)

Dynamic latency speech recognition with asynchronous revision. - Mingkun Huang; Meng Cai; Jun Zhang 066; Yang Zhang 088; Yongbin You; Yi He; Zejun Ma 001 (CoRR, 2020)

Improving RNN transducer with normalized jointer network. - Mingkun Huang; Jun Zhang 066; Meng Cai; Yang Zhang 088; Jiali Yao; Yongbin You; Yi He; Zejun Ma 001 (CoRR, 2020)

Bytecover: Cover Song Identification Via Multi-Loss Training. - Xingjian Du; Zhesong Yu; Bilei Zhu; Xiaoou Chen; Zejun Ma 001 (ICASSP, 2021)

Singing Melody Extraction from Polyphonic Music based on Spectral Correlation Modeling. - Xingjian Du; Bilei Zhu; Qiuqiang Kong; Zejun Ma 001 (ICASSP, 2021)

An Hrnet-Blstm Model With Two-Stage Training For Singing Melody Extraction. - Yongwei Gao; Xingjian Du; Bilei Zhu; Xiaoheng Sun; Wei Li 012; Zejun Ma 001 (ICASSP, 2021)

Rule-Embedded Network for Audio-Visual Voice Activity Detection in Live Musical Video Streams. - Yuanbo Hou; Yi Deng; Bilei Zhu; Zejun Ma 001; Dick Botteldooren (ICASSP, 2021)

PPG-Based Singing Voice Conversion with Adversarial Representation Learning. - Zhonghao Li; Benlai Tang; Xiang Yin 006; Yuan Wan; Ling Xu; Chen Shen 011; Zejun Ma 001 (ICASSP, 2021)

A Chapter-Wise Understanding System for Text-To-Speech in Chinese Novels. - Junjie Pan; Lin Wu; Xiang Yin 006; Pengfei Wu; Chenchang Xu; Zejun Ma 001 (ICASSP, 2021)

Improving RNN Transducer Modeling for Small-Footprint Keyword Spotting. - Yao Tian; Haitao Yao; Meng Cai; Yaming Liu; Zejun Ma 001 (ICASSP, 2021)

Emitting Word Timings with HMM-Free End-to-End System in Automatic Speech Recognition. - Xianzhao Chen; Hao Ni; Yi He; Kang Wang; Zejun Ma 001; Zongxia Xie (Interspeech, 2021)

Attention-Based Cross-Modal Fusion for Audio-Visual Voice Activity Detection in Musical Video Streams. - Yuanbo Hou; Zhesong Yu; Xia Liang; Xingjian Du; Bilei Zhu; Zejun Ma 001; Dick Botteldooren (Interspeech, 2021)

HMM-Free Encoder Pre-Training for Streaming RNN Transducer. - Lu Huang; Jingyu Sun; Yufeng Tang; Junfeng Hou; Jinkun Chen; Jun Zhang 066; Zejun Ma 001 (Interspeech, 2021)

Fine-Grained Prosody Modeling in Neural Speech Synthesis Using ToBI Representation. - Yuxiang Zou; Shichao Liu 003; Xiang Yin 006; Haopeng Lin; Chunfeng Wang; Haoyu Zhang; Zejun Ma 001 (Interspeech, 2021)

ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoders. - Yu Gu; Xiang Yin 006; Yonghui Rao; Yuan Wan; Benlai Tang; Yang Zhang 088; Jitong Chen; Yuxuan Wang 002; Zejun Ma 001 (ISCSLP, 2021)

Towards Realistic Visual Dubbing with Heterogeneous Sources. - Tianyi Xie; Liucheng Liao; Cheng Bi; Benlai Tang; Xiang Yin 006; Jianfei Yang; Mingjie Wang; Jiali Yao; Yang Zhang 088; Zejun Ma 001 (ACM Multimedia, 2021)

Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech. - Pengfei Wu; Junjie Pan; Chenchang Xu; Junhui Zhang; Lin Wu; Xiang Yin 006; Zejun Ma 001 (CoRR, 2021)

Zero-Shot Audio Source Separation through Query-Based Learning from Weakly-Labeled Data. - Ke Chen 021; Xingjian Du; Bilei Zhu; Zejun Ma 001; Taylor Berg-Kirkpatrick; Shlomo Dubnov (AAAI, 2022)

Dynamic Transfer Gaussian Process Regression. - Pengfei Wei 001; Xinghua Qu; Wen Song 004; Zejun Ma 001 (CIKM, 2022)

HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection. - Ke Chen 021; Xingjian Du; Bilei Zhu; Zejun Ma 001; Taylor Berg-Kirkpatrick; Shlomo Dubnov (ICASSP, 2022)

Bytecover2: Towards Dimensionality Reduction of Latent Embedding for Efficient Cover Song Identification. - Xingjian Du; Ke Chen 021; Zijie Wang; Bilei Zhu; Zejun Ma 001 (ICASSP, 2022)

Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection. - Minglun Han; Linhao Dong; Zhenlin Liang; Meng Cai; Shiyu Zhou; Zejun Ma 001; Bo Xu 002 (ICASSP, 2022)

Improving Pseudo-Label Training For End-To-End Speech Recognition Using Gradient Mask. - Shaoshi Ling; Chen Shen 011; Meng Cai; Zejun Ma 001 (ICASSP, 2022)

Language Adaptive Cross-Lingual Speech Representation Learning with Sparse Sharing Sub-Networks. - Yizhou Lu; Mingkun Huang; Xinghua Qu; Pengfei Wei 001; Zejun Ma 001 (ICASSP, 2022)

The Volcspeech System for the ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challenge. - Chen Shen 011; Yi Liu; Wenzhi Fan; Bin Wang; Shixue Wen; Yao Tian; Jun Zhang 066; Jingsheng Yang; Zejun Ma 001 (ICASSP, 2022)

Towards Using Clothes Style Transfer for Scenario-Aware Person Video Generation. - Jingning Xu; Benlai Tang; Mingjie Wang; Siyuan Bian; Wenyi Guo; Xiang Yin 006; Zejun Ma 001 (ICASSP, 2022)

S3T: Self-Supervised Pre-Training with Swin Transformer For Music Classification. - Hang Zhao; Chen Zhang 020; Bilei Zhu; Zejun Ma 001; Kejun Zhang (ICASSP, 2022)

BiFSMN: Binary Neural Network for Keyword Spotting. - Haotong Qin; Xudong Ma; Yifu Ding; Xiaoyang Li; Yang Zhang 088; Yao Tian; Zejun Ma 001; Jie Luo 004; Xianglong Liu 001 (IJCAI, 2022)

Token-level Speaker Change Detection Using Speaker Difference and Speech Content via Continuous Integrate-and-fire. - Zhiyun Fan; Zhenlin Liang; Linhao Dong; Yi Liu; Shiyu Zhou; Meng Cai; Jun Zhang 066; Zejun Ma 001; Bo Xu (INTERSPEECH, 2022)

Using Fluency Representation Learned from Sequential Raw Features for Improving Non-native Fluency Scoring. - Kaiqi Fu; Shaojun Gao; Xiaohai Tian; Wei Li 119; Zejun Ma 001 (INTERSPEECH, 2022)

Bring dialogue-context into RNN-T for streaming ASR. - Junfeng Hou; Jinkun Chen; Wanyu Li; Yufeng Tang; Jun Zhang 066; Zejun Ma 001 (INTERSPEECH, 2022)

Internal Language Model Estimation Through Explicit Context Vector Learning for Attention-based Encoder-decoder ASR. - Yufei Liu; Rao Ma; Haihua Xu 001; Yi He; Zejun Ma 001; Weibin Zhang (INTERSPEECH, 2022)

A Transfer and Multi-Task Learning based Approach for MOS Prediction. - Xiaohai Tian; Kaiqi Fu; Shaojun Gao; Yiwei Gu; Kai Wang; Wei Li 119; Zejun Ma 001 (INTERSPEECH, 2022)

Towards high-fidelity singing voice conversion with acoustic reference and contrastive predictive coding. - Chao Wang; Zhonghao Li; Benlai Tang; Xiang Yin 006; Yuan Wan; Yibiao Yu; Zejun Ma 001 (INTERSPEECH, 2022)

Latent feature augmentation for chorus detection. - Xingjian Du; Huidong Liang; Yuan Wan; Yuheng Lin; Ke Chen 021; Bilei Zhu; Zejun Ma 001 (ISMIR, 2022)

Importance Prioritized Policy Distillation. - Xinghua Qu; Yew Soon Ong; Abhishek Gupta 001; Pengfei Wei 001; Zhu Sun 001; Zejun Ma 001 (KDD, 2022)

Synthesising Audio Adversarial Examples for Automatic Speech Recognition. - Xinghua Qu; Pengfei Wei 001; Mingyong Gao; Zhu Sun 001; Yew Soon Ong; Zejun Ma 001 (KDD, 2022)

GIO: A Timbre-informed Approach for Pitch Tracking in Highly Noisy Environments. - Xiaoheng Sun; Xia Liang; Qiqi He; Bilei Zhu; Zejun Ma 001 (ICMR, 2022)

Improving Contextual Representation with Gloss Regularized Pre-training. - Yu Lin; Zhecheng An; Peihao Wu; Zejun Ma 001 (NAACL-HLT (Findings), 2022)

S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification. - Hang Zhao; Chen Zhang 020; Belei Zhu; Zejun Ma 001; Kejun Zhang (CoRR, 2022)

Improving Non-native Word-level Pronunciation Scoring with Phone-level Mixup Data Augmentation and Multi-source Information. - Kaiqi Fu; Shaojun Gao; Kai Wang; Wei Li 119; Xiaohai Tian; Zejun Ma 001 (CoRR, 2022)

A Novel Chinese Dialect TTS Frontend with Non-Autoregressive Neural Machine Translation. - Wudi Bao; Junhui Zhang; Junjie Pan; Xiang Yin 006; Zejun Ma 001 (CoRR, 2022)

Unsupervised Video Domain Adaptation: A Disentanglement Perspective. - Pengfei Wei 001; Lingdong Kong; Xinghua Qu; Xiang Yin 006; Zhiqiang Xu 003; Jing Jiang 002; Zejun Ma 001 (CoRR, 2022)

Improving short-video speech recognition using random utterance concatenation. - Haihua Xu 001; Van Tung Pham; Yerbolat Khassanov; Yist Y. Lin; Tao Han; Tze Yuang Chong; Yi He; Zejun Ma 001 (CoRR, 2022)

Direct Speech-to-speech Translation without Textual Annotation using Bottleneck Features. - Junhui Zhang; Junjie Pan; Xiang Yin 006; Zejun Ma 001 (CoRR, 2022)

Sequence-Level Speaker Change Detection With Difference-Based Continuous Integrate-and-Fire. - Zhiyun Fan; Linhao Dong; Meng Cai; Zejun Ma 001; Bo Xu 002 (IEEE Signal Process. Lett., 2022)

CIF-PT: Bridging Speech and Text Representations for Spoken Language Understanding via Continuous Integrate-and-Fire Pre-Training. - Linhao Dong; Zhecheng An; Peihao Wu; Jun Zhang 066; Lu Lu 015; Zejun Ma 001 (ACL (Findings), 2023)

Improving Large-Scale Deep Biasing With Phoneme Features and Text-Only Data in Streaming Transducer. - Jin Qiu; Lu Huang; Boyu Li; Jun Zhang 066; Lu Lu 015; Zejun Ma 001 (ASRU, 2023)

Bytecover3: Accurate Cover Song Identification On Short Queries. - Xingjian Du; Zijie Wang; Xia Liang; Huidong Liang; Bilei Zhu; Zejun Ma 001 (ICASSP, 2023)

Leveraging Phone-Level Linguistic-Acoustic Similarity For Utterance-Level Pronunciation Scoring. - Wei Liu 147; Kaiqi Fu; Xiaohai Tian; Shuju Shi; Wei Li 119; Zejun Ma 001; Tan Lee 001 (ICASSP, 2023)

An ASR-Free Fluency Scoring Approach with Self-Supervised Learning. - Wei Liu 147; Kaiqi Fu; Xiaohai Tian; Shuju Shi; Wei Li 119; Zejun Ma 001; Tan Lee 001 (ICASSP, 2023)

Internal Language Model Estimation Based Adaptive Language Model Fusion for Domain Adaptation. - Rao Ma; Xiaobo Wu; Jin Qiu; Yanan Qin; Haihua Xu 001; Peihao Wu; Zejun Ma 001 (ICASSP, 2023)

LiteG2P: A Fast, Light and High Accuracy Model for Grapheme-to-Phoneme Conversion. - Chunfeng Wang; Peisong Huang; Yuxiang Zou; Haoyu Zhang; Shichao Liu 003; Xiang Yin 006; Zejun Ma 001 (ICASSP, 2023)

Virtual Try-On with Pose-Garment Keypoints Guided Inpainting. - Zhi Li; Pengfei Wei 001; Xiang Yin 006; Zejun Ma 001; Alex C. Kot (ICCV, 2023)

AudioQR: Deep Neural Audio Watermarks For QR Code. - Xinghua Qu; Xiang Yin 006; Pengfei Wei 001; Lu Lu 015; Zejun Ma 001 (IJCAI, 2023)

Improving Frame-level Classifier for Word Timings with Non-peaky CTC in End-to-End Automatic Speech Recognition. - Xianzhao Chen; Yist Y. Lin; Kang Wang; Yi He; Zejun Ma 001 (INTERSPEECH, 2023)

Knowledge Distillation Approach for Efficient Internal Language Model Estimation. - Zhipeng Chen; Haihua Xu 001; Yerbolat Khassanov; Yi He; Lu Lu 015; Zejun Ma 001; Ji Wu 002 (INTERSPEECH, 2023)

GenerTTS: Pronunciation Disentanglement for Timbre and Style Generalization in Cross-Lingual Text-to-Speech. - Yahuan Cong; Haoyu Zhang; Haopeng Lin; Shichao Liu 003; Chunfeng Wang; Yi Ren 006; Xiang Yin 006; Zejun Ma 001 (INTERSPEECH, 2023)

Language-specific Boundary Learning for Improving Mandarin-English Code-switching Speech Recognition. - Zhiyun Fan; Linhao Dong; Chen Shen 011; Zhenlin Liang; Jun Zhang 066; Lu Lu 015; Zejun Ma 001 (INTERSPEECH, 2023)

Phonetic and Prosody-aware Self-supervised Learning Approach for Non-native Fluency Scoring. - Kaiqi Fu; Shaojun Gao; Shuju Shi; Xiaohai Tian; Wei Li 119; Zejun Ma 001 (INTERSPEECH, 2023)

Text-only Domain Adaptation using Unified Speech-Text Representation in Transducer. - Lu Huang; Boyu Li; Jun Zhang 066; Lu Lu 015; Zejun Ma 001 (INTERSPEECH, 2023)

Random Utterance Concatenation Based Data Augmentation for Improving Short-video Speech Recognition. - Yist Y. Lin; Tao Han; Haihua Xu 001; Van Tung Pham; Yerbolat Khassanov; Tze Yuang Chong; Yi He; Lu Lu 015; Zejun Ma 001 (INTERSPEECH, 2023)

Disentangling the Contribution of Non-native Speech in Automated Pronunciation Assessment. - Shuju Shi; Kaiqi Fu; Yiwei Gu; Xiaohai Tian; Shaojun Gao; Wei Li 119; Zejun Ma 001 (INTERSPEECH, 2023)

StyleS2ST: Zero-shot Style Transfer for Direct Speech-to-speech Translation. - Kun Song; Yi Ren 006; Yi Lei; Chunfeng Wang; Kun Wei; Lei Xie 001; Xiang Yin 006; Zejun Ma 001 (INTERSPEECH, 2023)

S2CD: Self-heuristic Speaker Content Disentanglement for Any-to-Any Voice Conversion. - Pengfei Wei 001; Xiang Yin 006; Chunfeng Wang; Zhonghao Li; Xinghua Qu; Zhiqiang Xu 003; Zejun Ma 001 (INTERSPEECH, 2023)

Emotionally Situated Text-to-Speech Synthesis in User-Agent Conversation. - Yuchen Liu 003; Haoyu Zhang; Shichao Liu 003; Xiang Yin 006; Zejun Ma 001; Qin Jin (ACM Multimedia, 2023)

Towards Building Voice-based Conversational Recommender Systems: Datasets, Potential Solutions and Prospects. - Xinghua Qu; Hongyang Liu; Zhu Sun 001; Xiang Yin 006; Yew Soon Ong; Lu Lu 015; Zejun Ma 001 (SIGIR, 2023)

Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System. - Xinnian Liang; Bing Wang; Hui Huang 021; Shuangzhi Wu; Peihao Wu; Lu Lu 015; Zejun Ma 001; Zhoujun Li 001 (CoRR, 2023)

GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation. - Zhenhui Ye; Jinzheng He; Ziyue Jiang 001; Rongjie Huang 001; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Xiang Yin 006; Zejun Ma 001; Zhou Zhao 001 (CoRR, 2023)

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation. - Jiawei Huang 008; Yi Ren 006; Rongjie Huang 001; Dongchao Yang; Zhenhui Ye; Chen Zhang 020; Jinglin Liu; Xiang Yin 006; Zejun Ma 001; Zhou Zhao 001 (CoRR, 2023)

PolyVoice: Language Models for Speech to Speech Translation. - Qianqian Dong; Zhiying Huang; Qiao Tian 001; Chen Xu 008; Tom Ko; Yunlong Zhao 004; Siyuan Feng; Tang Li 001; Kexin Wang; Xuxin Cheng; Fengpeng Yue; Ye Bai; et al. (CoRR, 2023)

Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis. - Zhenhui Ye; Ziyue Jiang 001; Yi Ren 006; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; Zejun Ma 001; Zhou Zhao 001 (CoRR, 2023)

Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias. - Ziyue Jiang 001; Yi Ren 006; Zhenhui Ye; Jinglin Liu; Chen Zhang 020; Qian Yang 006; Shengpeng Ji; Rongjie Huang 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma 001; Zhou Zhao 001 (CoRR, 2023)

Language-specific Acoustic Boundary Learning for Mandarin-English Code-switching Speech Recognition. - Zhiyun Fan; Linhao Dong; Chen Shen 011; Zhenlin Liang; Jun Zhang 066; Lu Lu 015; Zejun Ma 001 (CoRR, 2023)

Mega-TTS 2: Zero-Shot Text-to-Speech with Arbitrary Length Speech Prompts. - Ziyue Jiang 001; Jinglin Liu; Yi Ren 006; Jinzheng He; Chen Zhang 020; Zhenhui Ye; Pengfei Wei 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma 001; Zhou Zhao 001 (CoRR, 2023)

Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models. - Guangzhi Sun; Wenyi Yu; Changli Tang; Xianzhao Chen; Tian Tan 019; Wei Li 119; Lu Lu 015; Zejun Ma 001; Chao Zhang 031 (CoRR, 2023)

Graph contrastive learning with implicit augmentations. - Huidong Liang; Xingjian Du; Bilei Zhu; Zejun Ma 001; Ke Chen 021; Junbin Gao (Neural Networks, 2023)

Transfer Kernel Learning for Multi-Source Transfer Gaussian Process Regression. - Pengfei Wei 001; Thanh Vinh Vo; Xinghua Qu; Yew Soon Ong; Zejun Ma 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

Adaptive Transfer Kernel Learning for Transfer Gaussian Process Regression. - Pengfei Wei 001; Yiping Ke; Yew-Soon Ong; Zejun Ma 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

SA-SOT: Speaker-Aware Serialized Output Training for Multi-Talker ASR. - Zhiyun Fan; Linhao Dong; Jun Zhang 066; Lu Lu 015; Zejun Ma 001 (ICASSP, 2024)

Extending Multilingual ASR to New Languages Using Supplementary Encoder and Decoder Components. - Yerbolat Khassanov; Zhipeng Chen; Tianfeng Chen; Tze Yuang Chong; Wei Li; Lu Lu; Zejun Ma 001 (ICASSP, 2024)

Extending Large Language Models for Speech and Audio Captioning. - Changli Tang; Wenyi Yu; Guangzhi Sun; Xianzhao Chen; Tian Tan 019; Wei Li 119; Lu Lu 015; Zejun Ma 001; Chao Zhang 031 (ICASSP, 2024)

Connecting Speech Encoder and Large Language Model for ASR. - Wenyi Yu; Changli Tang; Guangzhi Sun; Xianzhao Chen; Tian Tan 019; Wei Li 119; Lu Lu 015; Zejun Ma 001; Chao Zhang 031 (ICASSP, 2024)

Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis. - Ziyue Jiang 001; Jinglin Liu; Yi Ren 006; Jinzheng He; Zhenhui Ye; Shengpeng Ji; Qian Yang 006; Chen Zhang 020; Pengfei Wei 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma 001; et al. (ICLR, 2024)

PolyVoice: Language Models for Speech to Speech Translation. - Qianqian Dong; Zhiying Huang; Qi Tian 001; Chen Xu 008; Tom Ko; Yunlong Zhao 004; Siyuan Feng; Tang Li 001; Kexin Wang; Xuxin Cheng; Fengpeng Yue; Ye Bai; et al. (ICLR, 2024)

SALMONN: Towards Generic Hearing Abilities for Large Language Models. - Changli Tang; Wenyi Yu; Guangzhi Sun; Xianzhao Chen; Tian Tan 019; Wei Li 119; Lu Lu 015; Zejun Ma 001; Chao Zhang 031 (ICLR, 2024)

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Jiaqi Yang 008; Weichuang Li; Jiawei Huang 008; Ziyue Jiang 001; Jinzheng He; Rongjie Huang 001; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; et al. (ICLR, 2024)

video-SALMONN: Speech-Enhanced Audio-Visual Large Language Models. - Guangzhi Sun; Wenyi Yu; Changli Tang; Xianzhao Chen; Tian Tan 019; Wei Li 119; Lu Lu 015; Zejun Ma 001; Yuxuan Wang 002; Chao Zhang 031 (ICML, 2024)

Can Large Language Models Understand Spatial Audio? - Changli Tang; Wenyi Yu; Guangzhi Sun; Xianzhao Chen; Tian Tan 019; Wei Li 119; Jun Zhang 066; Lu Lu 015; Zejun Ma 001; Yuxuan Wang 002; Chao Zhang 031 (INTERSPEECH, 2024)

MINT: Boosting Audio-Language Model via Multi-Target Pre-Training and Instruction Tuning. - Hang Zhao; Yifei Xin; Zhesong Yu; Bilei Zhu; Lu Lu 015; Zejun Ma 001 (INTERSPEECH, 2024)

LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models. - Feng Li 040; Renrui Zhang; Hao Zhang 097; Yuanhan Zhang; Bo Li 080; Wei Li 190; Zejun Ma 001; Chunyuan Li (CoRR, 2024)

Video Instruction Tuning With Synthetic Data. - Yuanhan Zhang; Jinming Wu; Wei Li 190; Bo Li 080; Zejun Ma 001; Ziwei Liu 002; Chunyuan Li (CoRR, 2024)

BiFSMNv2: Pushing Binary Neural Networks for Keyword Spotting to Real-Network Performance. - Haotong Qin; Xudong Ma; Yifu Ding; Xiaoyang Li; Yang Zhang 088; Zejun Ma 001; Jiakai Wang; Jie Luo 004; Xianglong Liu 001 (IEEE Trans. Neural Networks Learn. Syst., 2024)

LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale. - Joya Chen; Ziyun Zeng; Yiqi Lin; Wei Li; Zejun Ma 001; Mike Zheng Shou (CVPR, 2025)

LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models. - Feng Li 040; Renrui Zhang; Hao Zhang 097; Yuanhan Zhang; Bo Li 080; Wei Li 190; Zejun Ma 001; Chunyuan Li (ICLR, 2025)

LLaVA-Video: Video Instruction Tuning With Synthetic Data. - Yuanhan Zhang; Jinming Wu; Wei Li; Bo Li; Zejun Ma 001; Ziwei Liu; Chunyuan Li (Trans. Mach. Learn. Res., 2025)

video-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language Model. - Guangzhi Sun; Yudong Yang; Jimin Zhuang; Changli Tang; Yixuan Li; Wei Li 119; Zejun Ma 001; Chao Zhang 031 (CoRR, 2025)

Improving LLM Video Understanding with 16 Frames Per Second. - Yixuan Li; Changli Tang; Jimin Zhuang; Yudong Yang; Guangzhi Sun; Wei Li 119; Zejun Ma 001; Chao Zhang 031 (CoRR, 2025)

SimpleRL-Zoo: Investigating and Taming Zero Reinforcement Learning for Open Base Models in the Wild. - Weihao Zeng; Yuzhen Huang; Qian Liu 012; Wei Liu 131; Keqing He 001; Zejun Ma 001; Junxian He (CoRR, 2025)

ACVUBench: Audio-Centric Video Understanding Benchmark. - Yudong Yang; Jimin Zhuang; Guangzhi Sun; Changli Tang; Yixuan Li; Peihan Li; Yifan Jiang; Wei Li 119; Zejun Ma 001; Chao Zhang 031 (CoRR, 2025)

General-Reasoner: Advancing LLM Reasoning Across All Domains. - Xueguang Ma; Qian Liu; Dongfu Jiang; Ge Zhang 009; Zejun Ma 001; Wenhu Chen (CoRR, 2025)

video-SALMONN 2: Captioning-Enhanced Audio-Visual Large Language Models. - Changli Tang; Yixuan Li; Yudong Yang; Jimin Zhuang; Guangzhi Sun; Wei Li 119; Zejun Ma 001; Chao Zhang 031 (CoRR, 2025)

ZeCO: Zero Communication Overhead Sequence Parallelism for Linear Attention. - Yuhong Chou; Zehao Liu; Rui-Jie Zhu 003; Xinyi Wan; Tianjian Li; Congying Chu; Qian Liu; Jibin Wu; Zejun Ma 001 (CoRR, 2025)

First Return, Entropy-Eliciting Explore. - Tianyu Zheng; Tianshun Xing; Qingshui Gu; Taoran Liang; Xingwei Qu; Xin Zhou 012; Yizhi Li; Zhoufutu Wen; Chenghua Lin; Wenhao Huang 001; Qian Liu; Ge Zhang 009; et al. (CoRR, 2025)

SWE-Perf: Can Language Models Optimize Code Performance on Real-World Repositories? - Xinyi He; Qian Liu; Mingzhe Du; Lin Yan; Zhijie Fan; Yiming Huang; Zejian Yuan; Zejun Ma 001 (CoRR, 2025)

SimpleTIR: End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning. - Zhenghai Xue; Longtao Zheng; Qian Liu; Yingru Li; Xiaosen Zheng; Zejun Ma 001; Bo An 001 (CoRR, 2025)

video-SALMONN S: Streaming Audio-Visual LLMs Beyond Length Limits via Memory. - Guangzhi Sun; Yixuan Li; Xiaodong Wu; Yudong Yang; Wei Li 119; Zejun Ma 001; Chao Zhang 031 (CoRR, 2025)