Efficient Algorithms for Finding Optimal Meeting Point on Road Networks. - Da Yan 001; Zhou Zhao 001; Wilfred Ng (Proc. VLDB Endow., 2011)

Leveraging read rates of passive RFID tags for real-time indoor location tracking. - Da Yan 001; Zhou Zhao 001; Wilfred Ng (CIKM, 2012)

Monochromatic and bichromatic reverse nearest neighbor queries on land surfaces. - Da Yan 001; Zhou Zhao 001; Wilfred Ng (CIKM, 2012)

A model-based approach for RFID data stream cleansing. - Zhou Zhao 001; Wilfred Ng (CIKM, 2012)

Mining probabilistically frequent sequential patterns in uncertain databases. - Zhou Zhao 001; Da Yan 001; Wilfred Ng (EDBT, 2012)

A probabilistic convex hull query tool. - Zhou Zhao 001; Da Yan 001; Wilfred Ng (EDBT, 2012)

CrowdSeed: query processing on microblogs. - Zhou Zhao 001; Wilfred Ng; Zhijun Zhang (EDBT, 2013)

A transfer learning based framework of crowd-selection on twitter. - Zhou Zhao 001; Da Yan 001; Wilfred Ng; Shi Gao (KDD, 2013)

Truth Discovery in Data Streams: A Single-Pass Probabilistic Approach. - Zhou Zhao 001; James Cheng; Wilfred Ng (CIKM, 2014)

SocialTransfer: Transferring Social Knowledge for Cold-Start Cowdsourcing. - Zhou Zhao 001; James Cheng; Furu Wei; Ming Zhou 001; Wilfred Ng; Yingjun Wu (CIKM, 2014)

Mining Probabilistically Frequent Sequential Patterns in Large Uncertain Databases. - Zhou Zhao 001; Da Yan 001; Wilfred Ng (IEEE Trans. Knowl. Data Eng., 2014)

A Comparative Study of Team Formation in Social Networks. - Xinyu Wang 020; Zhou Zhao 001; Wilfred Ng (DASFAA (1), 2015)

Cold-Start Expert Finding in Community Question Answering via Graph Regularization. - Zhou Zhao 001; Furu Wei; Ming Zhou 001; Wilfred Ng (DASFAA (1), 2015)

Crowd-Selection Query Processing in Crowdsourcing Databases: A Task-Driven Approach. - Zhou Zhao 001; Furu Wei; Ming Zhou 001; Weikeng Chen; Wilfred Ng (EDBT, 2015)

Mobile Query Recommendation via Tensor Function Learning. - Zhou Zhao 001; Ruihua Song; Xing Xie 001; Xiaofei He 001; Yueting Zhuang (IJCAI, 2015)

Deep Compositional Cross-modal Learning to Rank via Local-Global Alignment. - Xinyang Jiang; Fei Wu 001; Xi Li 001; Zhou Zhao 001; Weiming Lu 001; Siliang Tang; Yueting Zhuang (ACM Multimedia, 2015)

Efficient location-based search of trajectories with location importance. - Da Yan 001; James Cheng; Zhou Zhao 001; Wilfred Ng (Knowl. Inf. Syst., 2015)

Efficient processing of optimal meeting point queries in Euclidean space and road networks. - Da Yan 001; Zhou Zhao 001; Wilfred Ng (Knowl. Inf. Syst., 2015)

Probabilistic Convex Hull Queries over Uncertain Data. - Da Yan 001; Zhou Zhao 001; Wilfred Ng; Steven Liu (IEEE Trans. Knowl. Data Eng., 2015)

Expert Finding for Question Answering via Graph Regularized Matrix Completion. - Zhou Zhao 001; Lijun Zhang 005; Xiaofei He 001; Wilfred Ng (IEEE Trans. Knowl. Data Eng., 2015)

Community-Based Question Answering via Heterogeneous Social Network Learning. - Hanyin Fang; Fei Wu 001; Zhou Zhao 001; Xinyu Duan; Yueting Zhuang; Martin Ester (AAAI, 2016)

Crowdsourced Query Processing on Microblogs. - Weikeng Chen; Zhou Zhao 001; Xinyu Wang 020; Wilfred Ng (DASFAA (1), 2016)

Expert Finding for Community-Based Question Answering via Ranking Metric Network Learning. - Zhou Zhao 001; Qifan Yang; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IJCAI, 2016)

Partial Multi-Modal Sparse Coding via Adaptive Similarity Structure Regularization. - Zhou Zhao 001; Hanqing Lu; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (ACM Multimedia, 2016)

User Personalized Satisfaction Prediction via Multiple Instance Deep Learning. - Zheqian Chen; Ben Gao; Huimin Zhang; Zhou Zhao 001; Deng Cai 001 (CoRR, 2016)

Question Retrieval for Community-based Question Answering via Heterogeneous Network Integration Learning. - Zheqian Chen; Chi Zhang; Zhou Zhao 001; Deng Cai 001 (CoRR, 2016)

Social recommendation via multi-view user preference learning. - Hanqing Lu; Chaochao Chen 001; Ming Kong; Hanyi Zhang; Zhou Zhao 001 (Neurocomputing, 2016)

USTF: A Unified System of Team Formation. - Xinyu Wang 020; Zhou Zhao 001; Wilfred Ng (IEEE Trans. Big Data, 2016)

Graph Regularized Feature Selection with Data Reconstruction. - Zhou Zhao 001; Xiaofei He 001; Deng Cai 001; Lijun Zhang 005; Wilfred Ng; Yueting Zhuang (IEEE Trans. Knowl. Data Eng., 2016)

User Preference Learning for Online Social Recommendation. - Zhou Zhao 001; Hanqing Lu; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IEEE Trans. Knowl. Data Eng., 2016)

Semantic Proximity Search on Heterogeneous Graph by Proximity Embedding. - Zemin Liu; Vincent W. Zheng; Zhou Zhao 001; Fanwei Zhu; Kevin Chen-Chuan Chang; Minghui Wu 001; Jing Ying (AAAI, 2017)

Community-Based Question Answering via Asymmetric Multi-Faceted Ranking Network Learning. - Zhou Zhao 001; Hanqing Lu; Vincent W. Zheng; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (AAAI, 2017)

Integrating Side Information for Boosting Machine Comprehension. - Yutong Wang; Yixin Xu; Min Yang 007; Zhou Zhao 001; Jun Xiao 001; Yueting Zhuang (CIKM, 2017)

Dual Learning for Cross-domain Image Captioning. - Wei Zhao 033; Wei Xu; Min Yang 007; Jianbo Ye; Zhou Zhao 001; Yabing Feng; Yu Qiao 001 (CIKM, 2017)

Identifying and Tracking Sentiments and Topics from Social Media Texts during Natural Disasters. - Min Yang 007; Jincheng Mei; Heng Ji; Wei Zhao 033; Zhou Zhao 001; Xiaojun Chen 006 (EMNLP, 2017)

Link Prediction via Ranking Metric Dual-Level Attention Network Learning. - Zhou Zhao 001; Ben Gao; Vincent W. Zheng; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IJCAI, 2017)

Microblog Sentiment Classification via Recurrent Random Walk Network Learning. - Zhou Zhao 001; Hanqing Lu; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IJCAI, 2017)

Video Question Answering via Hierarchical Spatio-Temporal Attention Networks. - Zhou Zhao 001; Qifan Yang; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IJCAI, 2017)

Detecting Temporal Proposal for Action Localization with Tree-structured Search Policy. - Xinyang Jiang; Siliang Tang; Yang Yang 009; Zhou Zhao 001; Yin Zhang 006; Fei Wu 001; Yueting Zhuang (ACM Multimedia, 2017)

Video Question Answering via Gradually Refined Attention over Appearance and Motion. - Dejing Xu; Zhou Zhao 001; Jun Xiao 001; Fei Wu 001; Hanwang Zhang; Xiangnan He 001; Yueting Zhuang (ACM Multimedia, 2017)

Video Question Answering via Hierarchical Dual-Level Attention Network Learning. - Zhou Zhao 001; Jinghao Lin; Xinghua Jiang; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (ACM Multimedia, 2017)

Personalized Response Generation via Domain adaptation. - Min Yang 007; Zhou Zhao 001; Wei Zhao 033; Xiaojun Chen 006; Jia Zhu 003; Lianqiang Zhou; Zigang Cao (SIGIR, 2017)

Video Question Answering via Attribute-Augmented Attention Network Learning. - Yunan Ye; Zhou Zhao 001; Yimeng Li; Long Chen 016; Jun Xiao 001; Yueting Zhuang (SIGIR, 2017)

Learning Max-Margin GeoSocial Multimedia Network Representations for Point-of-Interest Suggestion. - Zhou Zhao 001; Qifan Yang; Hanqing Lu; Min Yang 007; Jun Xiao 001; Fei Wu 001; Yueting Zhuang (SIGIR, 2017)

User Personalized Satisfaction Prediction via Multiple Instance Deep Learning. - Zheqian Chen; Ben Gao; Huimin Zhang; Zhou Zhao 001; Haifeng Liu 001; Deng Cai 001 (WWW, 2017)

MEMEN: Multi-layer Embedding with Memory Networks for Machine Comprehension. - Boyuan Pan; Hao Li 009; Zhou Zhao 001; Bin Cao; Deng Cai 001; Xiaofei He 001 (CoRR, 2017)

The Forgettable-Watcher Model for Video Question Answering. - Hongyang Xue; Zhou Zhao 001; Deng Cai 001 (CoRR, 2017)

Smarnet: Teaching Machines to Read and Comprehend Like Human. - Zheqian Chen; Rongqin Yang; Bin Cao; Zhou Zhao 001; Deng Cai 001; Xiaofei He 001 (CoRR, 2017)

Keyword-based Query Comprehending via Multiple Optimized-Demand Augmentation. - Boyuan Pan; Hao Li 009; Zhou Zhao 001; Deng Cai 001; Xiaofei He 001 (CoRR, 2017)

Leveraging Long and Short-term Information in Content-aware Movie Recommendation. - Wei Zhao 033; Benyou Wang; Jianbo Ye; Yongqiang Gao; Min Yang 007; Zhou Zhao 001; Xiaojun Chen 006 (CoRR, 2017)

Unifying the Video and Question Attentions for Open-Ended Video Question Answering. - Hongyang Xue; Zhou Zhao 001; Deng Cai 001 (IEEE Trans. Image Process., 2017)

Temporal Interaction and Causal Influence in Community-Based Question Answering. - Fei Wu 001; Xinyu Duan; Jun Xiao 001; Zhou Zhao 001; Siliang Tang; Yin Zhang 006; Yueting Zhuang (IEEE Trans. Knowl. Data Eng., 2017)

Multi-Label Community-Based Question Classification via Personalized Sequence Memory Network Learning. - Xinyu Duan; Shengyu Zhang 001; Zhou Zhao 001; Fei Wu 001; Yueting Zhuang (AAAI, 2018)

Distance-Aware DAG Embedding for Proximity Search on Heterogeneous Graphs. - Zemin Liu; Vincent W. Zheng; Zhou Zhao 001; Fanwei Zhu; Kevin Chen-Chuan Chang; Minghui Wu 001; Jing Ying (AAAI, 2018)

Discourse Marker Augmented Network with Reinforcement Learning for Natural Language Inference. - Boyuan Pan; Yazheng Yang; Zhou Zhao 001; Yueting Zhuang; Deng Cai 001; Xiaofei He 001 (ACL (1), 2018)

Improved Dynamic Memory Network for Dialogue Act Classification with Adversarial Training. - Yao Wan 001; Wenqiang Yan; Jianwei Gao; Zhou Zhao 001; Jian Wu 001; Philip S. Yu (IEEE BigData, 2018)

Cross-domain Aspect/Sentiment-aware Abstractive Review Summarization. - Min Yang 007; Qiang Qu; Jia Zhu 003; Ying Shen 001; Zhou Zhao 001 (CIKM, 2018)

Investigating Capsule Networks with Dynamic Routing for Text Classification. - Min Yang 007; Wei Zhao 033; Jianbo Ye; Zeyang Lei; Zhou Zhao 001; Soufei Zhang (EMNLP, 2018)

Video question answering via multi-granularity temporal attention network learning. - Shaoning Xiao; Yimeng Li; Yunan Ye; Zhou Zhao 001; Jun Xiao 001; Fei Wu 001; Jiang Zhu; Yueting Zhuang (ICIMCS, 2018)

Rethinking Diversified and Discriminative Proposal Generation for Visual Grounding. - Zhou Yu 001; Jun Yu 002; Chenchao Xiang; Zhou Zhao 001; Qi Tian 001; Dacheng Tao (IJCAI, 2018)

Multi-Turn Video Question Answering via Multi-Stream Hierarchical Attention Context Network. - Zhou Zhao 001; Xinghua Jiang; Deng Cai 001; Jun Xiao 001; Xiaofei He 001; Shiliang Pu (IJCAI, 2018)

Attentional Image Retweet Modeling via Multi-Faceted Ranking Network Learning. - Zhou Zhao 001; Lingtao Meng; Jun Xiao 001; Min Yang 007; Fei Wu 001; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IJCAI, 2018)

A Multi-task Learning Approach for Image Captioning. - Wei Zhao 033; Benyou Wang; Jianbo Ye; Min Yang 007; Zhou Zhao 001; Ruotian Luo; Yu Qiao 001 (IJCAI, 2018)

Open-Ended Long-form Video Question Answering via Adaptive Hierarchical Reinforced Networks. - Zhou Zhao 001; Zhu Zhang; Shuwen Xiao; Zhou Yu 001; Jun Yu 002; Deng Cai 001; Fei Wu 001; Yueting Zhuang (IJCAI, 2018)

Improving automatic source code summarization via deep reinforcement learning. - Yao Wan 001; Zhou Zhao 001; Min Yang 007; Guandong Xu; Haochao Ying; Jian Wu 001; Philip S. Yu (ASE, 2018)

Interactive Paths Embedding for Semantic Proximity Search on Heterogeneous Graphs. - Zemin Liu; Vincent W. Zheng; Zhou Zhao 001; Zhao Li 007; Hongxia Yang; Minghui Wu 001; Jing Ying (KDD, 2018)

NGUARD: A Game Bot Detection Framework for NetEase MMORPGs. - Jianrong Tao; Jiarong Xu; Linxia Gong; Yifu Li; Changjie Fan; Zhou Zhao 001 (KDD, 2018)

MacNet: Transferring Knowledge from Machine Comprehension to Sequence-to-Sequence Models. - Boyuan Pan; Yazheng Yang; Hao Li 009; Zhou Zhao 001; Yueting Zhuang; Deng Cai 001; Xiaofei He 001 (NeurIPS, 2018)

Investigating Deep Reinforcement Learning Techniques in Personalized Dialogue Generation. - Min Yang 007; Qiang Qu; Kai Lei; Jia Zhu 003; Zhou Zhao 001; Xiaojun Chen 006; Joshua Zhexue Huang (SDM, 2018)

Dialogue Act Recognition via CRF-Attentive Structured Network. - Zheqian Chen; Rongqin Yang; Zhou Zhao 001; Deng Cai 001; Xiaofei He 001 (SIGIR, 2018)

Subgraph-augmented Path Embedding for Semantic User Search on Heterogeneous Social Network. - Zemin Liu; Vincent W. Zheng; Zhou Zhao 001; Hongxia Yang; Kevin Chen-Chuan Chang; Minghui Wu 001; Jing Ying (WWW, 2018)

Textually Guided Ranking Network for Attentional Image Retweet Modeling. - Zhou Zhao 001; Hanbing Zhan; Lingtao Meng; Jun Xiao 001; Jun Yu 002; Min Yang 007; Fei Wu 001; Deng Cai 001 (CoRR, 2018)

Dial2Desc: End-to-end Dialogue Description Generation. - Haojie Pan; Junpei Zhou; Zhou Zhao 001; Yan Liu; Deng Cai 001; Min Yang 007 (CoRR, 2018)

Question retrieval for community-based question answering via heterogeneous social influential network. - Zheqian Chen; Chi Zhang; Zhou Zhao 001; Chengwei Yao; Deng Cai 001 (Neurocomputing, 2018)

The forgettable-watcher model for video question answering. - Wenqing Chu; Hongyang Xue; Zhou Zhao 001; Deng Cai 001; Chengwei Yao (Neurocomputing, 2018)

Exploiting cross-source knowledge for warming up community question answering services. - Yao Wan 001; Guandong Xu; Liang Chen 001; Zhou Zhao 001; Jian Wu 001 (Neurocomputing, 2018)

Temporality-enhanced knowledgememory network for factoid question answering. - Xinyu Duan; Siliang Tang; Shengyu Zhang 001; Yin Zhang 006; Zhou Zhao 001; Jianru Xue; Yueting Zhuang; Fei Wu 001 (Frontiers Inf. Technol. Electron. Eng., 2018)

Personalized response generation by Dual-learning based domain adaptation. - Min Yang 007; Wenting Tu; Qiang Qu; Zhou Zhao 001; Xiaojun Chen 006; Jia Zhu 003 (Neural Networks, 2018)

A Better Way to Attend: Attention With Trees for Video Question Answering. - Hongyang Xue; Wenqing Chu; Zhou Zhao 001; Deng Cai 001 (IEEE Trans. Image Process., 2018)

PurTreeClust: A Clustering Algorithm for Customer Segmentation from Massive Customer Transaction Data. - Xiaojun Chen 006; Yixiang Fang; Min Yang 007; Feiping Nie 001; Zhou Zhao 001; Joshua Zhexue Huang (IEEE Trans. Knowl. Data Eng., 2018)

Social-Aware Movie Recommendation via Multimodal Network Learning. - Zhou Zhao 001; Qifan Yang; Hanqing Lu; Tim Weninger; Deng Cai 001; Xiaofei He 001; Yueting Zhuang (IEEE Trans. Multim., 2018)

SCSMiner: mining social coding sites for software developer recommendation with relevance propagation. - Yao Wan 001; Liang Chen 001; Guandong Xu; Zhou Zhao 001; Jie Tang 001; Jian Wu 001 (World Wide Web, 2018)

Answer Identification from Product Reviews for User Questions by Multi-Task Attentive Networks. - Long Chen 007; Ziyu Guan; Wei Zhao 019; Wanqing Zhao; Xiaopeng Wang; Zhou Zhao 001; Huan Sun 001 (AAAI, 2019)

Location-Based End-to-End Speech Recognition with Multiple Language Models. - Zhijie Lin 001; Kaiyang Lin; Shiling Chen; Linlin Li 001; Zhou Zhao 001 (AAAI, 2019)

Exploring Human-Like Reading Strategy for Abstractive Text Summarization. - Min Yang 007; Qiang Qu; Wenting Tu; Ying Shen 001; Zhou Zhao 001; Xiaojun Chen 006 (AAAI, 2019)

ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answering. - Zhou Yu 001; Dejing Xu; Jun Yu 002; Ting Yu 016; Zhou Zhao 001; Yueting Zhuang; Dacheng Tao (AAAI, 2019)

Hierarchical Multi-label Text Classification: An Attention-based Recurrent Network Approach. - Wei Huang 002; Enhong Chen; Qi Liu 003; Yuying Chen; Zai Huang; Yang Liu 278; Zhou Zhao 001; Dan Zhang; Shijin Wang 001 (CIKM, 2019)

Cross-modal Image-Text Retrieval with Multitask Learning. - Junyu Luo 001; Ying Shen 001; Xiang Ao 001; Zhou Zhao 001; Min Yang 007 (CIKM, 2019)

Self-Supervised Spatiotemporal Learning via Video Clip Order Prediction. - Dejing Xu; Jun Xiao 001; Zhou Zhao 001; Jian Shao 001; Di Xie; Yueting Zhuang (CVPR, 2019)

Video Dialog via Progressive Inference and Cross-Transformer. - Weike Jin; Zhou Zhao 001; Mao Gu; Jun Xiao 001; Furu Wei; Yueting Zhuang (EMNLP/IJCNLP (1), 2019)

Multilingual Neural Machine Translation with Knowledge Distillation. - Xu Tan 003; Yi Ren 006; Di He 001; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ICLR (Poster), 2019)

Almost Unsupervised Text to Speech and Automatic Speech Recognition. - Yi Ren 006; Xu Tan 003; Tao Qin 001; Sheng Zhao; Zhou Zhao 001; Tie-Yan Liu (ICML, 2019)

Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval. - Lianli Gao; Xiaosu Zhu; Jingkuan Song; Zhou Zhao 001; Heng Tao Shen (IJCAI, 2019)

Weak Supervision Enhanced Generative Network for Question Generation. - Yutong Wang; Jiyuan Zheng; Qijiong Liu; Zhou Zhao 001; Jun Xiao 001; Yueting Zhuang (IJCAI, 2019)

Localizing Unseen Activities in Video via Image Query. - Zhu Zhang; Zhou Zhao 001; Zhijie Lin 001; Jingkuan Song; Deng Cai 001 (IJCAI, 2019)

Open-Ended Long-Form Video Question Answering via Hierarchical Convolutional Self-Attention Networks. - Zhu Zhang; Zhou Zhao 001; Zhijie Lin 001; Jingkuan Song; Xiaofei He 001 (IJCAI, 2019)

Multi-modal Attention Network Learning for Semantic Source Code Retrieval. - Yao Wan 001; Jingdong Shu; Yulei Sui; Guandong Xu; Zhou Zhao 001; Jian Wu 001; Philip S. Yu (ASE, 2019)

Multi-interaction Network with Object Relation for Video Question Answering. - Weike Jin; Zhou Zhao 001; Mao Gu; Jun Yu 002; Jun Xiao 001; Yueting Zhuang (ACM Multimedia, 2019)

Personalized Hashtag Recommendation for Micro-videos. - Yinwei Wei; Zhiyong Cheng 001; Xuzheng Yu; Zhou Zhao 001; Lei Zhu 002; Liqiang Nie (ACM Multimedia, 2019)

FastSpeech: Fast, Robust and Controllable Text to Speech. - Yi Ren 006; Yangjun Ruan; Xu Tan 003; Tao Qin 001; Sheng Zhao; Zhou Zhao 001; Tie-Yan Liu (NeurIPS, 2019)

Video Dialog via Multi-Grained Convolutional Self-Attention Context Networks. - Weike Jin; Zhou Zhao 001; Mao Gu; Jun Yu 002; Jun Xiao 001; Yueting Zhuang (SIGIR, 2019)

Cross-Modal Interaction Networks for Query-Based Moment Retrieval in Videos. - Zhu Zhang; Zhijie Lin 001; Zhou Zhao 001; Zhenxin Xiao (SIGIR, 2019)

Abstractive Meeting Summarization via Hierarchical Adaptive Segmental Network Learning. - Zhou Zhao 001; Haojie Pan; Changjie Fan; Yan Liu; Linlin Li 001; Min Yang 007 (WWW, 2019)

Hierarchical human-like strategy for aspect-level sentiment classification with sentiment linguistic knowledge and reinforcement learning. - Min Yang 007; Qingnan Jiang; Ying Shen 001; Qingyao Wu; Zhou Zhao 001; Wei Zhou 028 (Neural Networks, 2019)

Investigating the transferring capability of capsule networks for text classification. - Min Yang 007; Wei Zhao 033; Lei Chen 072; Qiang Qu; Zhou Zhao 001; Ying Shen 001 (Neural Networks, 2019)

Multi-Turn Video Question Answering via Hierarchical Attention Context Reinforced Networks. - Zhou Zhao 001; Zhu Zhang; Xinghua Jiang; Deng Cai 001 (IEEE Trans. Image Process., 2019)

Long-Form Video Question Answering via Dynamic Hierarchical Reinforced Networks. - Zhou Zhao 001; Zhu Zhang; Shuwen Xiao; Zhenxin Xiao; Xiaohui Yan; Jun Yu 002; Deng Cai 001; Fei Wu 001 (IEEE Trans. Image Process., 2019)

Multitask Learning for Cross-Domain Image Captioning. - Min Yang 007; Wei Zhao 033; Wei Xu; Yabing Feng; Zhou Zhao 001; Xiaojun Chen 006; Kai Lei (IEEE Trans. Multim., 2019)

Video Question Answering via Knowledge-based Progressive Spatial-Temporal Attention Network. - Weike Jin; Zhou Zhao 001; Yimeng Li; Jie Li; Jun Xiao 001; Yueting Zhuang (ACM Trans. Multim. Comput. Commun. Appl., 2019)

Weakly-Supervised Video Moment Retrieval via Semantic Completion Network. - Zhijie Lin 001; Zhou Zhao 001; Zhu Zhang; Qi Wang; Huasheng Liu (AAAI, 2020)

Interactive Dual Generative Adversarial Networks for Image Captioning. - Junhao Liu 001; Kai Wang 036; Chunpu Xu; Zhou Zhao 001; Ruifeng Xu 001; Ying Shen 001; Min Yang 007 (AAAI, 2020)

Convolutional Hierarchical Attention Network for Query-Focused Video Summarization. - Shuwen Xiao; Zhou Zhao 001; Zijian Zhang 002; Xiaohui Yan; Min Yang 007 (AAAI, 2020)

Be Relevant, Non-Redundant, and Timely: Deep Reinforcement Learning for Real-Time Event Summarization. - Min Yang 007; Chengming Li; Fei Sun 001; Zhou Zhao 001; Ying Shen 001; Chenglin Wu (AAAI, 2020)

SimulSpeech: End-to-End Simultaneous Speech to Text Translation. - Yi Ren 006; Jinglin Liu; Xu Tan 003; Chen Zhang 020; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ACL, 2020)

A Study of Non-autoregressive Model for Sequence Generation. - Yi Ren 006; Jinglin Liu; Xu Tan 003; Zhou Zhao 001; Sheng Zhao; Tie-Yan Liu (ACL, 2020)

Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences. - Zhu Zhang; Zhou Zhao 001; Yang Zhao 022; Qi Wang; Huasheng Liu; Lianli Gao (CVPR, 2020)

Task-Level Curriculum Learning for Non-Autoregressive Neural Machine Translation. - Jinglin Liu; Yi Ren 006; Xu Tan 003; Chen Zhang 020; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (IJCAI, 2020)

Object-Aware Multi-Branch Relation Networks for Spatio-Temporal Video Grounding. - Zhu Zhang; Zhou Zhao 001; Zhijie Lin 001; Baoxing Huai; Jing Yuan 007 (IJCAI, 2020)

DeepSinger: Singing Voice Synthesis with Data Mined From the Web. - Yi Ren 006; Xu Tan 003; Tao Qin 001; Jian Luan 001; Zhou Zhao 001; Tie-Yan Liu (KDD, 2020)

Comprehensive Information Integration Modeling Framework for Video Titling. - Shengyu Zhang 001; Ziqi Tan; Zhou Zhao 001; Jin Yu; Kun Kuang; Tan Jiang; Jingren Zhou 001; Hongxia Yang; Fei Wu 001 (KDD, 2020)

Text-Guided Image Inpainting. - Zijian Zhang 002; Zhou Zhao 001; Zhu Zhang; Baoxing Huai; Jing Yuan 007 (ACM Multimedia, 2020)

FastLR: Non-Autoregressive Lipreading Model with Integrate-and-Fire. - Jinglin Liu; Yi Ren 006; Zhou Zhao 001; Chen Zhang 020; Baoxing Huai; Jing Yuan 007 (ACM Multimedia, 2020)

PopMAG: Pop Music Accompaniment Generation. - Yi Ren 006; Jinzheng He; Xu Tan 003; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ACM Multimedia, 2020)

DeVLBert: Learning Deconfounded Visio-Linguistic Representations. - Shengyu Zhang 001; Tan Jiang; Tan Wang; Kun Kuang; Zhou Zhao 001; Jianke Zhu; Jin Yu; Hongxia Yang; Fei Wu 001 (ACM Multimedia, 2020)

Regularized Two-Branch Proposal Networks for Weakly-Supervised Moment Retrieval in Videos. - Zhu Zhang; Zhijie Lin 001; Zhou Zhao 001; Jieming Zhu; Xiuqiang He 001 (ACM Multimedia, 2020)

Poet: Product-oriented Video Captioner for E-commerce. - Shengyu Zhang 001; Ziqi Tan; Jin Yu; Zhou Zhao 001; Kun Kuang; Jie Liu 002; Jingren Zhou 001; Hongxia Yang; Fei Wu 001 (ACM Multimedia, 2020)

Counterfactual Contrastive Learning for Weakly-Supervised Vision-Language Grounding. - Zhu Zhang; Zhou Zhao 001; Zhijie Lin 001; Jieming Zhu; Xiuqiang He 001 (NeurIPS, 2020)

A Generic Network Compression Framework for Sequential Recommender Systems. - Yang Sun; Fajie Yuan; Min Yang 007; Guoao Wei; Zhou Zhao 001; Duo Liu (SIGIR, 2020)

Regional Relation Modeling for Visual Place Recognition. - Yingying Zhu 001; Biao Li; Jiong Wang; Zhou Zhao 001 (SIGIR, 2020)

Grounded and Controllable Image Completion by Incorporating Lexical Semantics. - Shengyu Zhang 001; Tan Jiang; Qinghao Huang; Ziqi Tan; Zhou Zhao 001; Siliang Tang; Jin Yu; Hongxia Yang; Yi Yang 001; Fei Wu 001 (CoRR, 2020)

MGD-GAN: Text-to-Pedestrian generation through Multi-Grained Discrimination. - Shengyu Zhang 001; Donghui Wang; Zhou Zhao 001; Siliang Tang; Di Xie; Fei Wu 001 (CoRR, 2020)

Bi-Decoder Augmented Network for Neural Machine Translation. - Boyuan Pan; Yazheng Yang; Zhou Zhao 001; Yueting Zhuang; Deng Cai 001 (Neurocomputing, 2020)

Abstractive meeting summarization by hierarchical adaptive segmental network learning with multiple revising steps. - Jiyuan Zheng; Zhou Zhao 001; Zehan Song; Min Yang 007; Jun Xiao 001; Xiaohui Yan (Neurocomputing, 2020)

Hierarchical Temporal Fusion of Multi-grained Attention Features for Video Question Answering. - Shaoning Xiao; Yimeng Li; Yunan Ye; Long Chen 016; Shiliang Pu; Zhou Zhao 001; Jian Shao 001; Jun Xiao 001 (Neural Process. Lett., 2020)

Play and rewind: Context-aware video temporal action proposals. - Lianli Gao; Tao Li; Jingkuan Song; Zhou Zhao 001; Heng Tao Shen (Pattern Recognit., 2020)

Video Dialog via Multi-Grained Convolutional Self-Attention Context Multi-Modal Networks. - Mao Gu; Zhou Zhao 001; Weike Jin; Deng Cai 001; Fei Wu 001 (IEEE Trans. Circuits Syst. Video Technol., 2020)

An Advanced Deep Generative Framework for Temporal Link Prediction in Dynamic Networks. - Min Yang 007; Junhao Liu 001; Lei Chen 072; Zhou Zhao 001; Xiaojun Chen 006; Ying Shen 001 (IEEE Trans. Cybern., 2020)

Leveraging Long and Short-Term Information in Content-Aware Movie Recommendation via Adversarial Training. - Wei Zhao 033; Benyou Wang; Min Yang 007; Jianbo Ye; Zhou Zhao 001; Xiaojun Chen 006; Ying Shen 001 (IEEE Trans. Cybern., 2020)

Moment Retrieval via Cross-Modal Interaction Networks With Query Reconstruction. - Zhijie Lin 001; Zhou Zhao 001; Zhu Zhang; Zijian Zhang 002; Deng Cai 001 (IEEE Trans. Image Process., 2020)

Query-Biased Self-Attentive Network for Query-Focused Video Summarization. - Shuwen Xiao; Zhou Zhao 001; Zijian Zhang 002; Ziyu Guan; Deng Cai 001 (IEEE Trans. Image Process., 2020)

An Ensemble of Generation- and Retrieval-Based Image Captioning With Dual Generator Generative Adversarial Network. - Min Yang 007; Junhao Liu 001; Ying Shen 001; Zhou Zhao 001; Xiaojun Chen 006; Qingyao Wu; Chengming Li (IEEE Trans. Image Process., 2020)

Open-Ended Video Question Answering via Multi-Modal Conditional Adversarial Networks. - Zhou Zhao 001; Shuwen Xiao; Zehan Song; Chujie Lu; Jun Xiao 001; Yueting Zhuang (IEEE Trans. Image Process., 2020)

NGUARD+: An Attention-based Game Bot Detection Framework via Player Behavior Sequences. - Jiarong Xu; Yifan Luo; Jianrong Tao; Changjie Fan; Zhou Zhao 001; Jiangang Lu (ACM Trans. Knowl. Discov. Data, 2020)

Multichannel Attention Refinement for Video Question Answering. - Yueting Zhuang; Dejing Xu; Xin Yan; Wenzhuo Cheng; Zhou Zhao 001; Shiliang Pu; Jun Xiao 001 (ACM Trans. Multim. Comput. Commun. Appl., 2020)

Modeling High-order Interactions across Multi-interests for Micro-video Reommendation (Student Abstract). - Dong Yao; Shengyu Zhang 001; Zhou Zhao 001; Wenyan Fan; Jieming Zhu; Xiuqiang He 001; Fei Wu 001 (AAAI, 2021)

Multi-Modal Relational Graph for Cross-Modal Video Moment Retrieval. - Yawen Zeng; Da Cao; Xiaochi Wei; Meng Liu 006; Zhou Zhao 001; Zheng Qin 001 (CVPR, 2021)

Grounded, Controllable and Debiased Image Completion With Lexical Semantics. - Shengyu Zhang 001; Tan Jiang; Qinghao Huang; Ziqi Tan; Kun Kuang; Zhou Zhao 001; Siliang Tang; Jin Yu; Hongxia Yang; Yi Yang 001; Fei Wu 001 (CVPR Workshops, 2021)

DeVLBert: Out-of-Distribution Visio-Linguistic Pretraining With Causality. - Shengyu Zhang 001; Tan Jiang; Tan Wang; Kun Kuang; Zhou Zhao 001; Jianke Zhu; Jin Yu; Hongxia Yang; Fei Wu 001 (CVPR Workshops, 2021)

Cascaded Prediction Network via Segment Tree for Temporal Video Grounding. - Yang Zhao 022; Zhou Zhao 001; Zhu Zhang; Zhijie Lin 001 (CVPR, 2021)

FastSpeech 2: Fast and High-Quality End-to-End Text to Speech. - Yi Ren 006; Chenxu Hu; Xu Tan 003; Tao Qin 001; Sheng Zhao; Zhou Zhao 001; Tie-Yan Liu (ICLR, 2021)

Learning to Rehearse in Long Sequence Memorization. - Zhu Zhang; Chang Zhou; Jianxin Ma; Zhijie Lin 001; Jingren Zhou 001; Hongxia Yang; Zhou Zhao 001 (ICML, 2021)

FedSpeech: Federated Text-to-Speech with Continual Learning. - Ziyue Jiang 001; Yi Ren 006; Ming Lei; Zhou Zhao 001 (IJCAI, 2021)

EMOVIE: A Mandarin Emotion Speech Dataset with a Simple Emotional Text-to-Speech Model. - Chenye Cui; Yi Ren 006; Jinglin Liu; Feiyang Chen; Rongjie Huang 001; Ming Lei; Zhou Zhao 001 (Interspeech, 2021)

WSRGlow: A Glow-Based Waveform Generative Model for Audio Super-Resolution. - Kexun Zhang; Yi Ren 006; Changliang Xu; Zhou Zhao 001 (Interspeech, 2021)

Multi-Singer: Fast Multi-Singer Singing Voice Vocoder With A Large-Scale Corpus. - Rongjie Huang 001; Feiyang Chen; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (ACM Multimedia, 2021)

Towards Fast and High-Quality Sign Language Production. - Wencan Huang; Wenwen Pan 003; Zhou Zhao 001; Qi Tian 001 (ACM Multimedia, 2021)

Contrastive Disentangled Meta-Learning for Signer-Independent Sign Language Translation. - Tao Jin 004; Zhou Zhao 001 (ACM Multimedia, 2021)

SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory. - Zhijie Lin 001; Zhou Zhao 001; Haoyuan Li 002; Jinglin Liu; Meng Zhang 019; Xingshan Zeng; Xiaofei He 001 (ACM Multimedia, 2021)

VLAD-VSA: Cross-Domain Face Presentation Attack Detection with Vocabulary Separation and Adaptation. - Jiong Wang; Zhou Zhao 001; Weike Jin; Xinyu Duan; Zhen Lei 001; Baoxing Huai; Yiling Wu; Xiaofei He 001 (ACM Multimedia, 2021)

Why Do We Click: Visual Impression-aware News Recommendation. - Jiahao Xun; Shengyu Zhang 001; Zhou Zhao 001; Jieming Zhu; Qi Zhang 001; Jingjie Li; Xiuqiang He 001; Xiaofei He 001; Tat-Seng Chua; Fei Wu 001 (ACM Multimedia, 2021)

SimulSLT: End-to-End Simultaneous Sign Language Translation. - Aoxiong Yin; Zhou Zhao 001; Jinglin Liu; Weike Jin; Meng Zhang 019; Xingshan Zeng; Xiaofei He 001 (ACM Multimedia, 2021)

Generalizable Multi-linear Attention Network. - Tao Jin 004; Zhou Zhao 001 (NeurIPS, 2021)

PortaSpeech: Portable and High-Quality Generative Text-to-Speech. - Yi Ren 006; Jinglin Liu; Zhou Zhao 001 (NeurIPS, 2021)

MGD-GAN: Text-to-Pedestrian Generation Through Multi-grained Discrimination. - Shengyu Zhang 001; Donghui Wang; Zhou Zhao 001; Siliang Tang; Kun Kuang; Di Xie; Fei Wu 001 (PRCV (2), 2021)

Hierarchical Cross-Modal Graph Consistency Learning for Video-Text Retrieval. - Weike Jin; Zhou Zhao 001; Pengcheng Zhang; Jieming Zhu; Xiuqiang He 001; Yueting Zhuang (SIGIR, 2021)

CauseRec: Counterfactual User Sequence Synthesis for Sequential Recommendation. - Shengyu Zhang 001; Dong Yao; Zhou Zhao 001; Tat-Seng Chua; Fei Wu 001 (SIGIR, 2021)

Future-Aware Diverse Trends Framework for Recommendation. - Yujie Lu; Shengyu Zhang 001; Yingxuan Huang; Luyao Wang; Xinyao Yu 003; Zhou Zhao 001; Fei Wu 001 (WWW, 2021)

Modeling High-order Interactions across Multi-interests for Micro-video Reommendation. - Dong Yao; Shengyu Zhang 001; Zhou Zhao 001; Wenyan Fan; Jieming Zhu; Xiuqiang He 001; Fei Wu 001 (CoRR, 2021)

DiffSinger: Diffusion Acoustic Model for Singing Voice Synthesis. - Jinglin Liu; Chengxi Li 002; Yi Ren 006; Feiyang Chen; Peng Liu; Zhou Zhao 001 (CoRR, 2021)

High-Speed and High-Quality Text-to-Lip Generation. - Jinglin Liu; Zhiying Zhu; Yi Ren 006; Zhou Zhao 001 (CoRR, 2021)

Stable Prediction on Graphs with Agnostic Distribution Shift. - Shengyu Zhang 001; Kun Kuang; Jiezhong Qiu; Jin Yu; Zhou Zhao 001; Hongxia Yang; Zhongfei Zhang; Fei Wu 001 (CoRR, 2021)

Multi-trends Enhanced Dynamic Micro-video Recommendation. - Yujie Lu; Yingxuan Huang; Shengyu Zhang 001; Wei Han; Hui Chen 023; Zhou Zhao 001; Fei Wu 001 (CoRR, 2021)

Test-time Batch Statistics Calibration for Covariate Shift. - Fuming You; Jingjing Li 001; Zhou Zhao 001 (CoRR, 2021)

SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation. - Feiyang Chen; Rongjie Huang 001; Chenye Cui; Yi Ren 006; Jinglin Liu; Zhou Zhao 001; Nicholas Jing Yuan; Baoxing Huai (CoRR, 2021)

A Chinese Multi-type Complex Questions Answering Dataset over Wikidata. - Jianyun Zou; Min Yang 007; Lichao Zhang; Yechen Xu; Qifan Pan; Fengqing Jiang; Ran Qin; Shushu Wang; Yifan He; Songfang Huang; Zhou Zhao 001 (CoRR, 2021)

Lightweight dynamic conditional GAN with pyramid attention for text-to-image synthesis. - Lianli Gao; Daiyuan Chen; Zhou Zhao 001; Jie Shao 001; Heng Tao Shen (Pattern Recognit., 2021)

Multi-Turn Video Question Generation via Reinforced Multi-Choice Attention Network. - Zhaoyu Guo; Zhou Zhao 001; Weike Jin; Zhicheng Wei; Min Yang 007; Nannan Wang 001; Nicholas Jing Yuan (IEEE Trans. Circuits Syst. Video Technol., 2021)

Hierarchical Memory Decoder for Visual Narrating. - Aming Wu; Yahong Han; Zhou Zhao 001; Yi Yang 001 (IEEE Trans. Circuits Syst. Video Technol., 2021)

Graph-Based Multi-Interaction Network for Video Question Answering. - Mao Gu; Zhou Zhao 001; Weike Jin; Richang Hong; Fei Wu 001 (IEEE Trans. Image Process., 2021)

Adaptive Spatio-Temporal Graph Enhanced Vision-Language Representation for Video QA. - Weike Jin; Zhou Zhao 001; Xiaochun Cao; Jieming Zhu; Xiuqiang He 001; Yueting Zhuang (IEEE Trans. Image Process., 2021)

Temporal Textual Localization in Video via Adversarial Bi-Directional Interaction Networks. - Zijian Zhang 002; Zhou Zhao 001; Zhu Zhang; Zhijie Lin 001; Qi Wang; Richang Hong (IEEE Trans. Multim., 2021)

Hierarchical Human-Like Deep Neural Networks for Abstractive Text Summarization. - Min Yang 007; Chengming Li; Ying Shen 001; Qingyao Wu; Zhou Zhao 001; Xiaojun Chen 006 (IEEE Trans. Neural Networks Learn. Syst., 2021)

An Effective Hybrid Learning Model for Real-Time Event Summarization. - Min Yang 007; Qiang Qu; Ying Shen 001; Zhou Zhao 001; Xiaojun Chen 006; Chengming Li (IEEE Trans. Neural Networks Learn. Syst., 2021)

Flow-Based Unconstrained Lip to Speech Generation. - Jinzheng He; Zhou Zhao 001; Yi Ren 006; Jinglin Liu; Baoxing Huai; Nicholas Jing Yuan (AAAI, 2022)

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism. - Jinglin Liu; Chengxi Li 002; Yi Ren 006; Feiyang Chen; Zhou Zhao 001 (AAAI, 2022)

Parallel and High-Fidelity Text-to-Lip Generation. - Jinglin Liu; Zhiying Zhu; Yi Ren 006; Wencan Huang; Baoxing Huai; Nicholas Jing Yuan; Zhou Zhao 001 (AAAI, 2022)

Revisiting Over-Smoothness in Text to Speech. - Yi Ren 006; Xu Tan 003; Tao Qin 001; Zhou Zhao 001; Tie-Yan Liu (ACL (1), 2022)

Prior Knowledge and Memory Enriched Transformer for Sign Language Translation. - Tao Jin 004; Zhou Zhao 001; Meng Zhang 019; Xingshan Zeng (ACL (Findings), 2022)

End-to-End Modeling via Information Tree for One-Shot Natural Language Spatial Video Grounding. - Mengze Li 001; Tianbao Wang; Haoyu Zhang; Shengyu Zhang 001; Zhou Zhao 001; Jiaxu Miao; Wenqiao Zhang; Wenming Tan; Jin Wang; Peng Wang; Shiliang Pu; Fei Wu 001 (ACL (1), 2022)

Learning the Beauty in Songs: Neural Singing Voice Beautifier. - Jinglin Liu; Chengxi Li 002; Yi Ren 006; Zhiying Zhu; Zhou Zhao 001 (ACL (1), 2022)

Fine-Grained Predicates Learning for Scene Graph Generation. - Xinyu Lyu; Lianli Gao; Yuyu Guo 001; Zhou Zhao 001; Hao Huang; Heng Tao Shen; Jingkuan Song (CVPR, 2022)

Wnet: Audio-Guided Video Object Segmentation via Wavelet-Based Cross- Modal Denoising Networks. - Wenwen Pan 003; Haonan Shi; Zhou Zhao 001; Jieming Zhu; Xiuqiang He 001; Zhigeng Pan; Lianli Gao; Jun Yu 002; Fei Wu 001; Qi Tian 001 (CVPR, 2022)

Cross-modal Background Suppression for Audio-Visual Event Localization. - Yan Xia 006; Zhou Zhao 001 (CVPR, 2022)

MLSLT: Towards Multilingual Sign Language Translation. - Aoxiong Yin; Zhou Zhao 001; Weike Jin; Meng Zhang 019; Xingshan Zeng; Xiaofei He 001 (CVPR, 2022)

Prosospeech: Enhancing Prosody with Quantized Vector Pre-Training in Text-To-Speech. - Yi Ren 006; Ming Lei; Zhiying Huang; Shiliang Zhang; Qian Chen 003; Zhijie Yan; Zhou Zhao 001 (ICASSP, 2022)

HiFiDenoise: High-Fidelity Denoising Text to Speech with Adversarial Networks. - Lichao Zhang; Yi Ren 006; Liqun Deng; Zhou Zhao 001 (ICASSP, 2022)

Pseudo Numerical Methods for Diffusion Models on Manifolds. - Luping Liu; Yi Ren 006; Zhijie Lin 001; Zhou Zhao 001 (ICLR, 2022)

FastDiff: A Fast Conditional Diffusion Model for High-Quality Speech Synthesis. - Rongjie Huang 001; Max W. Y. Lam; Jun Wang 091; Dan Su 002; Dong Yu 001; Yi Ren 006; Zhou Zhao 001 (IJCAI, 2022)

SyntaSpeech: Syntax-Aware Generative Adversarial Text-to-Speech. - Zhenhui Ye; Zhou Zhao 001; Yi Ren 006; Fei Wu 001 (IJCAI, 2022)

EditSinger: Zero-Shot Text-Based Singing Voice Editing System with Diverse Prosody Modeling. - Lichao Zhang; Zhou Zhao 001; Yi Ren 006; Liqun Deng (IJCAI, 2022)

Separate-to-Recognize: Joint Multi-target Speech Separation and Speech Recognition for Speaker-attributed ASR. - Yuxiao Lin; Zhihao Du; Shiliang Zhang; Fan Yu 002; Zhou Zhao 001; Fei Wu 001 (ISCSLP, 2022)

MC-SLT: Towards Low-Resource Signer-Adaptive Sign Language Translation. - Tao Jin 004; Zhou Zhao 001; Meng Zhang 019; Xingshan Zeng (ACM Multimedia, 2022)

SingGAN: Generative Adversarial Network For High-Fidelity Singing Voice Generation. - Rongjie Huang 001; Chenye Cui; Feiyang Chen; Yi Ren 006; Jinglin Liu; Zhou Zhao 001; Baoxing Huai; Zhefeng Wang 001 (ACM Multimedia, 2022)

DualSign: Semi-Supervised Sign Language Production with Balanced Multi-Modal Multi-Task Dual Transformation. - Wencan Huang; Zhou Zhao 001; Jinzheng He; Mingmin Zhang 001 (ACM Multimedia, 2022)

ProDiff: Progressive Fast Diffusion Model for High-Quality Text-to-Speech. - Rongjie Huang 001; Zhou Zhao 001; Huadai Liu; Jinglin Liu; Chenye Cui; Yi Ren 006 (ACM Multimedia, 2022)

Weakly-supervised Disentanglement Network for Video Fingerspelling Detection. - Ziqi Jiang; Shengyu Zhang 001; Siyuan Yao; Wenqiao Zhang; Sihan Zhang; Juncheng Li 006; Zhou Zhao 001; Fei Wu 001 (ACM Multimedia, 2022)

HERO: HiErarchical spatio-tempoRal reasOning with Contrastive Action Correspondence for End-to-End Video Object Grounding. - Mengze Li 001; Tianbao Wang; Haoyu Zhang; Shengyu Zhang 001; Zhou Zhao 001; Wenqiao Zhang; Jiaxu Miao; Shiliang Pu; Fei Wu 001 (ACM Multimedia, 2022)

Set-Based Face Recognition Beyond Disentanglement: Burstiness Suppression With Variance Vocabulary. - Jiong Wang; Zhou Zhao 001; Fei Wu 001 (ACM Multimedia, 2022)

FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech Synthesis. - Yongqi Wang; Zhou Zhao 001 (ACM Multimedia, 2022)

Video-Guided Curriculum Learning for Spoken Video Grounding. - Yan Xia 006; Zhou Zhao 001; Shangwei Ye; Yang Zhao 022; Haoyuan Li 002; Yi Ren 006 (ACM Multimedia, 2022)

GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech. - Rongjie Huang 001; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (NeurIPS, 2022)

Dict-TTS: Learning to Pronounce with Prior Dictionary Knowledge for Text-to-Speech. - Ziyue Jiang 001; Su Zhe; Zhou Zhao 001; Qian Yang 006; Yi Ren 006; Jinglin Liu; Zhenhui Ye (NeurIPS, 2022)

M4Singer: A Multi-Style, Multi-Singer and Musical Score Provided Mandarin Singing Corpus. - Lichao Zhang; Ruiqi Li; Shoutong Wang; Liqun Deng; Jinglin Liu; Yi Ren 006; Jinzheng He; Rongjie Huang 001; Jieming Zhu; Xiao Chen; Zhou Zhao 001 (NeurIPS, 2022)

Unsupervised Representation Learning from Pre-trained Diffusion Probabilistic Models. - Zijian Zhang 002; Zhou Zhao 001; Zhijie Lin 001 (NeurIPS, 2022)

Towards Effective Multi-Modal Interchanges in Zero-Resource Sounding Object Localization. - Yang Zhao 022; Chen Zhang 020; Haifeng Huang; Haoyuan Li 002; Zhou Zhao 001 (NeurIPS, 2022)

Uncovering Causal Effects of Online Short Videos on Consumer Behaviors. - Ziqi Tan; Shengyu Zhang 001; Nuanxin Hong; Kun Kuang; Yifan Yu; Jin Yu; Zhou Zhao 001; Hongxia Yang; Shiyuan Pan; Jingren Zhou 001; Fei Wu 001 (WSDM, 2022)

Contrastive Learning with Positive-Negative Frame Mask for Music Representation. - Dong Yao; Zhou Zhao 001; Shengyu Zhang 001; Jieming Zhu; Yudong Zhu; Rui Zhang 003; Xiuqiang He 001 (WWW, 2022)

Re4: Learning to Re-contrast, Re-attend, Re-construct for Multi-interest Recommendation. - Shengyu Zhang 001; Lingxiao Yang; Dong Yao; Yujie Lu; Fuli Feng; Zhou Zhao 001; Tat-Seng Chua; Fei Wu 001 (WWW, 2022)

MR-SVS: Singing Voice Synthesis with Multi-Reference Encoder. - Shoutong Wang; Jinglin Liu; Yi Ren 006; Zhen Wang; Changliang Xu; Zhou Zhao 001 (CoRR, 2022)

GenerSpeech: Towards Style Transfer for Generalizable Out-Of-Domain Text-to-Speech Synthesis. - Rongjie Huang 001; Yi Ren 006; Jinglin Liu; Chenye Cui; Zhou Zhao 001 (CoRR, 2022)

AntPivot: Livestream Highlight Detection via Hierarchical Attention Mechanism. - Yang Zhao 022; Xuan Lin; Wenqiang Xu; Maozong Zheng; Zhengyong Liu; Zhou Zhao 001 (CoRR, 2022)

CCL4Rec: Contrast over Contrastive Learning for Micro-video Recommendation. - Shengyu Zhang 001; Bofang Li; Dong Yao; Fuli Feng; Jieming Zhu; Wenyan Fan; Zhou Zhao 001; Xiaofei He 001; Tat-Seng Chua; Fei Wu 001 (CoRR, 2022)

AntCritic: Argument Mining for Free-Form and Visually-Rich Financial Comments. - Yang Zhao 022; Wenqiang Xu; Xuan Lin; Jingjing Huo; Hong Chen 002; Zhou Zhao 001 (CoRR, 2022)

Frame-Subtitle Self-Supervision for Multi-Modal Video Question Answering. - Jiong Wang; Zhou Zhao 001; Weike Jin (CoRR, 2022)

VarietySound: Timbre-Controllable Video to Sound Generation via Unsupervised Information Disentanglement. - Chenye Cui; Yi Ren 006; Jinglin Liu; Rongjie Huang 001; Zhou Zhao 001 (CoRR, 2022)

Diffusion Denoising Process for Perceptron Bias in Out-of-distribution Detection. - Luping Liu; Yi Ren 006; Xize Cheng; Zhou Zhao 001 (CoRR, 2022)

Interaction augmented transformer with decoupled decoding for video captioning. - Tao Jin 004; Zhou Zhao 001; Peng Wang; Jun Yu 002; Fei Wu 001 (Neurocomputing, 2022)

Local-Global Graph Pooling via Mutual Information Maximization for Video-Paragraph Retrieval. - Pengcheng Zhang; Zhou Zhao 001; Nannan Wang 001; Jun Yu 002; Fei Wu 001 (IEEE Trans. Circuits Syst. Video Technol., 2022)

TaoHighlight: Commodity-Aware Multi-Modal Video Highlight Detection in E-Commerce. - Zhaoyu Guo; Zhou Zhao 001; Weike Jin; Dazhou Wang; Ruitao Liu; Jun Yu 002 (IEEE Trans. Multim., 2022)

AgeGAN++: Face Aging and Rejuvenation With Dual Conditional GANs. - Jingkuan Song; Jingqiu Zhang; Lianli Gao; Zhou Zhao 001; Heng Tao Shen (IEEE Trans. Multim., 2022)

Reinforcement-Learning-Guided Source Code Summarization Using Hierarchical Attention. - Wenhua Wang; Yuqun Zhang; Yulei Sui; Yao Wan 001; Zhou Zhao 001; Jian Wu 001; Philip S. Yu; Guandong Xu (IEEE Trans. Software Eng., 2022)

Video-Audio Domain Generalization via Confounder Disentanglement. - Shengyu Zhang 001; Xusheng Feng; Wenyan Fan; Wenjing Fang; Fuli Feng; Wei Ji 008; Shuo Li; Li Wang 056; Shanshan Zhao 001; Zhou Zhao 001; Tat-Seng Chua; Fei Wu 001 (AAAI, 2023)

ShiftDDPMs: Exploring Conditional Diffusion Models by Shifting Diffusion Trajectories. - Zijian Zhang 002; Zhou Zhao 001; Jun Yu 002; Qi Tian 001 (AAAI, 2023)

OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment. - Xize Cheng; Tao Jin 004; Linjun Li; Wang Lin; Xinyu Duan; Zhou Zhao 001 (ACL (1), 2023)

RMSSinger: Realistic-Music-Score based Singing Voice Synthesis. - Jinzheng He; Jinglin Liu; Zhenhui Ye; Rongjie Huang 001; Chenye Cui; Huadai Liu; Zhou Zhao 001 (ACL (Findings), 2023)

FastDiff 2: Revisiting and Incorporating GANs and Diffusion Models in High-Fidelity Speech Synthesis. - Rongjie Huang 001; Yi Ren 006; Ziyue Jiang 001; Chenye Cui; Jinglin Liu; Zhou Zhao 001 (ACL (Findings), 2023)

AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translation. - Rongjie Huang 001; Huadai Liu; Xize Cheng; Yi Ren 006; Linjun Li; Zhenhui Ye; Jinzheng He; Lichao Zhang; Jinglin Liu; Xiang Yin 006; Zhou Zhao 001 (ACL (1), 2023)

Prosody-TTS: Improving Prosody with Masked Autoencoder and Conditional Diffusion Model For Expressive Text-to-Speech. - Rongjie Huang 001; Chunlei Zhang; Yi Ren 006; Zhou Zhao 001; Dong Yu 001 (ACL (Findings), 2023)

FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Models. - Ziyue Jiang 001; Qian Yang 006; Jialong Zuo; Zhenhui Ye; Rongjie Huang 001; Yi Ren 006; Zhou Zhao 001 (ACL (Findings), 2023)

AlignSTS: Speech-to-Singing Conversion via Cross-Modal Alignment. - Ruiqi Li; Rongjie Huang 001; Lichao Zhang; Jinglin Liu; Zhou Zhao 001 (ACL (Findings), 2023)

Contrastive Token-Wise Meta-Learning for Unseen Performer Visual Temporal-Aligned Translation. - Linjun Li; Tao Jin 004; Xize Cheng; Ye Wang 018; Wang Lin; Rongjie Huang 001; Zhou Zhao 001 (ACL (Findings), 2023)

Multi-modal Action Chain Abductive Reasoning. - Mengze Li 001; Tianbao Wang; Jiahe Xu 003; Kairong Han; Shengyu Zhang 001; Zhou Zhao 001; Jiaxu Miao; Wenqiao Zhang; Shiliang Pu; Fei Wu 001 (ACL (1), 2023)

TAVT: Towards Transferable Audio-Visual Text Generation. - Wang Lin; Tao Jin 004; Wenwen Pan 003; Linjun Li; Xize Cheng; Ye Wang 018; Zhou Zhao 001 (ACL (1), 2023)

DopplerBAS: Binaural Audio Synthesis Addressing Doppler Effect. - Jinglin Liu; Zhenhui Ye; Qian Chen 003; Siqi Zheng; Wen Wang 001; Qinglin Zhang; Zhou Zhao 001 (ACL (Findings), 2023)

Semantic-conditioned Dual Adaptation for Cross-domain Query-based Visual Segmentation. - Ye Wang 018; Tao Jin 004; Wang Lin; Xize Cheng; Linjun Li; Zhou Zhao 001 (ACL (Findings), 2023)

Weakly-Supervised Spoken Video Grounding via Semantic Interaction Learning. - Ye Wang 018; Wang Lin; Shengyu Zhang 001; Tao Jin 004; Linjun Li; Xize Cheng; Zhou Zhao 001 (ACL (1), 2023)

Scene-robust Natural Language Video Localization via Learning Domain-invariant Representations. - Zehan Wang 001; Yang Zhao 022; Haifeng Huang; Yan Xia 006; Zhou Zhao 001 (ACL (Findings), 2023)

CLAPSpeech: Learning Prosody from Text Context with Contrastive Language-Audio Pre-Training. - Zhenhui Ye; Rongjie Huang 001; Yi Ren 006; Ziyue Jiang 001; Jinglin Liu; Jinzheng He; Xiang Yin 006; Zhou Zhao 001 (ACL (1), 2023)

Multi-trends Enhanced Dynamic Micro-video Recommendation. - Yujie Lu; Yingxuan Huang; Shengyu Zhang 001; Wei Han; Hui Chen 023; Wenyan Fan; Jiangliang Lai; Zhou Zhao 001; Fei Wu 001 (CICAI (1), 2023)

Sequential Style Consistency Learning for Domain-Generalizable Text Recognition. - Pengcheng Zhang; Wenrui Liu 003; Ning Wang; Ran Shen; Gang Sun 004; Xinghua Jiang; Zheqian Chen; Fei Wu 001; Zhou Zhao 001 (CICAI (1), 2023)

ANetQA: A Large-scale Benchmark for Fine-grained Compositional Reasoning over Untrimmed Videos. - Zhou Yu 001; Lixiang Zheng; Zhou Zhao 001; Fei Wu 001; Jianping Fan 001; Kui Ren 001; Jun Yu 002 (CVPR, 2023)

DATE: Domain Adaptive Product Seeker for E-Commerce. - Haoyuan Li 002; Hao Jiang 014; Tao Jin 004; Mengyan Li; Yan Chen; Zhijie Lin 001; Yang Zhao 022; Zhou Zhao 001 (CVPR, 2023)

WINNER: Weakly-supervised hIerarchical decompositioN and aligNment for spatio-tEmporal video gRounding. - Mengze Li 001; Han Wang 019; Wenqiao Zhang; Jiaxu Miao; Zhou Zhao 001; Shengyu Zhang 001; Wei Ji 008; Fei Wu 001 (CVPR, 2023)

Gloss Attention for Gloss-free Sign Language Translation. - Aoxiong Yin; Tianyun Zhong; Li Tang; Weike Jin; Tao Jin 004; Zhou Zhao 001 (CVPR, 2023)

ART: rule bAsed futuRe-inference deducTion. - Mengze Li 001; Tianqi Zhao; Jionghao Bai; Baoyi He; Jiaxu Miao; Wei Ji 008; Zheqi Lv; Zhou Zhao 001; Shengyu Zhang 001; Wenqiao Zhang; Fei Wu 001 (EMNLP, 2023)

ViT-TTS: Visual Text-to-Speech with Scalable Diffusion Transformer. - Huadai Liu; Rongjie Huang 001; Xuan Lin; Wenqiang Xu; Maozong Zheng; Hong Chen 002; Jinzheng He; Zhou Zhao 001 (EMNLP, 2023)

3DRP-Net: 3D Relative Position-aware Network for 3D Visual Grounding. - Zehan Wang 001; Haifeng Huang; Yang Zhao 022; Linjun Li; Xize Cheng; Yichen Zhu; Aoxiong Yin; Zhou Zhao 001 (EMNLP, 2023)

VarietySound: Timbre-Controllable Video to Sound Generation Via Unsupervised Information Disentanglement. - Chenye Cui; Zhou Zhao 001; Yi Ren 006; Jinglin Liu; Rongjie Huang 001; Feiyang Chen; Zhefeng Wang 001; Baoxing Huai; Fei Wu 001 (ICASSP, 2023)

Overview of the ICASSP 2023 General Meeting Understanding and Generation Challenge (MUG). - Qinglin Zhang; Chong Deng; Jiaqing Liu; Hai Yu; Qian Chen 003; Wen Wang 001; Zhijie Yan; Jinglin Liu; Yi Ren 006; Zhou Zhao 001 (ICASSP, 2023)

MUG: A General Meeting Understanding and Generation Benchmark. - Qinglin Zhang; Chong Deng; Jiaqing Liu; Hai Yu; Qian Chen 003; Wen Wang 001; Zhijie Yan; Jinglin Liu; Yi Ren 006; Zhou Zhao 001 (ICASSP, 2023)

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition. - Xize Cheng; Tao Jin 004; Rongjie Huang 001; Linjun Li; Wang Lin; Zehan Wang 001; Ye Wang 018; Huadai Liu; Aoxiong Yin; Zhou Zhao 001 (ICCV, 2023)

Exploring Group Video Captioning with Efficient Relational Approximation. - Wang Lin; Tao Jin 004; Ye Wang 018; Wenwen Pan 003; Linjun Li; Xize Cheng; Zhou Zhao 001 (ICCV, 2023)

Distilling Coarse-to-Fine Semantic Matching Knowledge for Weakly Supervised 3D Visual Grounding. - Zehan Wang 001; Haifeng Huang; Yang Zhao 022; Linjun Li; Xize Cheng; Yichen Zhu; Aoxiong Yin; Zhou Zhao 001 (ICCV, 2023)

Open-Vocabulary Object Detection With an Open Corpus. - Jiong Wang; Huiming Zhang; Haiwen Hong; Xuan Jin; Yuan He 011; Hui Xue 001; Zhou Zhao 001 (ICCV, 2023)

TranSpeech: Speech-to-Speech Translation With Bilateral Perturbation. - Rongjie Huang 001; Jinglin Liu; Huadai Liu; Yi Ren 006; Lichao Zhang; Jinzheng He; Zhou Zhao 001 (ICLR, 2023)

GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis. - Zhenhui Ye; Ziyue Jiang 001; Yi Ren 006; Jinglin Liu; Jinzheng He; Zhou Zhao 001 (ICLR, 2023)

Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models. - Rongjie Huang 001; Jiawei Huang 008; Dongchao Yang; Yi Ren 006; Luping Liu; Mingze Li; Zhenhui Ye; Jinglin Liu; Xiang Yin 006; Zhou Zhao 001 (ICML, 2023)

MSSRNet: Manipulating Sequential Style Representation for Unsupervised Text Style Transfer. - Yazheng Yang; Zhou Zhao 001; Qi Liu 049 (KDD, 2023)

Stable Prediction on Graphs with Agnostic Distribution Shifts. - Shengyu Zhang 001; Yunze Tong; Kun Kuang; Fuli Feng; Jiezhong Qiu; Jin Yu; Zhou Zhao 001; Hongxia Yang; Zhongfei Zhang; Fei Wu 001 (CDPD, 2023)

UniSinger: Unified End-to-End Singing Voice Synthesis With Cross-Modality Information Matching. - Zhiqing Hong; Chenye Cui; Rongjie Huang 001; Lichao Zhang; Jinglin Liu; Jinzheng He; Zhou Zhao 001 (ACM Multimedia, 2023)

Rethinking Missing Modality Learning from a Decoding Perspective. - Tao Jin 004; Xize Cheng; Linjun Li; Wang Lin; Ye Wang 018; Zhou Zhao 001 (ACM Multimedia, 2023)

Unsupervised Domain Adaptation for Video Object Grounding with Cascaded Debiasing Learning. - Mengze Li 001; Haoyu Zhang; Juncheng Li 006; Zhou Zhao 001; Wenqiao Zhang; Shengyu Zhang 001; Shiliang Pu; Yueting Zhuang; Fei Wu 001 (ACM Multimedia, 2023)

Unsupervised Domain Adaptation for Referring Semantic Segmentation. - Haonan Shi; Wenwen Pan 003; Zhou Zhao 001; Mingmin Zhang 001; Fei Wu 001 (ACM Multimedia, 2023)

Cross-modal Prompts: Adapting Large Pre-trained Models for Audio-Visual Downstream Tasks. - Haoyi Duan; Yan Xia 006; Mingze Zhou; Li Tang; Jieming Zhu; Zhou Zhao 001 (NeurIPS, 2023)

PTADisc: A Cross-Course Dataset Supporting Personalized Learning in Cold-Start Scenarios. - Liya Hu; Zhiang Dong; Jingyuan Chen; Guifeng Wang; Zhihua Wang 008; Zhou Zhao 001; Fei Wu 001 (NeurIPS, 2023)

Connecting Multi-modal Contrastive Representations. - Zehan Wang 001; Yang Zhao 022; Xize Cheng; Haifeng Huang; Jiageng Liu; Aoxiong Yin; Li Tang; Linjun Li; Yongqi Wang; Ziang Zhang; Zhou Zhao 001 (NeurIPS, 2023)

Achieving Cross Modal Generalization with Multimodal Unified Representation. - Yan Xia 006; Hai Huang 013; Jieming Zhu; Zhou Zhao 001 (NeurIPS, 2023)

Beyond Two-Tower Matching: Learning Sparse Retrievable Cross-Interactions for Recommendation. - Liangcai Su; Fan Yan; Jieming Zhu; Xi Xiao; Haoyi Duan; Zhou Zhao 001; Zhenhua Dong; Ruiming Tang (SIGIR, 2023)

DisCover: Disentangled Music Representation Learning for Cover Song Identification. - Jiahao Xun; Shengyu Zhang 001; Yanting Yang; Jieming Zhu; Liqun Deng; Zhou Zhao 001; Zhenhua Dong; Ruiqi Li; Lichao Zhang; Fei Wu 001 (SIGIR, 2023)

MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition. - Xize Cheng; Linjun Li; Tao Jin 004; Rongjie Huang 001; Wang Lin; Zehan Wang 001; Huangdai Liu; Ye Wang 018; Aoxiong Yin; Zhou Zhao 001 (CoRR, 2023)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. - Rongjie Huang 001; Mingze Li; Dongchao Yang; Jiatong Shi; Xuankai Chang; Zhenhui Ye; Yuning Wu 001; Zhiqing Hong; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Zhou Zhao 001; et al. (CoRR, 2023)

GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation. - Zhenhui Ye; Jinzheng He; Ziyue Jiang 001; Rongjie Huang 001; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Denoising Multi-modal Sequential Recommenders with Contrastive Learning. - Dong Yao; Shengyu Zhang 001; Zhou Zhao 001; Jieming Zhu; Wenqiao Zhang; Rui Zhang 003; Xiaofei He 001; Fei Wu 001 (CoRR, 2023)

Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation. - Jiawei Huang 008; Yi Ren 006; Rongjie Huang 001; Dongchao Yang; Zhenhui Ye; Chen Zhang 020; Jinglin Liu; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Make-A-Voice: Unified Voice Synthesis With Discrete Representation. - Rongjie Huang 001; Chunlei Zhang; Yongqi Wang; Dongchao Yang; Luping Liu; Zhenhui Ye; Ziyue Jiang 001; Chao Weng; Zhou Zhao 001; Dong Yu 001 (CoRR, 2023)

Detector Guidance for Multi-Object Text-to-Image Generation. - Luping Liu; Zijian Zhang 002; Yi Ren 006; Rongjie Huang 001; Xiang Yin 006; Zhou Zhao 001 (CoRR, 2023)

Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis. - Zhenhui Ye; Ziyue Jiang 001; Yi Ren 006; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias. - Ziyue Jiang 001; Yi Ren 006; Zhenhui Ye; Jinglin Liu; Chen Zhang 020; Qian Yang 006; Shengpeng Ji; Rongjie Huang 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Mega-TTS 2: Zero-Shot Text-to-Speech with Arbitrary Length Speech Prompts. - Ziyue Jiang 001; Jinglin Liu; Yi Ren 006; Jinzheng He; Chen Zhang 020; Zhenhui Ye; Pengfei Wei 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; Zhou Zhao 001 (CoRR, 2023)

Chat-3D: Data-efficiently Tuning Large Language Model for Universal Dialogue of 3D Scenes. - Zehan Wang 001; Haifeng Huang; Yang Zhao 022; Ziang Zhang; Zhou Zhao 001 (CoRR, 2023)

TextrolSpeech: A Text Style Control Speech Corpus With Codec Language Text-to-Speech Models. - Shengpeng Ji; Jialong Zuo; Minghui Fang 002; Ziyue Jiang 001; Feiyang Chen; Xinyu Duan; Baoxing Huai; Zhou Zhao 001 (CoRR, 2023)

UniAudio: An Audio Foundation Model Toward Universal Audio Generation. - Dongchao Yang; Jinchuan Tian; Xu Tan 003; Rongjie Huang 001; Songxiang Liu; Xuankai Chang; Jiatong Shi; Sheng Zhao; Jiang Bian 002; Xixin Wu; Zhou Zhao 001; Shinji Watanabe 001; et al. (CoRR, 2023)

Extending Multi-modal Contrastive Representations. - Zehan Wang 001; Ziang Zhang; Luping Liu; Yang Zhao 022; Haifeng Huang; Tao Jin 004; Zhou Zhao 001 (CoRR, 2023)

Unsupervised Discovery of Interpretable Directions in h-space of Pre-trained Diffusion Models. - Zijian Zhang 002; Luping Liu; Zhijie Lin 001; Yichen Zhu; Zhou Zhao 001 (CoRR, 2023)

Weakly-Supervised Video Moment Retrieval via Regularized Two-Branch Proposal Networks with Erasing Mechanism. - Haoyuan Li 002; Zhou Zhao 001; Zhu Zhang; Zhijie Lin 001 (CoRR, 2023)

Music-PAW: Learning Music Representations via Hierarchical Part-whole Interaction and Contrast. - Dong Yao; Shengyu Zhang 001; Zhou Zhao 001; Jieming Zhu; Liqun Deng; Wenqiao Zhang; Zhenhua Dong; Ruiming Tang; Xin Jiang 002 (CoRR, 2023)

Chat-3D v2: Bridging 3D Scene and Large Language Models with Object Identifiers. - Haifeng Huang; Zehan Wang 001; Rongjie Huang 001; Luping Liu; Xize Cheng; Yang Zhao 022; Tao Jin 004; Zhou Zhao 001 (CoRR, 2023)

Multi-Modal Domain Adaptation Across Video Scenes for Temporal Video Grounding. - Haifeng Huang; Yang Zhao 022; Zehan Wang 001; Yan Xia 006; Zhou Zhao 001 (CoRR, 2023)

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation. - Xize Cheng; Rongjie Huang 001; Linjun Li; Tao Jin 004; Zehan Wang 001; Aoxiong Yin; Minglei Li; Xinyu Duan; Changpeng Yang; Zhou Zhao 001 (CoRR, 2023)

Personalized Latent Structure Learning for Recommendation. - Shengyu Zhang 001; Fuli Feng; Kun Kuang; Wenqiao Zhang; Zhou Zhao 001; Hongxia Yang; Tat-Seng Chua; Fei Wu 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head. - Rongjie Huang 001; Mingze Li; Dongchao Yang; Jiatong Shi; Xuankai Chang; Zhenhui Ye; Yuning Wu 001; Zhiqing Hong; Jiawei Huang 008; Jinglin Liu; Yi Ren 006; Yuexian Zou; et al. (AAAI, 2024)

StyleSinger: Style Transfer for Out-of-Domain Singing Voice Synthesis. - Yu Zhang 126; Rongjie Huang 001; Ruiqi Li; Jinzheng He; Yan Xia 006; Feiyang Chen; Xinyu Duan; Baoxing Huai; Zhou Zhao 001 (AAAI, 2024)

TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation. - Xize Cheng; Rongjie Huang 001; Linjun Li; Zehan Wang 001; Tao Jin 004; Aoxiong Yin; Feiyang Chen; Xinyu Duan; Baoxing Huai; Zhou Zhao 001 (ACL (Findings), 2024)

Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition. - Zirun Guo; Tao Jin 004; Zhou Zhao 001 (ACL (1), 2024)

Text-to-Song: Towards Controllable Music Generation Incorporating Vocal and Accompaniment. - Zhiqing Hong; Rongjie Huang 001; Xize Cheng; Yongqi Wang; Ruiqi Li; Fuming You; Zhou Zhao 001; Zhimeng Zhang (ACL (1), 2024)

Make-A-Voice: Revisiting Voice Large Language Models as Scalable Multilingual and Multitask Learners. - Rongjie Huang 001; Chunlei Zhang; Yongqi Wang; Dongchao Yang; Jinchuan Tian; Zhenhui Ye; Luping Liu; Zehan Wang 001; Ziyue Jiang 001; Xuankai Chang; Jiatong Shi; Chao Weng; et al. (ACL (1), 2024)

MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech. - Shengpeng Ji; Ziyue Jiang 001; Hanting Wang; Jialong Zuo; Zhou Zhao 001 (ACL (1), 2024)

Rethinking the Multimodal Correlation of Multimodal Sequential Learning via Generalizable Attentional Results Alignment. - Tao Jin 004; Wang Lin; Ye Wang 018; Linjun Li; Xize Cheng; Zhou Zhao 001 (ACL (1), 2024)

Uni-Dubbing: Zero-Shot Speech Synthesis from Visual Articulation. - Songju Lei; Xize Cheng; Mengjiao Lyu; Jianqiao Hu; Jintao Tan; Runlin Liu; Lingyu Xiong; Tao Jin 004; Xiandong Li; Zhou Zhao 001 (ACL (1), 2024)

Robust Singing Voice Transcription Serves Synthesis. - Ruiqi Li; Yu Zhang 126; Yongqi Wang; Zhiqing Hong; Rongjie Huang 001; Zhou Zhao 001 (ACL (1), 2024)

Self-Supervised Singing Voice Pre-Training towards Speech-to-Singing Conversion. - Ruiqi Li; Rongjie Huang 001; Yongqi Wang; Zhiqing Hong; Zhou Zhao 001 (ACL (Findings), 2024)

Wav2SQL: Direct Generalizable Speech-To-SQL Parsing. - Huadai Liu; Rongjie Huang 001; Jinzheng He; Gang Sun 004; Ran Shen; Xize Cheng; Zhou Zhao 001 (ACL (Findings), 2024)

Speech-to-Speech Translation with Discrete-Unit-Based Style Transfer. - Yongqi Wang; Jionghao Bai; Rongjie Huang 001; Ruiqi Li; Zhiqing Hong; Zhou Zhao 001 (ACL (Student Research Workshop), 2024)

AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension. - Qian Yang 006; Jin Xu; Wenrui Liu 003; Yunfei Chu; Ziyue Jiang 001; Xiaohuan Zhou; Yichong Leng; Yuanjun Lv; Zhou Zhao 001; Chang Zhou; Jingren Zhou 001 (ACL (1), 2024)

MPOD123: One Image to 3D Content Generation Using Mask-Enhanced Progressive Outline-to-Detail Optimization. - Jimin Xu; Tianbao Wang; Tao Jin 004; Shengyu Zhang 001; Dongjie Fu; Zhe Wang; Jiangjing Lyu; Chengfei Lv; Chaoyue Niu; Zhou Yu 001; Zhou Zhao 001; Fei Wu 001 (CVPR, 2024)

TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control. - Yu Zhang 126; Ziyue Jiang 001; Ruiqi Li; Changhao Pan; Jinzheng He; Rongjie Huang 001; Chuxin Wang; Zhou Zhao 001 (EMNLP, 2024)

TextrolSpeech: A Text Style Control Speech Corpus with Codec Language Text-to-Speech Models. - Shengpeng Ji; Jialong Zuo; Minghui Fang 002; Ziyue Jiang 004; Feiyang Chen; Xinyu Duan; Baoxing Huai; Zhou Zhao 001 (ICASSP, 2024)

Language Model is a Branch Predictor for Simultaneous Machine Translation. - Aoxiong Yin; Tianyun Zhong; Haoyuan Li 002; Siliang Tang; Zhou Zhao 001 (ICASSP, 2024)

Mega-TTS 2: Boosting Prompting Mechanisms for Zero-Shot Speech Synthesis. - Ziyue Jiang 001; Jinglin Liu; Yi Ren 006; Jinzheng He; Zhenhui Ye; Shengpeng Ji; Qian Yang 006; Chen Zhang 020; Pengfei Wei 001; Chunfeng Wang; Xiang Yin 006; Zejun Ma; et al. (ICLR, 2024)

Real3D-Portrait: One-shot Realistic 3D Talking Portrait Synthesis. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Jiaqi Yang 008; Weichuang Li; Jiawei Huang 008; Ziyue Jiang 001; Jinzheng He; Rongjie Huang 001; Jinglin Liu; Chen Zhang 020; Xiang Yin 006; et al. (ICLR, 2024)

FreeBind: Free Lunch in Unified Multimodal Space via Knowledge Fusion. - Zehan Wang 001; Ziang Zhang; Xize Cheng; Rongjie Huang 001; Luping Liu; Zhenhui Ye; Haifeng Huang; Yang Zhao 022; Tao Jin 004; Peng Gao 007; Zhou Zhao 001 (ICML, 2024)

InstructSpeech: Following Speech Editing Instructions via Large Language Models. - Rongjie Huang 001; Ruofan Hu; Yongqi Wang; Zehan Wang 001; Xize Cheng; Ziyue Jiang 001; Zhenhui Ye; Dongchao Yang; Luping Liu; Peng Gao 007; Zhou Zhao 001 (ICML, 2024)

Non-confusing Generation of Customized Concepts in Diffusion Models. - Wang Lin; Jingyuan Chen; Jiaxin Shi; Yichen Zhu; Chen Liang; Junzhong Miao; Tao Jin 004; Zhou Zhao 001; Fei Wu 001; Shuicheng Yan; Hanwang Zhang (ICML, 2024)

UniAudio: Towards Universal Audio Generation with Large Language Models. - Dongchao Yang; Jinchuan Tian; Xu Tan 003; Rongjie Huang 001; Songxiang Liu; Haohan Guo; Xuankai Chang; Jiatong Shi; Sheng Zhao; Jiang Bian 002; Zhou Zhao 001; Xixin Wu; et al. (ICML, 2024)

MSceneSpeech: A Multi-Scene Speech Dataset For Expressive Speech Synthesis. - Qian Yang 006; Jialong Zuo; Zhe Su; Ziyue Jiang 001; Mingze Li; Zhou Zhao 001; Feiyang Chen; Zhefeng Wang 001; Baoxing Huai (INTERSPEECH, 2024)

Multimodal Pretraining, Adaptation, and Generation for Recommendation: A Survey. - Qijiong Liu; Jieming Zhu; Yanting Yang; Quanyu Dai; Zhaocheng Du; Xiao-Ming Wu 003; Zhou Zhao 001; Rui Zhang 003; Zhenhua Dong (KDD, 2024)

EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration. - Ye Wang 018; Jiahao Xun; Minjie Hong; Jieming Zhu; Tao Jin 004; Wang Lin; Haoyuan Li 002; Linjun Li; Yan Xia 006; Zhou Zhao 001; Zhenhua Dong (KDD, 2024)

Cross-modal Observation Hypothesis Inference. - Mengze Li 001; Kairong Han; Jiahe Xu 003; Yueying Li; Tao Wu; Zhou Zhao 001; Jiaxu Miao; Shengyu Zhang 001; Jingyuan Chen (ACM Multimedia, 2024)

Calibrating Prompt from History for Continual Vision-Language Retrieval and Grounding. - Tao Jin 004; Weicai Yan; Ye Wang 018; Sihang Cai; Qifan Shuai; Zhou Zhao 001 (ACM Multimedia, 2024)

Boosting Speech Recognition Robustness to Modality-Distortion with Contrast-Augmented Prompts. - Dongjie Fu; Xize Cheng; Xiaoda Yang; Hanting Wang; Zhou Zhao 001; Tao Jin 004 (ACM Multimedia, 2024)

VoiceTuner: Self-Supervised Pre-training and Efficient Fine-tuning For Voice Generation. - Rongjie Huang 001; Yongqi Wang; Ruofan Hu; Xiaoshan Xu; Zhiqing Hong; Dongchao Yang; Xize Cheng; Zehan Wang 001; Ziyue Jiang 001; Zhenhui Ye; Luping Liu; Siqi Zheng; et al. (ACM Multimedia, 2024)

AudioLCM: Efficient and High-Quality Text-to-Audio Generation with Minimal Inference Steps. - Huadai Liu; Rongjie Huang 001; Yang Liu 278; Hengyuan Cao; Jialei Wang; Xize Cheng; Siqi Zheng; Zhou Zhao 001 (ACM Multimedia, 2024)

Semantic Codebook Learning for Dynamic Recommendation Models. - Zheqi Lv; Shaoxuan He; Tianyu Zhan; Shengyu Zhang 001; Wenqiao Zhang; Jingyuan Chen; Zhou Zhao 001; Fei Wu 001 (ACM Multimedia, 2024)

Semantic Alignment for Multimodal Large Language Models. - Tao Wu; Mengze Li 001; Jingyuan Chen; Wei Ji 008; Wang Lin; Jinyang Gao; Kun Kuang; Zhou Zhao 001; Fei Wu 001 (ACM Multimedia, 2024)

Low-rank Prompt Interaction for Continual Vision-Language Retrieval. - Weicai Yan; Ye Wang 018; Wang Lin; Zirun Guo; Zhou Zhao 001; Tao Jin 004 (ACM Multimedia, 2024)

SyncTalklip: Highly Synchronized Lip-Readable Speaker Generation with Multi-Task Learning. - Xiaoda Yang; Xize Cheng; Dongjie Fu; Minghui Fang 002; Jialong Zuo; Shengpeng Ji; Zhou Zhao 001; Tao Jin 004 (ACM Multimedia, 2024)

Prompt-Singer: Controllable Singing-Voice-Synthesis with Natural Language Prompt. - Yongqi Wang; Ruofan Hu; Rongjie Huang 001; Zhiqing Hong; Ruiqi Li; Wenrui Liu 003; Fuming You; Tao Jin 004; Zhou Zhao 001 (NAACL-HLT, 2024)

Classifier-guided Gradient Modulation for Enhanced Multimodal Learning. - Zirun Guo; Tao Jin 004; Jingyuan Chen; Zhou Zhao 001 (NeurIPS, 2024)

Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifiers. - Haifeng Huang; Yilun Chen; Zehan Wang 001; Rongjie Huang 001; Runsen Xu; Tai Wang; Luping Liu; Xize Cheng; Yang Zhao 022; Jiangmiao Pang; Zhou Zhao 001 (NeurIPS, 2024)

Action Imitation in Common Action Space for Customized Action Image Synthesis. - Wang Lin; Jingyuan Chen; Jiaxin Shi; Zirun Guo; Yichen Zhu; Zehan Wang 001; Tao Jin 004; Zhou Zhao 001; Fei Wu 001; Shuicheng Yan; Hanwang Zhang (NeurIPS, 2024)

E3: Exploring Embodied Emotion Through A Large-Scale Egocentric Video Dataset. - Wang Lin; Yueying Feng; WenKang Han; Tao Jin 004; Zhou Zhao 001; Fei Wu 001; Chang Yao; Jingyuan Chen (NeurIPS, 2024)

Frieren: Efficient Video-to-Audio Generation Network with Rectified Flow Matching. - Yongqi Wang; Wenxiang Guo; Rongjie Huang 001; Jiawei Huang 008; Zehan Wang 001; Fuming You; Ruiqi Li; Zhou Zhao 001 (NeurIPS, 2024)

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Ziyue Jiang 001; Jiawei Huang 008; Rongjie Huang 001; Jinglin Liu; Jinzheng He; Chen Zhang 020; Zehan Wang 001; Xize Cheng; Xiang Yin 006; et al. (NeurIPS, 2024)

MoMu-Diffusion: On Learning Long-Term Motion-Music Synchronization and Correspondence. - Fuming You; Minghui Fang 002; Li Tang; Rongjie Huang 001; Yongqi Wang; Zhou Zhao 001 (NeurIPS, 2024)

Extending Multi-modal Contrastive Representations. - Ziang Zhang; Zehan Wang 001; Luping Liu; Rongjie Huang 001; Xize Cheng; Zhenhui Ye; Wang Lin; Huadai Liu; Haifeng Huang; Yang Zhao 022; Tao Jin 004; Siqi Zheng; et al. (NeurIPS, 2024)

GTSinger: A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks. - Yu Zhang 126; Changhao Pan; Wenxiang Guo; Ruiqi Li; Zhiyuan Zhu; Jialei Wang; Wenhao Xu; Jingyu Lu; Zhiqing Hong; Chuxin Wang; Lichao Zhang; Jinzheng He; et al. (NeurIPS, 2024)

MART: Learning Hierarchical Music Audio Representations with Part-Whole Transformer. - Dong Yao; Jieming Zhu; Jiahao Xun; Shengyu Zhang 001; Zhou Zhao 001; Liqun Deng; Wenqiao Zhang; Zhenhua Dong; Xin Jiang 002 (WWW (Companion Volume), 2024)

MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech. - Shengpeng Ji; Ziyue Jiang 004; Hanting Wang; Jialong Zuo; Zhou Zhao 001 (CoRR, 2024)

Language-Codec: Reducing the Gaps Between Discrete Codec Representation and Speech Language Models. - Shengpeng Ji; Minghui Fang 002; Ziyue Jiang 001; Rongjie Huang 001; Jialong Zuo; Shulei Wang; Zhou Zhao 001 (CoRR, 2024)

Unlocking the Potential of Multimodal Unified Discrete Representation through Training-Free Codebook Optimization and Hierarchical Alignment. - Hai Huang 013; Yan Xia 006; Shengpeng Ji; Shulei Wang; Hanting Wang; Jieming Zhu; Zhenhua Dong; Zhou Zhao 001 (CoRR, 2024)

Text-to-Song: Towards Controllable Music Generation Incorporating Vocals and Accompaniment. - Zhiqing Hong; Rongjie Huang 001; Xize Cheng; Yongqi Wang; Ruiqi Li; Fuming You; Zhou Zhao 001; Zhimeng Zhang (CoRR, 2024)

MergeNet: Knowledge Migration across Heterogeneous Models, Tasks, and Modalities. - Kunxi Li; Tianyu Zhan; Shengyu Zhang 001; Kun Kuang; Jiwei Li 001; Zhou Zhao 001; Fei Wu 001 (CoRR, 2024)

Frieren: Efficient Video-to-Audio Generation with Rectified Flow Matching. - Yongqi Wang; Wenxiang Guo; Rongjie Huang 001; Jiawei Huang 008; Zehan Wang 001; Fuming You; Ruiqi Li; Zhou Zhao 001 (CoRR, 2024)

AudioLCM: Text-to-Audio Generation with Latent Consistency Models. - Huadai Liu; Rongjie Huang 001; Yang Liu 278; Hengyuan Cao; Jialei Wang; Xize Cheng; Siqi Zheng; Zhou Zhao 001 (CoRR, 2024)

ControlSpeech: Towards Simultaneous Zero-shot Speaker Cloning and Zero-shot Language Style Control With Decoupled Codec. - Shengpeng Ji; Jialong Zuo; Minghui Fang 002; Siqi Zheng; Qian Chen 003; Wen Wang 001; Ziyue Jiang 001; Hai Huang 013; Xize Cheng; Rongjie Huang 001; Zhou Zhao 001 (CoRR, 2024)

EAGER: Two-Stream Generative Recommender with Behavior-Semantic Collaboration. - Ye Wang 018; Jiahao Xun; Mingjie Hong; Jieming Zhu; Tao Jin 004; Wang Lin; Haoyuan Li 002; Linjun Li; Yan Xia 006; Zhou Zhao 001; Zhenhua Dong (CoRR, 2024)

ACE: A Generative Cross-Modal Retrieval Framework with Coarse-To-Fine Semantic Modeling. - Minghui Fang 002; Shengpeng Ji; Jialong Zuo; Hai Huang 013; Yan Xia 006; Jieming Zhu; Xize Cheng; Xiaoda Yang; Wenrui Liu 003; Gang Wang; Zhenhua Dong; Zhou Zhao 001 (CoRR, 2024)

Accompanied Singing Voice Synthesis with Fully Text-controlled Melody. - Ruiqi Li; Zhiqing Hong; Yongqi Wang; Lichao Zhang; Rongjie Huang 001; Siqi Zheng; Zhou Zhao 001 (CoRR, 2024)

OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces. - Zehan Wang 001; Ziang Zhang; Hang Zhang; Luping Liu; Rongjie Huang 001; Xize Cheng; Hengshuang Zhao; Zhou Zhao 001 (CoRR, 2024)

MEDIC: Zero-shot Music Editing with Disentangled Inversion Control. - Huadai Liu; Jialei Wang; Rongjie Huang 001; Yang Liu 278; Jiayang Xu; Zhou Zhao 001 (CoRR, 2024)

MulliVC: Multi-lingual Voice Conversion With Cycle Consistency. - Jiawei Huang 008; Chen Zhang 020; Yi Ren 006; Ziyue Jiang 001; Zhenhui Ye; Jinglin Liu; Jinzheng He; Xiang Yin 006; Zhou Zhao 001 (CoRR, 2024)

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling. - Shengpeng Ji; Ziyue Jiang 001; Xize Cheng; Yifu Chen; Minghui Fang 002; Jialong Zuo; Qian Yang 006; Ruiqi Li; Ziang Zhang; Xiaoda Yang; Rongjie Huang 001; Yidi Jiang; et al. (CoRR, 2024)

STORE: Streamlining Semantic Tokenization and Generative Recommendation with A Single LLM. - Qijiong Liu; Jieming Zhu; Lu Fan; Zhou Zhao 001; Xiao-Ming Wu 003 (CoRR, 2024)

Analyzing and Mitigating Inconsistency in Discrete Audio Tokens for Neural Codec Language Models. - Wenrui Liu 003; Zhifang Guo; Jin Xu; Yuanjun Lv; Yunfei Chu; Zhou Zhao 001; Junyang Lin (CoRR, 2024)

MimicTalk: Mimicking a personalized and expressive 3D talking face in minutes. - Zhenhui Ye; Tianyun Zhong; Yi Ren 006; Ziyue Jiang 001; Jiawei Huang 008; Rongjie Huang 001; Jinglin Liu; Jinzheng He; Chen Zhang 020; Zehan Wang 001; Xize Chen; Xiang Yin 006; et al. (CoRR, 2024)

FlashAudio: Rectified Flows for Fast and High-Fidelity Text-to-Audio Generation. - Huadai Liu; Jialei Wang; Rongjie Huang 001; Yang Liu 278; Heng Lu; Wei Xue 002; Zhou Zhao 001 (CoRR, 2024)

MuVi: Video-to-Music Generation with Semantic Alignment and Rhythmic Synchronization. - Ruiqi Li; Siqi Zheng; Xize Cheng; Ziang Zhang; Shengpeng Ji; Zhou Zhao 001 (CoRR, 2024)

A Comprehensive Survey of Datasets, Theories, Variants, and Applications in Direct Preference Optimization. - Wenyi Xiao; Zechuan Wang; Leilei Gan; Shuai Zhao 007; Wanggui He; Luu Anh Tuan; Long Chen 016; Hao Jiang 014; Zhou Zhao 001; Fei Wu 001 (CoRR, 2024)

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup. - Xize Cheng; Siqi Zheng; Zehan Wang 001; Minghui Fang 002; Ziang Zhang; Rongjie Huang 001; Ziyang Ma; Shengpeng Ji; Jialong Zuo; Tao Jin 004; Zhou Zhao 001 (CoRR, 2024)

WavChat: A Survey of Spoken Dialogue Models. - Shengpeng Ji; Yifu Chen; Minghui Fang 002; Jialong Zuo; Jingyu Lu; Hanting Wang; Ziyue Jiang 001; Long Zhou; Shujie Liu 001; Xize Cheng; Xiaoda Yang; Zehan Wang 001; et al. (CoRR, 2024)

Orient Anything: Learning Robust Object Orientation Estimation from Rendering 3D Models. - Zehan Wang 001; Ziang Zhang; Tianyu Pang; Chao Du; Hengshuang Zhao; Zhou Zhao 001 (CoRR, 2024)

Causal Distillation for Alleviating Performance Heterogeneity in Recommender Systems. - Shengyu Zhang 001; Ziqi Jiang; Jiangchao Yao; Fuli Feng; Kun Kuang; Zhou Zhao 001; Shuo Li; Hongxia Yang; Tat-Seng Chua; Fei Wu 001 (IEEE Trans. Knowl. Data Eng., 2024)

SLED: Structure Learning based Denoising for Recommendation. - Shengyu Zhang 001; Tan Jiang; Kun Kuang; Fuli Feng; Jin Yu; Jianxin Ma; Zhou Zhao 001; Jianke Zhu; Hongxia Yang; Tat-Seng Chua; Fei Wu 001 (ACM Trans. Inf. Syst., 2024)

Video Moment Retrieval With Noisy Labels. - Wenwen Pan 003; Zhou Zhao 001; Wencan Huang; Zhu Zhang; Liyong Fu; Zhigeng Pan; Jun Yu 002; Fei Wu 001 (IEEE Trans. Neural Networks Learn. Syst., 2024)

Multi-Granularity Relational Attention Network for Audio-Visual Question Answering. - Linjun Li; Tao Jin 004; Wang Lin; Hao Jiang 014; Wenwen Pan 003; Jian Wang 119; Shuwen Xiao; Yan Xia 006; Weihao Jiang; Zhou Zhao 001 (IEEE Trans. Circuits Syst. Video Technol., 2024)

TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching. - Wenxiang Guo; Yu Zhang 126; Changhao Pan; Rongjie Huang 001; Li Tang; Ruiqi Li; Zhiqing Hong; Yongqi Wang; Zhou Zhao 001 (AAAI, 2025)

Speech Watermarking with Discrete Intermediate Representations. - Shengpeng Ji; Ziyue Jiang 001; Jialong Zuo; Minghui Fang 002; Yifu Chen; Tao Jin 004; Zhou Zhao 001 (AAAI, 2025)

MergeNet: Knowledge Migration Across Heterogeneous Models, Tasks, and Modalities. - Kunxi Li; Tianyu Zhan; Kairui Fu; Shengyu Zhang 001; Kun Kuang; Jiwei Li 001; Zhou Zhao 001; Fan Wu 006; Fei Wu 001 (AAAI, 2025)

T2A-Feedback: Improving Basic Capabilities of Text-to-Audio Generation via Fine-grained AI Feedback. - Zehan Wang 001; Ke Lei; Chen Zhu; Jiawei Huang 008; Sashuai Zhou; Luping Liu; Xize Cheng; Shengpeng Ji; Zhenhui Ye; Tao Jin 004; Zhou Zhao 001 (ACL (1), 2025)

CART: A Generative Cross-Modal Retrieval Framework With Coarse-To-Fine Semantic Modeling. - Minghui Fang 002; Shengpeng Ji; Jialong Zuo; Hai Huang 013; Yan Xia 006; Jieming Zhu; Xize Cheng; Xiaoda Yang; Wenrui Liu 003; Gang Wang; Zhenhua Dong; Zhou Zhao 001 (ACL (1), 2025)

Enhancing Multimodal Unified Representations for Cross Modal Generalization. - Hai Huang 013; Yan Xia 006; Shengpeng Ji; Shulei Wang; Hanting Wang; Minghui Fang 002; Jieming Zhu; Zhenhua Dong; Sashuai Zhou; Zhou Zhao 001 (ACL (Findings), 2025)

STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation. - Wenxiang Guo; Yu Zhang 126; Changhao Pan; Zhiyuan Zhu; Ruiqi Li; ZheTao Chen; Wenhao Xu; Fei Wu 001; Zhou Zhao 001 (ACL (Findings), 2025)

OS Agents: A Survey on MLLM-based Agents for Computer, Phone and Browser Use. - Xueyu Hu; Tao Xiong; Biao Yi; Zishu Wei; Ruixuan Xiao; Yurun Chen 004; Jiasheng Ye; Meiling Tao; Xiangxin Zhou; Ziyu Zhao 001; Yuhuai Li; Shengze Xu; et al. (ACL (1), 2025)

Language-Codec: Bridging Discrete Codec Representations and Speech Language Models. - Shengpeng Ji; Minghui Fang 002; Jialong Zuo; Ziyue Jiang 004; Dingdong Wang; Hanting Wang; Hai Huang 013; Zhou Zhao 001 (ACL (1), 2025)

ControlSpeech: Towards Simultaneous and Independent Zero-shot Speaker Cloning and Zero-shot Language Style Control. - Shengpeng Ji; Qian Chen 003; Wen Wang 001; Jialong Zuo; Minghui Fang 002; Ziyue Jiang 004; Hai Huang 013; Zehan Wang 001; Xize Cheng; Siqi Zheng; Zhou Zhao 001 (ACL (1), 2025)

FlashAudio: Rectified Flow for Fast and High-Fidelity Text-to-Audio Generation. - Huadai Liu; Jialei Wang; Rongjie Huang 001; Yang Liu 278; Heng Lu; Zhou Zhao 001; Wei Xue 002 (ACL (1), 2025)

Sign2Vis: Automated Data Visualization from Sign Language. - Yao Wan 001; Yang Wu 010; Zhen Li 050; Guobiao Zhang; Hongyu Zhang 002; Zhou Zhao 001; Hai Jin 001; April Wang (ACL (Findings), 2025)

TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis. - Yu Zhang 126; Wenxiang Guo; Changhao Pan; Dongyu Yao; Zhiyuan Zhu; Ziyue Jiang 001; Yuhan Wang; Tao Jin 004; Zhou Zhao 001 (ACL (Findings), 2025)

Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching. - Jialong Zuo; Shengpeng Ji; Minghui Fang 002; Mingze Li; Ziyue Jiang 001; Xize Cheng; Xiaoda Yang; Feiyang Chen; Xinyu Duan; Zhou Zhao 001 (ACL (1), 2025)

VoxpopuliTTS: a large-scale multilingual TTS corpus for zero-shot speech generation. - Wenrui Liu 003; Jionghao Bai; Xize Cheng; Jialong Zuo; Ziyue Jiang 001; Shengpeng Ji; Minghui Fang 002; Xiaoda Yang; Qian Yang 006; Zhou Zhao 001 (COLING, 2025)

SpatialCLIP: Learning 3D-aware Image Representations from Spatially Discriminative Language. - Zehan Wang 001; Sashuai Zhou; Shaoxuan He; Haifeng Huang; Lihe Yang; Ziang Zhang; Xize Cheng; Shengpeng Ji; Tao Jin 004; Hengshuang Zhao; Zhou Zhao 001 (CVPR, 2025)

RoboGround: Robotic Manipulation with Grounded Vision-Language Priors. - Haifeng Huang; Xinyi Chen; Yilun Chen; Hao Li 009; Xiaoshen Han; Zehan Wang 001; Tai Wang; Jiangmiao Pang; Zhou Zhao 001 (CVPR, 2025)

Non-Natural Image Understanding with Advancing Frequency-based Vision Encoders. - Wang Lin; Qingsong Wang; Yueying Feng; Shulei Wang; Tao Jin 004; Zhou Zhao 001; Fei Wu 001; Chang Yao; Jingyuan Chen (CVPR, 2025)

Towards Transformer-Based Aligned Generation with Self-Coherence Guidance. - Shulei Wang; Wang Lin; Hai Huang 013; Hanting Wang; Sihang Cai; WenKang Han; Tao Jin 004; Jingyuan Chen; Jiacheng Sun; Jieming Zhu; Zhou Zhao 001 (CVPR, 2025)

FADA: Fast Diffusion Avatar Synthesis with Mixed-Supervised Multi-CFG Distillation. - Tianyun Zhong; Chao Liang; Jianwen Jiang; Gaojie Lin; Jiaqi Yang 008; Zhou Zhao 001 (CVPR, 2025)

Curriculum Learning aided Audio-Visual Speech Recognition with Arbitrary Speaker Number. - Yuxiao Lin; Tao Jin 004; Xize Cheng; Zhou Zhao 001; Fei Wu 001 (ICASSP, 2025)

NAT3DSound: 3D Spatial Sound Field Synthesis with Multi-Modal Non-Autoregressive Transformer. - Fuming You; Rongjie Huang 001; Boyang Zhang; Yongqi Wang; Zhiqing Hong; Zhimeng Zhang; Zhou Zhao 001 (ICASSP, 2025)

Enhancing Expressive Voice Conversion with Discrete Pitch-Conditioned Flow Matching Model. - Jialong Zuo; Shengpeng Ji; Minghui Fang 002; Ziyue Jiang 001; Xize Cheng; Qian Yang 006; Wenrui Liu 003; Guangyan Zhang; Zehai Tu; Yiwen Guo; Zhou Zhao 001 (ICASSP, 2025)

OmniBind: Large-scale Omni Multimodal Representation via Binding Spaces. - Zehan Wang 001; Ziang Zhang; Minjie Hong; Hang Zhang; Luping Liu; Rongjie Huang 001; Xize Cheng; Shengpeng Ji; Tao Jin 004; Hengshuang Zhao; Zhou Zhao 001 (ICLR, 2025)

VoxDialogue: Can Spoken Dialogue Systems Understand Information Beyond Words? - Xize Cheng; Ruofan Hu; Xiaoda Yang; Jingyu Lu; Dongjie Fu; Zehan Wang 001; Shengpeng Ji; Rongjie Huang 001; Boyang Zhang; Tao Jin 004; Zhou Zhao 001 (ICLR, 2025)

OmniSep: Unified Omni-Modality Sound Separation with Query-Mixup. - Xize Cheng; Siqi Zheng; Zehan Wang 001; Minghui Fang 002; Ziang Zhang; Rongjie Huang 001; Shengpeng Ji; Jialong Zuo; Tao Jin 004; Zhou Zhao 001 (ICLR, 2025)

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling. - Shengpeng Ji; Ziyue Jiang 001; Wen Wang 001; Yifu Chen; Minghui Fang 002; Jialong Zuo; Qian Yang 006; Xize Cheng; Zehan Wang 001; Ruiqi Li; Ziang Zhang; Xiaoda Yang; et al. (ICLR, 2025)

SkinGEN: an Explainable Dermatology Diagnosis-to-Generation Framework with Interactive Vision-Language Models. - Bo Lin; Yingjing Xu; Xuanwen Bao; Zhou Zhao 001; Zhouyang Wang; Jianwei Yin (IUI, 2025)

Data-Efficiently Learn Large Language Model for Universal 3D Scene Perception. - Zehan Wang 001; Haifeng Huang; Yang Zhao 022; Ziang Zhang; Tao Jin 004; Zhou Zhao 001 (NAACL (Findings), 2025)

EAGER-LLM: Enhancing Large Language Models as Recommenders through Exogenous Behavior-Semantic Integration. - Minjie Hong; Yan Xia 006; Zehan Wang 001; Jieming Zhu; Ye Wang 018; Sihang Cai; Xiaoda Yang; Quanyu Dai; Zhenhua Dong; Zhimeng Zhang; Zhou Zhao 001 (WWW, 2025)

Recognize-and-tell: Generating video captions with textual cue in scene. - Tao Jin 004; Wang Lin; Hao Jiang 014; Jian Wang 119; Xiao Jin; Zhimeng Zhang; Jingyuan Chen; Zhou Zhao 001; Zhongfei Zhang (Expert Syst. Appl., 2025)

OmniChat: Enhancing Spoken Dialogue Systems with Scalable Synthetic Data for Diverse Scenarios. - Xize Cheng; Dongjie Fu; Xiaoda Yang; Minghui Fang 002; Ruofan Hu; Jingyu Lu; Jionghao Bai; Zehan Wang 001; Shengpeng Ji; Rongjie Huang 001; Linjun Li; Yu Chen; et al. (CoRR, 2025)

WavRAG: Audio-Integrated Retrieval Augmented Generation for Spoken Dialogue Models. - Yifu Chen; Shengpeng Ji; Haoxiao Wang; Ziqing Wang; Siyu Chen; Jinzheng He; Jin Xu; Zhou Zhao 001 (CoRR, 2025)

CODESYNC: Synchronizing Large Language Models with Dynamic Code Evolution at Scale. - Chenlong Wang; Zhaoyang Chu; Zhengxiang Cheng; Xuyi Yang; Kaiyue Qiu; Yao Wan 001; Zhou Zhao 001; Xuanhua Shi; Dongping Chen (CoRR, 2025)

Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis. - Ziyue Jiang 001; Yi Ren 006; Ruiqi Li; Shengpeng Ji; Zhenhui Ye; Chen Zhang 020; Jionghao Bai; Xiaoda Yang; Jialong Zuo; Yu Zhang 126; Rui Liu 008; Xiang Yin 006; et al. (CoRR, 2025)

Continual Cross-Modal Generalization. - Yan Xia 006; Hai Huang 013; Minghui Fang 002; Zhou Zhao 001 (CoRR, 2025)

OmniAudio: Generating Spatial Audio from 360-Degree Video. - Huadai Liu; Tianyi Luo; Qikai Jiang; Kaicheng Luo; Peiwen Sun; Jialei Wang; Rongjie Huang 001; Qian Chen 003; Wen Wang 001; Xiangtai Li; Shiliang Zhang; Zhijie Yan; et al. (CoRR, 2025)

Unleashing the Power of Natural Audio Featuring Multiple Sound Sources. - Xize Cheng; Slytherin Wang; Zehan Wang 001; Rongjie Huang 001; Tao Jin 004; Zhou Zhao 001 (CoRR, 2025)

Versatile Framework for Song Generation with Prompt-based Control. - Yu Zhang 126; Wenxiang Guo; Changhao Pan; Zhiyuan Zhu; Ruiqi Li; Jingyu Lu; Rongjie Huang 001; Ruiyuan Zhang; Zhiqing Hong; Ziyue Jiang 001; Zhou Zhao 001 (CoRR, 2025)

ISDrama: Immersive Spatial Drama Generation through Multimodal Prompting. - Yu Zhang 126; Wenxiang Guo; Changhao Pan; Zhiyuan Zhu; Tao Jin 004; Zhou Zhao 001 (CoRR, 2025)

WavReward: Spoken Dialogue Models With Generalist Reward Evaluators. - Shengpeng Ji; Tianle Liang; Yangzhuo Li; Jialong Zuo; Minghui Fang 002; Jinzheng He; Yifu Chen; Zhengqing Liu; Ziyue Jiang 001; Xize Cheng; Siqi Zheng; Jin Xu; et al. (CoRR, 2025)

Depth Anything with Any Prior. - Zehan Wang 001; Siyu Chen; Lihe Yang; Jialei Wang; Ziang Zhang; Hengshuang Zhao; Zhou Zhao 001 (CoRR, 2025)

IRBridge: Solving Image Restoration Bridge with Pre-trained Generative Diffusion Models. - Hanting Wang; Tao Jin 004; Wang Lin; Shulei Wang; Hai Huang 013; Shengpeng Ji; Zhou Zhao 001 (CoRR, 2025)

GenSpace: Benchmarking Spatially-Aware Image Generation. - Zehan Wang 001; Jiayang Xu; Ziang Zhang; Tianyu Pan; Chao Du; Hengshuang Zhao; Zhou Zhao 001 (CoRR, 2025)

ThinkSound: Chain-of-Thought Reasoning in Multimodal Large Language Models for Audio Generation and Editing. - Huadai Liu; Jialei Wang; Kaicheng Luo; Wen Wang 001; Qian Chen 003; Zhou Zhao 001; Wei Xue 002 (CoRR, 2025)

APO: Enhancing Reasoning Ability of MLLMs via Asymmetric Policy Optimization. - Minjie Hong; Zirun Guo; Yan Xia 006; Zehan Wang 001; Ziang Zhang; Tao Jin 004; Zhou Zhao 001 (CoRR, 2025)

Bridging Domain Generalization to Multimodal Domain Generalization via Unified Representations. - Hai Huang 013; Yan Xia 006; Sashuai Zhou; Hanting Wang; Shulei Wang; Zhou Zhao 001 (CoRR, 2025)

STARS: A Unified Framework for Singing Transcription, Alignment, and Refined Style Annotation. - Wenxiang Guo; Yu Zhang 126; Changhao Pan; Zhiyuan Zhu; Ruiqi Li; Zhetao Chen; Wenhao Xu; Fei Wu 001; Zhou Zhao 001 (CoRR, 2025)

Open-set Cross Modal Generalization via Multimodal Unified Representation. - Hai Huang 013; Yan Xia 006; Shulei Wang; Hanting Wang; Minghui Fang 002; Shengpeng Ji; Sashuai Zhou; Tao Jin 004; Zhou Zhao 001 (CoRR, 2025)

OS Agents: A Survey on MLLM-based Agents for General Computing Devices Use. - Xueyu Hu; Tao Xiong; Biao Yi; Zishu Wei; Ruixuan Xiao; Yurun Chen 004; Jiasheng Ye; Meiling Tao; Xiangxin Zhou; Ziyu Zhao 001; Yuhuai Li; Shengze Xu; et al. (CoRR, 2025)