Temporal Multimodal Learning in Audiovisual Speech Recognition. - Di Hu 001; Xuelong Li 001; Xiaoqiang Lu (CVPR, 2016)

Multimodal Learning via Exploring Deep Semantic Similarity. - Di Hu 001; Xiaoqiang Lu; Xuelong Li 001 (ACM Multimedia, 2016)

Large Graph Hashing with Spectral Rotation. - Xuelong Li 001; Di Hu 001; Feiping Nie 001 (AAAI, 2017)

Image2song: Song Retrieval via Bridging Image Content and Lyric Words. - Xuelong Li 001; Di Hu 001; Xiaoqiang Lu (ICCV, 2017)

Deep Co-Clustering for Unsupervised Audiovisual Learning. - Di Hu 001; Feiping Nie 001; Xuelong Li 001 (CoRR, 2018)

Deep LDA Hashing. - Di Hu 001; Feiping Nie 001; Xuelong Li 001 (CoRR, 2018)

Dense Multimodal Fusion for Hierarchically Joint Representation. - Di Hu 001; Feiping Nie 001; Xuelong Li 001 (CoRR, 2018)

Listen to the Image. - Di Hu 001; Dong Wang 028; Xuelong Li 001; Feiping Nie 001; Qi Wang 009 (CVPR, 2019)

Deep Multimodal Clustering for Unsupervised Audiovisual Learning. - Di Hu 001; Feiping Nie 001; Xuelong Li 001 (CVPR, 2019)

Dense Multimodal Fusion for Hierarchically Joint Representation. - Di Hu 001; Chengze Wang; Feiping Nie 001; Xuelong Li 001 (ICASSP, 2019)

Discrete Spectral Hashing for Efficient Similarity Retrieval. - Di Hu 001; Feiping Nie 001; Xuelong Li 001 (IEEE Trans. Image Process., 2019)

Deep Binary Reconstruction for Cross-Modal Hashing. - Di Hu 001; Feiping Nie 001; Xuelong Li 001 (IEEE Trans. Multim., 2019)

Cross-Task Transfer for Geotagged Audiovisual Aerial Scene Recognition. - Di Hu 001; Xuhong Li 002; Lichao Mou; Pu Jin; Dong Chen; Liping Jing; Xiaoxiang Zhu 001; Dejing Dou (ECCV (24), 2020)

Multiple Sound Sources Localization from Coarse to Fine. - Rui Qian 001; Di Hu 001; Heinrich Dinkel; Mengyue Wu; Ning Xu 007; Weiyao Lin (ECCV (20), 2020)

Discriminative Sounding Objects Localization via Self-supervised Audiovisual Matching. - Di Hu 001; Rui Qian 001; Minyue Jiang; Xiao Tan 001; Shilei Wen; Errui Ding; Weiyao Lin; Dejing Dou (NeurIPS, 2020)

Curriculum Audiovisual Learning. - Di Hu 001; Zheng Wang 037; Haoyi Xiong; Dong Wang 028; Feiping Nie 001; Dejing Dou (CoRR, 2020)

Ambient Sound Helps: Audiovisual Crowd Counting in Extreme Conditions. - Di Hu 001; Lichao Mou; Qingzhong Wang; Junyu Gao 001; Yuansheng Hua; Dejing Dou; Xiao Xiang Zhu 001 (CoRR, 2020)

Cross-Task Transfer for Multimodal Aerial Scene Recognition. - Di Hu 001; Xuhong Li 002; Lichao Mou; Pu Jin; Dong Chen; Liping Jing; Xiaoxiang Zhu 001; Dejing Dou (CoRR, 2020)

Towards Accurate Knowledge Transfer via Target-awareness Representation Disentanglement. - Xingjian Li 002; Di Hu 001; Xuhong Li 002; Haoyi Xiong; Zhi Ye; Zhipeng Wang; Chengzhong Xu 001; Dejing Dou (CoRR, 2020)

Temporal Relational Modeling with Self-Supervision for Action Segmentation. - Dong Wang 028; Di Hu 001; Xingjian Li 002; Dejing Dou (AAAI, 2021)

Unsupervised Multi-Source Domain Adaptation for Person Re-Identification. - Zechen Bai; Zhigang Wang 002; Jian Wang 066; Di Hu 001; Errui Ding (CVPR, 2021)

Cyclic Co-Learning of Sounding Object Visual Grounding and Sound Separation. - Yapeng Tian; Di Hu 001; Chenliang Xu (CVPR, 2021)

Generalising combinatorial discriminant analysis through conditioning truncated Rayleigh flow. - Sijia Yang; Haoyi Xiong; Di Hu 001; Kaibo Xu; Licheng Wang; Peizhen Zhu; Zeyi Sun 001 (Knowl. Inf. Syst., 2021)

Visual Sound Localization in the Wild by Cross-Modal Interference Erasing. - Xian Liu; Rui Qian 001; Hang Zhou 009; Di Hu 001; Weiyao Lin; Ziwei Liu 002; Bolei Zhou; Xiaowei Zhou 001 (AAAI, 2022)

SepFusion: Finding Optimal Fusion Structures for Visual Sound Separation. - Dongzhan Zhou; Xinchi Zhou; Di Hu 001; Hang Zhou 009; Lei Bai 001; Ziwei Liu 002; Wanli Ouyang (AAAI, 2022)

Learning to Answer Questions in Dynamic Audio-Visual Scenarios. - Guangyao Li; Yake Wei; Yapeng Tian; Chenliang Xu; Ji-Rong Wen; Di Hu 001 (CVPR, 2022)

Balanced Multimodal Learning via On-the-fly Gradient Modulation. - Xiaokang Peng; Yake Wei; Andong Deng; Dong Wang 028; Di Hu 001 (CVPR, 2022)

Dual Domain-Adversarial Learning for Audio-Visual Saliency Prediction. - Yingzi Fan; Longfei Han; Yue Zhang; Lechao Cheng; Chen Xia; Di Hu 001 (HCMA@MM, 2022)

Inadequately Pre-trained Models are Better Feature Extractors. - Andong Deng; Xingjian Li 002; Zhibing Li; Di Hu 001; Chengzhong Xu 001; Dejing Dou (CoRR, 2022)

SeCo: Separating Unknown Musical Visual Sounds with Consistency Guidance. - Xinchi Zhou; Dongzhan Zhou; Wanli Ouyang; Hang Zhou 009; Ziwei Liu 002; Di Hu 001 (CoRR, 2022)

Learning in Audio-visual Context: A Review, Analysis, and New Perspective. - Yake Wei; Di Hu 001; Yapeng Tian; Xuelong Li 001 (CoRR, 2022)

Class-Aware Sounding Objects Localization via Audiovisual Correspondence. - Di Hu 001; Yake Wei; Rui Qian 001; Weiyao Lin; Ruihua Song; Ji-Rong Wen (IEEE Trans. Pattern Anal. Mach. Intell., 2022)

MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning. - Ruize Xu; Ruoxuan Feng; Shi-Xiong Zhang 001; Di Hu 001 (ICASSP, 2023)

Towards Inadequately Pre-trained Models in Transfer Learning. - Andong Deng; Xingjian Li 002; Di Hu 001; Tianyang Wang; Haoyi Xiong; Cheng-Zhong Xu 001 (ICCV, 2023)

Multi-Scale Attention for Audio Question Answering. - Guangyao Li; Yixin Xu; Di Hu 001 (INTERSPEECH, 2023)

Progressive Spatio-temporal Perception for Audio-Visual Question Answering. - Guangyao Li; Wenxuan Hou 001; Di Hu 001 (ACM Multimedia, 2023)

TikTalk: A Video-Based Dialogue Dataset for Multi-Modal Chitchat in Real World. - Hongpeng Lin; Ludan Ruan; Wenke Xia; Peiyu Liu 002; Jingyuan Wen; Yixin Xu; Di Hu 001; Ruihua Song; Wayne Xin Zhao; Qin Jin; Zhiwu Lu 001 (ACM Multimedia, 2023)

Exploiting Visual Context Semantics for Sound Source Localization. - Xinchi Zhou; Dongzhan Zhou; Di Hu 001; Hang Zhou 009; Wanli Ouyang (WACV, 2023)

SeCo: Separating Unknown Musical Visual Sounds with Consistency Guidance. - Xinchi Zhou; Dongzhan Zhou; Wanli Ouyang; Hang Zhou 009; Di Hu 001 (WACV, 2023)

TikTalk: A Multi-Modal Dialogue Dataset for Real-World Chitchat. - Hongpeng Lin; Ludan Ruan; Wenke Xia; Peiyu Liu 002; Jingyuan Wen; Yixin Xu; Di Hu 001; Ruihua Song; Wayne Xin Zhao; Qin Jin; Zhiwu Lu 001 (CoRR, 2023)

Revisiting Pre-training in Audio-Visual Learning. - Ruoxuan Feng; Wenke Xia; Di Hu 001 (CoRR, 2023)

Balanced Audiovisual Dataset for Imbalance Analysis. - Wenke Xia; Xu Zhao; Xincheng Pang; Changqing Zhang; Di Hu 001 (CoRR, 2023)

Robust Cross-Modal Knowledge Distillation for Unconstrained Videos. - Wenke Xia; Xingjian Li 002; Andong Deng; Haoyi Xiong; Dejing Dou; Di Hu 001 (CoRR, 2023)

Towards Long Form Audio-visual Video Understanding. - Wenxuan Hou 001; Guangyao Li; Yapeng Tian; Di Hu 001 (CoRR, 2023)

Enhancing Multi-modal Cooperation via Fine-grained Modality Valuation. - Yake Wei; Ruoxuan Feng; Zihe Wang 001; Di Hu 001 (CoRR, 2023)

Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs. - Wenke Xia; Dong Wang 028; Xincheng Pang; Zhigang Wang 002; Bin Zhao 001; Di Hu 001 (CoRR, 2023)

Self-Supervised Learning for Heterogeneous Audiovisual Scene Analysis. - Di Hu 001; Zheng Wang 037; Feiping Nie 001; Rong Wang 001; Xuelong Li 001 (IEEE Trans. Multim., 2023)

Self-supervised audiovisual representation learning for remote sensing data. - Konrad Heidler; Lichao Mou; Di Hu 001; Pu Jin; Guangyao Li; Chuang Gan 001; Ji-Rong Wen; Xiao Xiang Zhu 001 (Int. J. Appl. Earth Obs. Geoinformation, 2023)

Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer. - Yaoting Wang; Weisong Liu; Guangyao Li; Jian Ding 001; Di Hu 001; Xi Li (AAAI, 2024)

Play to the Score: Stage-Guided Dynamic Multi-Sensory Fusion for Robotic Manipulation. - Ruoxuan Feng; Di Hu 001; Wenke Ma; Xuelong Li 001 (CoRL, 2024)

KOI: Accelerating Online Imitation Learning via Hybrid Key-state Guidance. - Jingxian Lu; Wenke Xia; Dong Wang 028; Zhigang Wang 002; Bin Zhao 001; Di Hu 001; Xuelong Li 001 (CoRL, 2024)

Enhancing Multimodal Cooperation via Sample-Level Modality Valuation. - Yake Wei; Ruoxuan Feng; Zihe Wang 001; Di Hu 001 (CVPR, 2024)

Stepping Stones: A Progressive Training Strategy for Audio-Visual Semantic Segmentation. - Juncheng Ma; Peiwen Sun; Yaoting Wang; Di Hu 001 (ECCV (73), 2024)

Can Textual Semantics Mitigate Sounding Object Segmentation Preference? - Yaoting Wang; Peiwen Sun; Yuanchao Li; Honggang Zhang 002; Di Hu 001 (ECCV (74), 2024)

Ref-AVS: Refer and Segment Objects in Audio-Visual Scenes. - Yaoting Wang; Peiwen Sun; Dongzhan Zhou; Guangyao Li; Honggang Zhang 002; Di Hu 001 (ECCV (74), 2024)

Diagnosing and Re-learning for Balanced Multimodal Learning. - Yake Wei; Siwei Li; Ruoxuan Feng; Di Hu 001 (ECCV (64), 2024)

Quantifying and Enhancing Multi-modal Robustness with Modality Preference. - Zequn Yang; Yake Wei; Ce Liang; Di Hu 001 (ICLR, 2024)

MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance. - Yake Wei; Di Hu 001 (ICML, 2024)

Kinematic-aware Prompting for Generalizable Articulated Object Manipulation with LLMs. - Wenke Xia; Dong Wang 028; Xincheng Pang; Zhigang Wang 002; Bin Zhao 001; Di Hu 001; Xuelong Li 001 (ICRA, 2024)

Depth Helps: Improving Pre-trained RGB-based Policy with Depth Information Injection. - Xincheng Pang; Wenke Xia; Zhigang Wang 002; Bin Zhao 001; Di Hu 001; Dong Wang 028; Xuelong Li 001 (IROS, 2024)

Boosting Audio Visual Question Answering via Key Semantic-Aware Cues. - Guangyao Li; Henghui Du; Di Hu 001 (ACM Multimedia, 2024)

Unveiling and Mitigating Bias in Audio Visual Segmentation. - Peiwen Sun; Honggang Zhang 002; Di Hu 001 (ACM Multimedia, 2024)

Enhancing Modality Representation and Alignment for Multimodal Cold-start Active Learning. - Meng Shen 002; Yake Wei; Jianxiong (Terry) Yin; Deepu Rajan; Di Hu 001; Simon See (MMAsia, 2024)

Learning Manipulation by Predicting Interaction. - Jia Zeng; Qingwen Bu; Bangjun Wang; Wenke Xia; Li Chen 008; Hao Dong 003; Haoming Song; Dong Wang 004; Di Hu 001; Ping Luo 002; Heming Cui; Bin Zhao 001; et al. (Robotics: Science and Systems, 2024)

Multimodal Fusion on Low-quality Data: A Comprehensive Survey. - Qingyang Zhang; Yake Wei; Zongbo Han; Huazhu Fu; Xi Peng 001; Cheng Deng; Qinghua Hu; Cai Xu; Jie Wen; Di Hu 001; Changqing Zhang (CoRR, 2024)

YuLan: An Open-source Large Language Model. - Yutao Zhu 001; Kun Zhou 002; Kelong Mao; Wentong Chen; Yiding Sun; Zhipeng Chen 001; Qian Cao 001; Yihan Wu; Yushuo Chen; Feng Wang; Lei Zhang; Junyi Li; et al. (CoRR, 2024)

Towards accurate knowledge transfer via target-awareness representation disentanglement. - Xingjian Li 002; Di Hu 001; Xuhong Li 002; Haoyi Xiong; Cheng-Zhong Xu 001; Dejing Dou (Mach. Learn., 2024)

Geometric-inspired graph-based Incomplete Multi-view Clustering. - Zequn Yang; Han Zhang 012; Yake Wei; Zheng Wang 037; Feiping Nie 001; Di Hu 001 (Pattern Recognit., 2024)

Towards Effective and Efficient Continual Pre-training of Large Language Models. - Jie Chen 007; Zhipeng Chen 001; Jiapeng Wang; Kun Zhou 002; Yutao Zhu 001; Jinhao Jiang; Yingqian Min; Xin Zhao 018; Zhicheng Dou; Jiaxin Mao; Yankai Lin; Ruihua Song; et al. (ACL (1), 2025)

Crab: A Unified Audio-Visual Scene Understanding Model with Explicit Cooperation. - Henghui Du; Guangyao Li; Chang Zhou; Chunjie Zhang; Alan Zhao; Di Hu 001 (CVPR, 2025)

Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition. - Chengxiang Huang; Yake Wei; Zequn Yang; Di Hu 001 (CVPR, 2025)

Patch Matters: Training-free Fine-grained Image Caption Enhancement via Local Perception. - Ruotian Peng; Haiying He; Yake Wei; Yandong Wen; Di Hu 001 (CVPR, 2025)

Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correction. - Wenke Xia; Ruoxuan Feng; Dong Wang 028; Di Hu 001 (CVPR, 2025)

AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors. - Ruoxuan Feng; Jiangyu Hu; Wenke Xia; Tianci Gao; Ao Shen; Yuhao Sun; Bin Fang; Di Hu 001 (ICLR, 2025)

Learning to Predict Advertisement Expansion Moments in Short-Form Video Platforms. - Wenxuan Hou 001; Kaibing Yang; Di Hu 001 (ICMR, 2025)

MGIPF: Multi-Granularity Interest Prediction Framework for Personalized Recommendation. - Ruoxuan Feng; Zhen Tian 001; Qiushi Peng; Jiaxin Mao; Wayne Xin Zhao; Di Hu 001; Changwang Zhang (SIGIR, 2025)

On-the-Fly Modulation for Balanced Multimodal Learning. - Yake Wei; Di Hu 001; Henghui Du; Ji-Rong Wen (IEEE Trans. Pattern Anal. Mach. Intell., 2025)

BalanceBenchmark: A Survey for Multimodal Imbalance Learning. - Shaoxuan Xu; Menglu Cui; Chengxiang Huang; Hongfa Wang; Di Hu 001 (CoRR, 2025)

MokA: Multimodal Low-Rank Adaptation for MLLMs. - Yake Wei; Yu Miao; Dongzhan Zhou; Di Hu 001 (CoRR, 2025)

RollingQ: Reviving the Cooperation Dynamics in Multimodal Transformer. - Haotian Ni; Yake Wei; Hang Liu; Gong Chen; Chong Peng; Hao Lin; Di Hu 001 (CoRR, 2025)

Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AI. - Sha Zhang 002; Suorong Yang; Tong Xie; Xiangyuan Xue; Zixuan Hu; Rui Li; Wenxi Qu; Zhenfei Yin; Tianfan Fu; Di Hu 001; Andres M. Bran; Nian Ran; et al. (CoRR, 2025)