S2 Transformer for Image Captioning. - Pengpeng Zeng; Haonan Zhang 003; Jingkuan Song; Lianli Gao (IJCAI, 2022)

A Differentiable Semantic Metric Approximation in Probabilistic Embedding for Cross-Modal Retrieval. - Hao Li; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Haonan Zhang 003; Gongfu Li (NeurIPS, 2022)

Video Question Answering With Prior Knowledge and Object-Sensitive Learning. - Pengpeng Zeng; Haonan Zhang 003; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Image Process., 2022)

Depth-Aware Sparse Transformer for Video-Language Learning. - Haonan Zhang 003; Lianli Gao; Pengpeng Zeng; Alan Hanjalic; Heng Tao Shen (ACM Multimedia, 2023)

Learning visual question answering on controlled semantic noisy labels. - Haonan Zhang 003; Pengpeng Zeng; Yuxuan Hu; Jin Qian; Jingkuan Song; Lianli Gao (Pattern Recognit., 2023)

Pedestrian Attributes Recognition for UAV-Human. - Hao Ni 002; Ping Lai; Yuke Li; Pengpeng Zeng; Haonan Zhang 003; Jingkuan Song (ICME Workshops, 2024)

MPT: Multi-grained Prompt Tuning for Text-Video Retrieval. - Haonan Zhang 003; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (ACM Multimedia, 2024)

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct. - Run Luo; Haonan Zhang 003; Longze Chen; Ting-En Lin; Xiong Liu; Yuchuan Wu; Min Yang 007; Minzheng Wang 001; Pengpeng Zeng; Lianli Gao; Heng Tao Shen; Yunshui Li; et al. (CoRR, 2024)

Memory-Based Augmentation Network for Video Captioning. - Shuaiqi Jing; Haonan Zhang 003; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Multim., 2024)

SPT: Spatial Pyramid Transformer for Image Captioning. - Haonan Zhang 003; Pengpeng Zeng; Lianli Gao; Xinyu Lyu; Jingkuan Song; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

Ump: Unified Modality-Aware Prompt Tuning for Text-Video Retrieval. - Haonan Zhang 003; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct. - Run Luo; Haonan Zhang 003; Longze Chen; Ting-En Lin; Xiong Liu; Yuchuan Wu; Min Yang 007; Yongbin Li; Minzheng Wang 001; Pengpeng Zeng; Lianli Gao; Heng Tao Shen; et al. (ACL (Findings), 2025)

OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction. - Haonan Zhang 003; Run Luo; Xiong Liu; Yuchuan Wu; Ting-En Lin; Pengpeng Zeng; Qiang Qu 001; Feiteng Fang; Min Yang 007; Lianli Gao; Jingkuan Song; Fei Huang 002; et al. (ACL (1), 2025)

Text-Video Retrieval With Global-LocalSemantic Consistent Learning. - Haonan Zhang 003; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Yihang Duan; Xinyu Lyu; Heng Tao Shen (IEEE Trans. Image Process., 2025)

OpenOmni: Large Language Models Pivot Zero-shot Omnimodal Alignment across Language with Real-time Self-Aware Emotional Speech Synthesis. - Run Luo; Ting-En Lin; Haonan Zhang 003; Yuchuan Wu; Xiong Liu; Min Yang 007; Yongbin Li; Longze Chen; Jiaming Li 004; Lei Zhang 201; Yangyi Chen; Hamid Alinejad-Rokny; et al. (CoRR, 2025)

Visual Commonsense-Aware Representation Network for Video Captioning. - Pengpeng Zeng; Haonan Zhang 003; Lianli Gao; Xiangpeng Li; Jin Qian; Heng Tao Shen (IEEE Trans. Neural Networks Learn. Syst., 2025)

ChARM: Character-based Act-adaptive Reward Modeling for Advanced Role-Playing Language Agents. - Feiteng Fang; Ting-En Lin; Yuchuan Wu; Xiong Liu; Xiang Huang; Dingwei Chen; Jing Ye; Haonan Zhang 003; Liang Zhu; Hamid Alinejad-Rokny; Min Yang 007; Fei Huang 002; et al. (CoRR, 2025)

Temporal-Guided Mixture-of-Experts for Zero-Shot Video Question Answering. - Yixin Qin; Lei Zhao 017; Lianli Gao; Haonan Zhang 003; Pengpeng Zeng; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2025)