From Pixels to Objects: Cubic Visual Attention for Visual Question Answering. - Jingkuan Song; Pengpeng Zeng; Lianli Gao; Heng Tao Shen (IJCAI, 2018)

Examine before You Answer: Multi-task Learning with Adaptive-attentions for Multiple-choice VQA. - Lianli Gao; Pengpeng Zeng; Jingkuan Song; Xianglong Liu 001; Heng Tao Shen (ACM Multimedia, 2018)

Structured Two-Stream Attention Network for Video Question Answering. - Lianli Gao; Pengpeng Zeng; Jingkuan Song; Yuan-Fang Li; Wu Liu; Tao Mei 001; Heng Tao Shen (AAAI, 2019)

Hierarchical Representation Network With Auxiliary Tasks For Video Captioning. - Yu Lei; Zhonghai He; Pengpeng Zeng; Jingkuan Song; Lianli Gao (ICME, 2021)

Conceptual and Syntactical Cross-modal Alignment with Cross-level Consistency for Image-Text Matching. - Pengpeng Zeng; Lianli Gao; Xinyu Lyu; Shuaiqi Jing; Jingkuan Song (ACM Multimedia, 2021)

Generalized pyramid co-attention with learnable aggregation net for video question answering. - Lianli Gao; Tangming Chen; Xiangpeng Li; Pengpeng Zeng; Lei Zhao; Yuan-Fang Li (Pattern Recognit., 2021)

Rich Visual Knowledge-Based Augmentation Network for Visual Question Answering. - Liyang Zhang; Shuaicheng Liu; Donghao Liu; Pengpeng Zeng; Xiangpeng Li; Jingkuan Song; Lianli Gao (IEEE Trans. Neural Networks Learn. Syst., 2021)

Support-Set Based Multi-Modal Representation Enhancement for Video Captioning. - Xiaoya Chen; Jingkuan Song; Pengpeng Zeng; Lianli Gao; Heng Tao Shen (ICME, 2022)

Learning to Generate Scene Graph from Head to Tail. - Chaofan Zheng; Xinyu Lyu; Yuyu Guo 001; Pengpeng Zeng; Jingkuan Song; Lianli Gao (ICME, 2022)

S2 Transformer for Image Captioning. - Pengpeng Zeng; Haonan Zhang; Jingkuan Song; Lianli Gao (IJCAI, 2022)

Dynamic Scene Graph Generation via Temporal Prior Inference. - Shuang Wang; Lianli Gao; Xinyu Lyu; Yuyu Guo 001; Pengpeng Zeng; Jingkuan Song (ACM Multimedia, 2022)

Progressive Tree-Structured Prototype Network for End-to-End Image Captioning. - Pengpeng Zeng; Jinkuan Zhu; Jingkuan Song; Lianli Gao (ACM Multimedia, 2022)

A Differentiable Semantic Metric Approximation in Probabilistic Embedding for Cross-Modal Retrieval. - Hao Li; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Haonan Zhang; Gongfu Li (NeurIPS, 2022)

Text-instance graph: Exploring the relational semantics for text-based visual question answering. - Xiangpeng Li; Bo Wu 018; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Chuang Gan 001 (Pattern Recognit., 2022)

Hierarchical Representation Network With Auxiliary Tasks for Video Captioning and Video Question Answering. - Lianli Gao; Yu Lei; Pengpeng Zeng; Jingkuan Song; Meng Wang 001; Heng Tao Shen (IEEE Trans. Image Process., 2022)

Video Question Answering With Prior Knowledge and Object-Sensitive Learning. - Pengpeng Zeng; Haonan Zhang; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Image Process., 2022)

Relation-aware aggregation network with auxiliary guidance for text-based person search. - Pengpeng Zeng; Shuaiqi Jing; Jingkuan Song; Kaixuan Fan; Xiangpeng Li; Liansuo We; Yuan Guo (World Wide Web, 2022)

Depth-Aware Sparse Transformer for Video-Language Learning. - Haonan Zhang; Lianli Gao; Pengpeng Zeng; Alan Hanjalic; Heng Tao Shen (ACM Multimedia, 2023)

End-to-end Image Captioning via Visual Region Aggregation and Dual-level Collaboration. - Jingkuan Song; Pengpeng Zeng; Jiayang Gu; Jinkuan Zhu; Lianli Gao (Int. J. Softw. Informatics, 2023)

Learning visual question answering on controlled semantic noisy labels. - Haonan Zhang; Pengpeng Zeng; Yuxuan Hu; Jin Qian; Jingkuan Song; Lianli Gao (Pattern Recognit., 2023)

Complementarity-Aware Space Learning for Video-Text Retrieval. - Jinkuan Zhu; Pengpeng Zeng; Lianli Gao; Gongfu Li; Dongliang Liao; Jingkuan Song (IEEE Trans. Circuits Syst. Video Technol., 2023)

Adaptive Fine-Grained Predicates Learning for Scene Graph Generation. - Xinyu Lyu; Lianli Gao; Pengpeng Zeng; Heng Tao Shen; Jingkuan Song (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

ProS: Prompting-to-Simulate Generalized Knowledge for Universal Cross-Domain Retrieval. - Kaipeng Fang; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Zhi-Qi Cheng; Xiyao Li; Heng Tao Shen (CVPR, 2024)

Attribute Vision Transformer for UAV-Human Re-Identification. - Hao Ni 002; Yuke Li; Ping Lai; Pengpeng Zeng; Hangyu Guo; Lianli Gao (ICME Workshops, 2024)

Pedestrian Attributes Recognition for UAV-Human. - Hao Ni 002; Ping Lai; Yuke Li; Pengpeng Zeng; Haonan Zhang; Jingkuan Song (ICME Workshops, 2024)

MPT: Multi-grained Prompt Tuning for Text-Video Retrieval. - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (ACM Multimedia, 2024)

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct. - Run Luo; Haonan Zhang; Longze Chen; Ting-En Lin; Xiong Liu; Yuchuan Wu; Min Yang 007; Minzheng Wang 001; Pengpeng Zeng; Lianli Gao; Heng Tao Shen; Yunshui Li; et al. (CoRR, 2024)

SeMv-3D: Towards Semantic and Mutil-view Consistency simultaneously for General Text-to-3D Generation with Triplane Priors. - Xiao Cai; Pengpeng Zeng; Lianli Gao; Junchen Zhu; Jiaxin Zhang; Sitong Su; Heng Tao Shen; Jingkuan Song (CoRR, 2024)

GT23D-Bench: A Comprehensive General Text-to-3D Generation Benchmark. - Sitong Su; Xiao Cai; Lianli Gao; Pengpeng Zeng; Qinhong Du; Mengqi Li; Heng Tao Shen; Jingkuan Song (CoRR, 2024)

Memory-Based Augmentation Network for Video Captioning. - Shuaiqi Jing; Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Multim., 2024)

Dual-Branch Hybrid Learning Network for Unbiased Scene Graph Generation. - Chaofan Zheng; Lianli Gao; Xinyu Lyu; Pengpeng Zeng; Abdulmotaleb El-Saddik; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

SPT: Spatial Pyramid Transformer for Image Captioning. - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Xinyu Lyu; Jingkuan Song; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

Ump: Unified Modality-Aware Prompt Tuning for Text-Video Retrieval. - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (IEEE Trans. Circuits Syst. Video Technol., 2024)

MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct. - Run Luo; Haonan Zhang; Longze Chen; Ting-En Lin; Xiong Liu; Yuchuan Wu; Min Yang 007; Yongbin Li; Minzheng Wang 001; Pengpeng Zeng; Lianli Gao; Heng Tao Shen; et al. (ACL (Findings), 2025)

OmniCharacter: Towards Immersive Role-Playing Agents with Seamless Speech-Language Personality Interaction. - Haonan Zhang; Run Luo; Xiong Liu; Yuchuan Wu; Ting-En Lin; Pengpeng Zeng; Qiang Qu; Feiteng Fang; Min Yang 007; Lianli Gao; Jingkuan Song; Fei Huang 002; et al. (ACL (1), 2025)

Skip Tuning: Pre-trained Vision-Language Models are Effective and Efficient Adapters Themselves. - Shihan Wu 001; Ji Zhang 012; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Heng Tao Shen (CVPR, 2025)

Multi-Concept Learning for Scene Graph Generation. - Xinyu Lyu; Lianli Gao; Junlin Xie; Pengpeng Zeng; Yulu Tian; Jie Shao 001; Heng Tao Shen (IEEE Trans. Image Process., 2025)

Text-Video Retrieval With Global-LocalSemantic Consistent Learning. - Haonan Zhang; Pengpeng Zeng; Lianli Gao; Jingkuan Song; Yihang Duan; Xinyu Lyu; Heng Tao Shen (IEEE Trans. Image Process., 2025)

Visual Commonsense-Aware Representation Network for Video Captioning. - Pengpeng Zeng; Haonan Zhang; Lianli Gao; Xiangpeng Li; Jin Qian; Heng Tao Shen (IEEE Trans. Neural Networks Learn. Syst., 2025)

CFReID: Continual Few-shot Person Re-Identification. - Hao Ni 002; Lianli Gao; Pengpeng Zeng; Heng Tao Shen; Jingkuan Song (CoRR, 2025)

Towards Generalized and Training-Free Text-Guided Semantic Manipulation. - Yu Hong; Xiao Cai; Pengpeng Zeng; Shuai Zhang; Jingkuan Song; Lianli Gao; Heng Tao Shen (CoRR, 2025)

Towards Redundancy-Free Sub-networks in Continual Learning. - Cheng Chen; Lianli Gao; Pengpeng Zeng; Mingsheng Cao; Heng Tao Shen (Pattern Recognit., 2026)

Staircase Sign Method: Boosting adversarial attacks by mitigating gradient distortion. - Pengpeng Zeng; Shengming Yuan; Qilong Zhang; Huimin Deng; Hui Xu; Lianli Gao (Pattern Recognit., 2026)