Walking with MIND: Mental Imagery eNhanceD Embodied QA. - Juncheng Li 006; Siliang Tang; Fei Wu 001; Yueting Zhuang (ACM Multimedia, 2019)

Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation. - Juncheng Li 006; Xin Wang 061; Siliang Tang; Haizhou Shi; Fei Wu 001; Yueting Zhuang; William Yang Wang (CVPR, 2020)

Topic Adaptation and Prototype Encoding for Few-Shot Visual Storytelling. - Jiacheng Li 002; Siliang Tang; Juncheng Li 006; Jun Xiao 001; Fei Wu 001; Shiliang Pu; Yueting Zhuang (ACM Multimedia, 2020)

Adaptive Hierarchical Graph Reasoning with Semantic Coherence for Video-and-Language Inference. - Juncheng Li 006; Siliang Tang; Linchao Zhu; Haochen Shi; Xuanwen Huang; Fei Wu 001; Yi Yang 001; Yueting Zhuang (ICCV, 2021)

MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-Based Image Captioning. - Wenqiao Zhang; Haochen Shi; Jiannan Guo 003; Shengyu Zhang 001; Qingpeng Cai 002; Juncheng Li 006; Sihui Luo 003; Yueting Zhuang (AAAI, 2022)

Compositional Temporal Grounding with Structured Variational Cross-Graph Correspondence Learning. - Juncheng Li 006; Junlin Xie; Long Qian; Linchao Zhu; Siliang Tang; Fei Wu 001; Yi Yang 001; Yueting Zhuang; Xin Eric Wang (CVPR, 2022)

Dilated Context Integrated Network with Cross-Modal Consensus for Temporal Emotion Localization in Videos. - Juncheng Li 006; Junlin Xie; Linchao Zhu; Long Qian; Siliang Tang; Wenqiao Zhang; Haochen Shi; Shengyu Zhang 001; Longhui Wei; Qi Tian 001; Yueting Zhuang (ACM Multimedia, 2022)

Weakly-supervised Disentanglement Network for Video Fingerspelling Detection. - Ziqi Jiang; Shengyu Zhang 001; Siyuan Yao; Wenqiao Zhang; Sihan Zhang; Juncheng Li 006; Zhou Zhao 001; Fei Wu 001 (ACM Multimedia, 2022)

Fine-Grained Semantically Aligned Vision-Language Pre-Training. - Juncheng Li 006; Xin He; Longhui Wei; Long Qian; Linchao Zhu; Lingxi Xie; Yueting Zhuang; Qi Tian 001; Siliang Tang (NeurIPS, 2022)

BOSS: Bottom-up Cross-modal Semantic Composition with Hybrid Counterfactual Training for Robust Content-based Image Retrieval. - Wenqiao Zhang; Jiannan Guo 003; Mengze Li 001; Haochen Shi; Shengyu Zhang 001; Juncheng Li 006; Siliang Tang; Yueting Zhuang (CoRR, 2022)

Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-based Active Learning. - Wei Ji 008; Renjie Liang; Zhedong Zheng; Wenqiao Zhang; Shengyu Zhang 001; Juncheng Li 006; Mengze Li 001; Tat-Seng Chua (CVPR, 2023)

Global Structure Knowledge-Guided Relation Extraction Method for Visually-Rich Document. - Xiangnan Chen; Qian Xiao; Juncheng Li 006; Duo Dong; Jun Lin; Xiaozhong Liu; Siliang Tang (EMNLP (Findings), 2023)

Reasoning Makes Good Annotators : An Automatic Task-specific Rules Distilling Framework for Low-resource Relation Extraction. - Yilin Lu; Juncheng Li 006; Xiaoqiang Wang 007; Haochen Shi; Tao Chen; Siliang Tang (EMNLP (Findings), 2023)

Self-supervised Meta-Prompt Learning with Meta-Gradient Regularization for Few-shot Generalization. - Kaihang Pan; Juncheng Li 006; Hongye Song; Jun Lin; Xiaozhong Liu; Siliang Tang (EMNLP (Findings), 2023)

Gradient-Regulated Meta-Prompt Learning for Generalizable Vision-Language Models. - Juncheng Li 006; Minghe Gao; Longhui Wei; Siliang Tang; Wenqiao Zhang; Mengze Li 001; Wei Ji 008; Qi Tian 001; Tat-Seng Chua; Yueting Zhuang (ICCV, 2023)

Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open World. - Qifan Yu; Juncheng Li 006; Yu Wu 011; Siliang Tang; Wei Ji 008; Yueting Zhuang (ICCV, 2023)

Unsupervised Domain Adaptation for Video Object Grounding with Cascaded Debiasing Learning. - Mengze Li 001; Haoyu Zhang; Juncheng Li 006; Zhou Zhao 001; Wenqiao Zhang; Shengyu Zhang 001; Shiliang Pu; Yueting Zhuang; Fei Wu 001 (ACM Multimedia, 2023)

Meta-augmented Prompt Tuning for Better Few-shot Learning. - Kaihang Pan; Juncheng Li 006; Hongye Song; Jun Lin; Xiaozhong Liu; Siliang Tang (CoRR, 2023)

Interactive Data Synthesis for Systematic Vision Adaptation via LLMs-AIGCs Collaboration. - Qifan Yu; Juncheng Li 006; Wentao Ye; Siliang Tang; Yueting Zhuang (CoRR, 2023)

Empowering Vision-Language Models to Follow Interleaved Vision-Language Instructions. - Juncheng Li 006; Kaihang Pan; Zhiqi Ge; Minghe Gao; Hanwang Zhang; Wei Ji 008; Wenqiao Zhang; Tat-Seng Chua; Siliang Tang; Yueting Zhuang (CoRR, 2023)

ControlRetriever: Harnessing the Power of Instructions for Controllable Retrieval. - Kaihang Pan; Juncheng Li 006; Hongye Song; Hao Fei 001; Wei Ji 008; Shuo Zhang 014; Jun Lin; Xiaozhong Liu; Siliang Tang (CoRR, 2023)

De-fine: Decomposing and Refining Visual Programs with Auto-Feedback. - Minghe Gao; Juncheng Li 006; Hao Fei 001; Liang Pang; Wei Ji 008; Guoming Wang; Wenqiao Zhang; Siliang Tang; Yueting Zhuang (CoRR, 2023)

Revisiting the Domain Shift and Sample Uncertainty in Multi-source Active Domain Transfer. - Wenqiao Zhang; Zheqi Lv; Hao Zhou; Jia-Wei Liu; Juncheng Li 006; Mengze Li 001; Siliang Tang; Yueting Zhuang (CoRR, 2023)

Variational Cross-Graph Reasoning and Adaptive Structured Semantics Learning for Compositional Temporal Grounding. - Juncheng Li 006; Siliang Tang; Linchao Zhu; Wenqiao Zhang; Yi Yang 001; Tat-Seng Chua; Fei Wu 001; Yueting Zhuang (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

DIEM: Decomposition-Integration Enhancing Multimodal Insights. - Xinyi Jiang; Guoming Wang; Junhao Guo; Juncheng Li 006; Wenqiao Zhang; Rongxing Lu; Siliang Tang (CVPR, 2024)

HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data. - Qifan Yu; Juncheng Li 006; Longhui Wei; Liang Pang; Wentao Ye; Bosheng Qin; Siliang Tang; Qi Tian 001; Yueting Zhuang (CVPR, 2024)

Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructions. - Juncheng Li 006; Kaihang Pan; Zhiqi Ge; Minghe Gao; Wei Ji 008; Wenqiao Zhang; Tat-Seng Chua; Siliang Tang; Hanwang Zhang; Yueting Zhuang (ICLR, 2024)

InstructVid2Vid: Controllable Video Editing with Natural Language Instructions. - Bosheng Qin; Juncheng Li 006; Siliang Tang; Tat-Seng Chua; Yueting Zhuang (ICME, 2024)

Auto-Encoding Morph-Tokens for Multimodal LLM. - Kaihang Pan; Siliang Tang; Juncheng Li 006; Zhaoyu Fan; Wei Chow; Shuicheng Yan; Tat-Seng Chua; Yueting Zhuang; Hanwang Zhang (ICML, 2024)

Momentor: Advancing Video Large Language Model with Fine-Grained Temporal Reasoning. - Long Qian; Juncheng Li 006; Yu Wu 011; Yaobo Ye; Hao Fei 001; Tat-Seng Chua; Yueting Zhuang; Siliang Tang (ICML, 2024)

De-fine: Decomposing and Refining Visual Programs with Auto-Feedback. - Minghe Gao; Juncheng Li 006; Hao Fei 001; Liang Pang; Wei Ji 008; Guoming Wang; Zheqi Lv; Wenqiao Zhang; Siliang Tang; Yueting Zhuang (ACM Multimedia, 2024)

Fact : Teaching MLLMs with Faithful, Concise and Transferable Rationales. - Minghe Gao; Shuang Chen; Liang Pang; Yuan Yao 013; Jisheng Dang; Wenqiao Zhang; Juncheng Li 006; Siliang Tang; Yueting Zhuang; Tat-Seng Chua (ACM Multimedia, 2024)

DEMON24: ACM MM24 Demonstrative Instruction Following Challenge. - Zhiqi Ge; Juncheng Li 006; Qifan Yu; Wei Zhou; Siliang Tang; Yueting Zhuang (ACM Multimedia, 2024)

WorldGPT: Empowering LLM as Multimodal World Model. - Zhiqi Ge; Hongzhe Huang; Mingze Zhou; Juncheng Li 006; Guoming Wang; Siliang Tang; Yueting Zhuang (ACM Multimedia, 2024)

The 2nd International Workshop on Deep Multi-modal Generation and Retrieval. - Wei Ji 008; Hao Fei 001; Yinwei Wei; Zhedong Zheng; Juncheng Li 006; Long Chen 016; Lizi Liao; Yueting Zhuang; Roger Zimmermann (MMGR@MM, 2024)

Unified Generative and Discriminative Training for Multi-modal Large Language Models. - Wei Chow; Juncheng Li 006; Qifan Yu; Kaihang Pan; Hao Fei 001; Zhiqi Ge; Shuai Yang; Siliang Tang; Hanwang Zhang; Qianru Sun (NeurIPS, 2024)

Towards Unified Multimodal Editing with Enhanced Knowledge Collaboration. - Kaihang Pan; Zhaoyu Fan; Juncheng Li 006; Qifan Yu; Hao Fei 001; Siliang Tang; Richang Hong; Hanwang Zhang; Qianru Sun (NeurIPS, 2024)

I3: Intent-Introspective Retrieval Conditioned on Instructions. - Kaihang Pan; Juncheng Li 006; Wenjie Wang 007; Hao Fei 001; Hongye Song; Wei Ji 008; Jun Lin; Xiaozhong Liu; Tat-Seng Chua; Siliang Tang (SIGIR, 2024)

HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models. - Wenqiao Zhang; Tianwei Lin; Jiang Liu; Fangxun Shu; Haoyuan Li 002; Lei Zhang 006; Wanggui He; Hao Zhou; Zheqi Lv; Hao Jiang 014; Juncheng Li 006; Siliang Tang; et al. (CoRR, 2024)

LASER: Tuning-Free LLM-Driven Attention Control for Efficient Text-conditioned Image-to-Animation. - Haoyu Zheng; Wenqiao Zhang; Yaoke Wang; Hao Zhou; Jiang Liu; Juncheng Li 006; Zheqi Lv; Siliang Tang; Yueting Zhuang (CoRR, 2024)

TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition. - Tianwei Lin; Jiang Liu; Wenqiao Zhang; Zhaocheng Li; Yang Dai; Haoyuan Li 002; Zhelun Yu; Wanggui He; Juncheng Li 006; Hao Jiang 014; Siliang Tang; Yueting Zhuang (CoRR, 2024)

Align2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction Curation. - Hongzhe Huang; Zhewen Yu; Jiang Liu; Li Cai; Dian Jiao; Wenqiao Zhang; Siliang Tang; Juncheng Li 006; Hao Jiang 014; Haoyuan Li 002; Yueting Zhuang (CoRR, 2024)

RADAR: Robust Two-stage Modality-incomplete Industrial Anomaly Detection. - Bingchen Miao; Wenqiao Zhang; Juncheng Li 006; Siliang Tang; Zhaocheng Li; Haochen Shi; Jun Xiao 001; Yueting Zhuang (CoRR, 2024)

Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms. - Minghe Gao; Wendong Bu; Bingchen Miao; Yang Wu; Yunfei Li; Juncheng Li 006; Siliang Tang; Qi Wu; Yueting Zhuang; Meng Wang (CoRR, 2024)

HumanEdit: A High-Quality Human-Rewarded Dataset for Instruction-based Image Editing. - Jinbin Bai; Wei Chow; Ling Yang 006; Xiangtai Li; Juncheng Li 006; Hanwang Zhang; Shuicheng Yan (CoRR, 2024)

Mastering Collaborative Multi-modal Data Selection: A Focus on Informativeness, Uniqueness, and Representativeness. - Qifan Yu; Zhebei Shen; Zhongqi Yue; Yang Wu; Wenqiao Zhang; Yunfei Li; Juncheng Li 006; Siliang Tang; Yueting Zhuang (CoRR, 2024)

Iris: Breaking GUI Complexity with Adaptive Focus and Self-Refining. - Zhiqi Ge; Juncheng Li 006; Xinglei Pang; Minghe Gao; Kaihang Pan; Wang Lin; Hao Fei 001; Wenqiao Zhang; Siliang Tang; Yueting Zhuang (CoRR, 2024)

Boosting Private Domain Understanding of Efficient MLLMs: A Tuning-free, Adaptive, Universal Prompt Optimization Framework. - Jiang Liu; Bolin Li; Haoyuan Li 002; Tianwei Lin; Wenqiao Zhang; Tao Zhong; Zhelun Yu; Jinghao Wei; Hao Cheng; Hao Jiang 014; Zheqi Lv; Juncheng Li 006; et al. (CoRR, 2024)

MAKIMA: Tuning-free Multi-Attribute Open-domain Video Editing via Mask-Guided Attention Modulation. - Haoyu Zheng; Wenqiao Zhang; Zheqi Lv; Yu Zhong; Yang Dai; Jianxiang An; Yongliang Shen 001; Juncheng Li 006; Dongping Zhang; Siliang Tang; Yueting Zhuang (CoRR, 2024)

RustGraph: Robust Anomaly Detection in Dynamic Graphs by Jointly Learning Structural-Temporal Dependency. - Jianhao Guo; Siliang Tang; Juncheng Li 006; Kaihang Pan; Lingfei Wu 001 (IEEE Trans. Knowl. Data Eng., 2024)

TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition. - Tianwei Lin; Jiang Liu; Wenqiao Zhang; Yang Dai; Haoyuan Li 002; Zhelun Yu; Wanggui He; Juncheng Li 006; Jiannan Guo 003; Hao Jiang 014; Siliang Tang; Yueting Zhuang (ACL (1), 2025)

Choice is what matters after Attention. - Chenhan Fu; Guoming Wang; Juncheng Li 006; Rongxing Lu; Siliang Tang (AISTATS, 2025)

ITERATE: Image-Text Enhancement, Retrieval, and Alignment for Transmodal Evolution with LLMs. - Chenhan Fu; Guoming Wang; Juncheng Li 006; Wenqiao Zhang; Rongxing Lu; Siliang Tang (COLING, 2025)

Generative Multimodal Pretraining with Discrete Diffusion Timestep Tokens. - Kaihang Pan; Wang Lin; Zhongqi Yue; Tenglong Ao; Liyu Jia; Wei Zhao; Juncheng Li 006; Siliang Tang; Hanwang Zhang (CVPR, 2025)

STEP: Enhancing Video-LLMs' Compositional Reasoning by Spatio-Temporal Graph-guided Self-Training. - Haiyi Qiu; Minghe Gao; Long Qian; Kaihang Pan; Qifan Yu; Juncheng Li 006; Wenjie Wang 007; Siliang Tang; Yueting Zhuang; Tat-Seng Chua (CVPR, 2025)

SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generation. - Leigang Qu; Haochuan Li; Wenjie Wang 007; Xiang Liu 017; Juncheng Li 006; Liqiang Nie; Tat-Seng Chua (CVPR, 2025)

Learning 4D Panoptic Scene Graph Generation from Rich 2D Visual Scene. - Shengqiong Wu; Hao Fei 001; Jingkang Yang; Xiangtai Li; Juncheng Li 006; Hanwang Zhang; Tat-Seng Chua (CVPR, 2025)

AnyEdit: Mastering Unified High-Quality Image Editing for Any Idea. - Qifan Yu; Wei Chow; Zhongqi Yue; Kaihang Pan; Yang Wu; Xiaoyang Wan; Juncheng Li 006; Siliang Tang; Hanwang Zhang; Yueting Zhuang (CVPR, 2025)

Toward Complex-query Referring Image Segmentation: A Novel Benchmark. - Wei Ji 008; Li Li 091; Hao Fei 001; Xiangyan Liu; Xun Yang 001; Juncheng Li 006; Roger Zimmermann (ACM Trans. Multim. Comput. Commun. Appl., 2025)

AEIA-MN: Evaluating the Robustness of Multimodal LLM-Powered Mobile Agents Against Active Environmental Injection Attacks. - Yurun Chen 004; Xueyu Hu; Keting Yin; Juncheng Li 006; Shengyu Zhang 001 (CoRR, 2025)

Chart-HQA: A Benchmark for Hypothetical Question Answering in Charts. - Xiangnan Chen; Yuancheng Fang; Qian Xiao; Juncheng Li 006; Jun Lin; Siliang Tang; Yi Yang 001; Yueting Zhuang (CoRR, 2025)

The Best of Both Worlds: Integrating Language Models and Diffusion Models for Video Generation. - Aoxiong Yin; Kai Shen; Yichong Leng; Xu Tan 003; Xinyu Zhou; Juncheng Li 006; Siliang Tang (CoRR, 2025)

SOYO: A Tuning-Free Approach for Video Style Morphing via Style-Adaptive Interpolation in Diffusion Models. - Haoyu Zheng; Qifan Yu; Binghe Yu; Yang Dai; Wenqiao Zhang; Juncheng Li 006; Siliang Tang; Yueting Zhuang (CoRR, 2025)

Boosting Virtual Agent Learning and Reasoning: A Step-wise, Multi-dimensional, and Generalist Reward Model with Benchmark. - Bingchen Miao; Yang Wu; Minghe Gao; Qifan Yu; Wendong Bu; Wenqiao Zhang; Yunfei Li; Siliang Tang; Tat-Seng Chua; Juncheng Li 006 (CoRR, 2025)

Benchmarking Multimodal CoT Reward Model Stepwise by Visual Program. - Minghe Gao; Xuqi Liu; Zhongqi Yue; Yang Wu; Shuang Chen; Juncheng Li 006; Siliang Tang; Fei Wu 001; Tat-Seng Chua; Yueting Zhuang (CoRR, 2025)

EyecareGPT: Boosting Comprehensive Ophthalmology Understanding with Tailored Dataset, Benchmark and Model. - Sijing Li; Tianwei Lin; Lingshuai Lin; Wenqiao Zhang; Jiang Liu; Xiaoda Yang; Juncheng Li 006; Yucheng He; Xiaohui Song; Jun Xiao 001; Yueting Zhuang; Beng Chin Ooi (CoRR, 2025)

On Path to Multimodal Generalist: General-Level and General-Bench. - Hao Fei 001; Yuan Zhou 016; Juncheng Li 006; Xiangtai Li; Qingshan Xu 001; Bobo Li; Shengqiong Wu; Yaoting Wang; Junbao Zhou; Jiahao Meng; Qingyu Shi; Zhiyuan Zhou; et al. (CoRR, 2025)

Unlocking Aha Moments via Reinforcement Learning: Advancing Collaborative Visual Comprehension and Generation. - Kaihang Pan; Yang Wu; Wendong Bu; Kai Shen; Juncheng Li 006; Yingting Wang; Yunfei Li; Siliang Tang; Jun Xiao 001; Fei Wu 001; Hang Zhao; Yueting Zhuang (CoRR, 2025)

FormFactory: An Interactive Benchmarking Suite for Multimodal Form-Filling Agents. - Bobo Li; Yuheng Wang; Hao Fei 001; Juncheng Li 006; Wei Ji 008; Mong-Li Lee; Wynne Hsu (CoRR, 2025)

MERIT: Multilingual Semantic Retrieval with Interleaved Multi-Condition Query. - Wei Chow; Yuan Gao; Linfeng Li; Xian Wang; Qi Xu; Hang Song; Lingdong Kong; Ran Zhou; Yi Zeng; Yidong Cai; Botian Jiang; Shilin Xu 001; et al. (CoRR, 2025)

FocusDiff: Advancing Fine-Grained Text-Image Alignment for Autoregressive Visual Generation through RL. - Kaihang Pan; Wendong Bu; Yuruo Wu; Yang Wu; Kai Shen; Yunfei Li; Hang Zhao; Juncheng Li 006; Siliang Tang; Yueting Zhuang (CoRR, 2025)

MoA: Heterogeneous Mixture of Adapters for Parameter-Efficient Fine-Tuning of Large Language Models. - Jie Cao; Tianwei Lin; Hongyang He; Rolan Yan; Wenqiao Zhang; Juncheng Li 006; Dongping Zhang; Siliang Tang; Yueting Zhuang (CoRR, 2025)

What Limits Virtual Agent Application? OmniBench: A Scalable Multi-Dimensional Benchmark for Essential Virtual Agent Capabilities. - Wendong Bu; Yang Wu; Qifan Yu; Minghe Gao; Bingchen Miao; Zhenkui Zhang; Kaihang Pan; Yunfei Li; Mengze Li 001; Wei Ji 008; Juncheng Li 006; Siliang Tang; et al. (CoRR, 2025)

Decoupled Seg Tokens Make Stronger Reasoning Video Segmenter and Grounder. - Jisheng Dang; Wu Xudong; Bimei Wang; Lv Ning; Chen Jiayu; Jingwen Zhao; Yichu liu; Jizhao Liu; Juncheng Li 006; Teng Wang (CoRR, 2025)

Consistent and Invariant Generalization Learning for Short-video Misinformation Detection. - Hanghui Guo; Weijie Shi; Mengze Li 001; Juncheng Li 006; Hao Chen; Yue Cui 001; Jiajie Xu 001; Jia Zhu 003; Jiawei Shen; Zhangze Chen; Sirui Han (CoRR, 2025)

SafeWork-R1: Coevolving Safety and Intelligence under the AI-45° Law. - Yicheng Bao; Guanxu Chen; Mingkang Chen; Yunhao Chen; Chiyu Chen; Lingjie Chen; Sirui Chen; Xinquan Chen; Jie Cheng; Yu Cheng 001; Dengke Deng; Yizhuo Ding; et al. (CoRR, 2025)

HarmonyGuard: Toward Safety and Utility in Web Agents via Adaptive Policy Enhancement and Dual-Objective Optimization. - Yurun Chen 004; Xavier Hu; Yuhan Liu; Keting Yin; Juncheng Li 006; Zhuosheng Zhang 001; Shengyu Zhang 001 (CoRR, 2025)

DBA: Efficient Transformer With Dynamic Bilinear Low-Rank Attention. - Bosheng Qin; Juncheng Li 006; Siliang Tang; Yueting Zhuang (IEEE Trans. Neural Networks Learn. Syst., 2025)