BUOL: A Bottom-Up Framework with Occupancy-Aware Lifting for Panoptic 3D Scene Reconstruction From a Single Image. - Tao Chu; Pan Zhang 001; Qiong Liu; Jiaqi Wang 003 (CVPR, 2023)

V3Det: Vast Vocabulary Visual Detection Dataset. - Jiaqi Wang 003; Pan Zhang 001; Tao Chu; Yuhang Cao; Yujie Zhou; Tong Wu; Bin Wang 065; Conghui He; Dahua Lin (ICCV, 2023)

Fine-Grained Building Roof Instance Segmentation Based on Domain Adapted Pretraining and Composite Dual-Backbone. - Guozhang Liu; Baochai Peng; Ting Liu 010; Pan Zhang 001; Mengke Yuan; Chaoran Lu; Ningning Cao; Sen Zhang; Simin Huang; Tao Wang 119 (IGARSS, 2023)

Hgdnet: A Height-Hierarchy Guided Dual-Decoder Network for Single View Building Extraction and Height Estimation. - Chaoran Lu; Ningning Cao; Pan Zhang 001; Ting Liu 010; Baochai Peng; Guozhang Liu; Mengke Yuan; Sen Zhang; Simin Huang; Tao Wang 119 (IGARSS, 2023)

HyperDreamer: Hyper-Realistic 3D Content Generation and Editing from a Single Image. - Tong Wu; Zhibing Li; Shuai Yang 001; Pan Zhang 001; Xingang Pan; Jiaqi Wang 003; Dahua Lin; Ziwei Liu 002 (SIGGRAPH Asia, 2023)

FreeDrag: Point Tracking is Not What You Need for Interactive Point-based Image Editing. - Pengyang Ling; Lin Chen 026; Pan Zhang 001; Huaian Chen; Yi Jin 002 (CoRR, 2023)

MLLM-DataEngine: An Iterative Refinement Approach for MLLM. - Zhiyuan Zhao; Linke Ouyang; Bin Wang 065; Siyuan Huang 003; Pan Zhang 001; Xiaoyi Dong; Jiaqi Wang 003; Conghui He (CoRR, 2023)

InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition. - Pan Zhang 001; Xiaoyi Dong; Bin Wang 065; Yuhang Cao; Chao Xu; Linke Ouyang; Zhiyuan Zhao; Shuangrui Ding; Songyang Zhang; Haodong Duan; Wenwei Zhang; Hang Yan 001; et al. (CoRR, 2023)

VIGC: Visual Instruction Generation and Correction. - Bin Wang 065; Fan Wu; Xiao Han; Jiahui Peng; Huaping Zhong; Pan Zhang 001; Xiaoyi Dong; Weijia Li; Wei Li 044; Jiaqi Wang 003; Conghui He (AAAI, 2024)

Alpha-CLIP: A CLIP Model Focusing on Wherever you Want. - Zeyi Sun 002; Ye Fang; Tong Wu; Pan Zhang 001; Yuhang Zang; Shu Kong; Yuanjun Xiong; Dahua Lin; Jiaqi Wang 003 (CVPR, 2024)

OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation. - Qidong Huang; Xiaoyi Dong; Pan Zhang 001; Bin Wang 065; Conghui He; Jiaqi Wang 003; Dahua Lin; Weiming Zhang 001; Nenghai Yu (CVPR, 2024)

FreeDrag: Feature Dragging for Reliable Point-Based Image Editing. - Pengyang Ling; Lin Chen 026; Pan Zhang 001; Huaian Chen; Yi Jin 002; Jinjin Zheng (CVPR, 2024)

ShareGPT4V: Improving Large Multi-modal Models with Better Captions. - Lin Chen 026; Jinsong Li 001; Xiaoyi Dong; Pan Zhang 001; Conghui He; Jiaqi Wang 003; Feng Zhao 004; Dahua Lin (ECCV (17), 2024)

Long-CLIP: Unlocking the Long-Text Capability of CLIP. - Beichen Zhang; Pan Zhang 001; Xiaoyi Dong; Yuhang Zang; Jiaqi Wang 003 (ECCV (51), 2024)

Water Body Extraction from SAR and Multi-Source Data Using Siamese Network-Based Segmentation. - Ting Liu 010; Mengke Yuan; Chaoran Lu; Kaixuan Lu; Baochai Peng; Heyang Duan; Mengya Li; Pan Zhang 001; Tao Wang 119; Tongkui Liao (IGARSS, 2024)

VLMEvalKit: An Open-Source ToolKit for Evaluating Large Multi-Modality Models. - Haodong Duan; Junming Yang 001; Yuxuan Qiao; Xinyu Fang; Lin Chen 026; Yuan Liu 025; Xiaoyi Dong; Yuhang Zang; Pan Zhang 001; Jiaqi Wang 003; Dahua Lin; Kai Chen 026 (ACM Multimedia, 2024)

ShareGPT4Video: Improving Video Understanding and Generation with Better Captions. - Lin Chen 016; Xilin Wei; Jinsong Li 001; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Zehui Chen; Haodong Duan; Lin Bin; Zhenyu Tang 004; Li Yuan 007; Yu Qiao 001; et al. (NeurIPS, 2024)

Are We on the Right Way for Evaluating Large Vision-Language Models? - Lin Chen; Jinsong Li 001; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Zehui Chen; Haodong Duan; Jiaqi Wang 003; Yu Qiao 001; Dahua Lin; Feng Zhao 004 (NeurIPS, 2024)

InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HD. - Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Bin Wang 065; Linke Ouyang; Songyang Zhang; Haodong Duan; Wenwei Zhang; Yining Li; Hang Yan 001; Yang Gao 042; et al. (NeurIPS, 2024)

MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs. - Ziyu Liu; Tao Chu; Yuhang Zang; Xilin Wei; Xiaoyi Dong; Pan Zhang 001; Zijian Liang; Yuanjun Xiong; Yu Qiao 001; Dahua Lin; Jiaqi Wang 003 (NeurIPS, 2024)

MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations. - Yubo Ma; Yuhang Zang; Liangyu Chen 005; Meiqi Chen 001; Yizhu Jiao; Xinze Li; Xinyuan Lu; Ziyu Liu; Yan Ma; Xiaoyi Dong; Pan Zhang 001; Liangming Pan; et al. (NeurIPS, 2024)

Streaming Long Video Understanding with Large Language Models. - Rui Qian 001; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Shuangrui Ding; Dahua Lin; Jiaqi Wang 003 (NeurIPS, 2024)

InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Model. - Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Bin Wang 065; Linke Ouyang; Xilin Wei; Songyang Zhang; Haodong Duan; Maosong Cao; Wenwei Zhang; Yining Li; et al. (CoRR, 2024)

DualFocus: Integrating Macro and Micro Perspectives in Multi-modal Large Language Models. - Yuhang Cao; Pan Zhang 001; Xiaoyi Dong; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

SongComposer: A Large Language Model for Lyric and Melody Composition in Song Generation. - Shuangrui Ding; Zihan Liu; Xiaoyi Dong; Pan Zhang 001; Rui Qian 001; Conghui He; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

RAR: Retrieving And Ranking Augmented MLLMs for Visual Recognition. - Ziyu Liu; Zeyi Sun 002; Yuhang Zang; Wei Li 044; Pan Zhang 001; Xiaoyi Dong; Yuanjun Xiong; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

Are We on the Right Way for Evaluating Large Vision-Language Models? - Lin Chen 026; Jinsong Li 001; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Zehui Chen; Haodong Duan; Jiaqi Wang 003; Yu Qiao 001; Dahua Lin; Feng Zhao 004 (CoRR, 2024)

Unified Scene Representation and Reconstruction for 3D Large Language Models. - Tao Chu; Pan Zhang 001; Xiaoyi Dong; Yuhang Zang; Qiong Liu; Jiaqi Wang 003 (CoRR, 2024)

ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editing. - Ying Jin; Pengyang Ling; Xiaoyi Dong; Pan Zhang 001; Jiaqi Wang 003; Dahua Lin (CoRR, 2024)

Bootstrap3D: Improving 3D Content Creation with Synthetic Data. - Zeyi Sun 002; Tong Wu; Pan Zhang 001; Yuhang Zang; Xiaoyi Dong; Yuanjun Xiong; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

ShareGPT4Video: Improving Video Understanding and Generation with Better Captions. - Lin Chen 026; Xilin Wei; Jinsong Li 001; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Zehui Chen; Haodong Duan; Bin Lin 014; Zhenyu Tang 004; Li Yuan 007; Yu Qiao 001; et al. (CoRR, 2024)

V3Det Challenge 2024 on Vast Vocabulary and Open Vocabulary Object Detection: Methods and Results. - Jiaqi Wang 003; Yuhang Zang; Pan Zhang 001; Tao Chu; Yuhang Cao; Zeyi Sun 002; Ziyu Liu; Xiaoyi Dong; Tong Wu; Dahua Lin; Zeming Chen 002; Zhi Wang; et al. (CoRR, 2024)

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output. - Pan Zhang 001; Xiaoyi Dong; Yuhang Zang; Yuhang Cao; Rui Qian 001; Lin Chen 026; Qipeng Guo; Haodong Duan; Bin Wang 065; Linke Ouyang; Songyang Zhang; Wenwei Zhang; et al. (CoRR, 2024)

BroadWay: Boost Your Text-to-Video Generation Model in a Training-free Way. - Jiazi Bu; Pengyang Ling; Pan Zhang 001; Tong Wu; Xiaoyi Dong; Yuhang Zang; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate. - Qidong Huang; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Jiaqi Wang 003; Dahua Lin; Weiming Zhang 001; Nenghai Yu (CoRR, 2024)

SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree. - Shuangrui Ding; Rui Qian 001; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Yuwei Guo 002; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction. - Long Xing; Qidong Huang; Xiaoyi Dong; Jiajie Lu; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Conghui He; Jiaqi Wang 003; Feng Wu; Dahua Lin (CoRR, 2024)

X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models. - Zeyi Sun 002; Ziyang Chu; Pan Zhang 001; Tong Wu; Xiaoyi Dong; Yuhang Zang; Yuanjun Xiong; Dahua Lin; Jiaqi Wang 003 (CoRR, 2024)

ASANet: Asymmetric Semantic Aligning Network for RGB and SAR image land cover classification. - Pan Zhang 001; Baochai Peng; Chaoran Lu; Quanjin Huang (CoRR, 2024)

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions. - Pan Zhang 001; Xiaoyi Dong; Yuhang Cao; Yuhang Zang; Rui Qian 001; Xilin Wei; Lin Chen 026; Yifei Li; Junbo Niu; Shuangrui Ding; Qipeng Guo; Haodong Duan; et al. (CoRR, 2024)

Large-Scale Fine-Grained Building Classification and Height Estimation for Semantic Urban Reconstruction: Outcome of the 2023 IEEE GRSS Data Fusion Contest. - Guozhang Liu; Baochai Peng; Ting Liu 010; Pan Zhang 001; Mengke Yuan; Chaoran Lu; Ningning Cao; Sen Zhang; Simin Huang; Tao Wang 119; Xiaoqiang Lu; Licheng Jiao; et al. (IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens., 2024)

SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition. - Shuangrui Ding; Zihan Liu; Xiaoyi Dong; Pan Zhang 001; Rui Qian 001; Junhao Huang; Conghui He; Dahua Lin; Jiaqi Wang 003 (ACL (1), 2025)

Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddings. - Yubo Ma; Jinsong Li 001; Yuhang Zang; Xiaobao Wu; Xiaoyi Dong; Pan Zhang 001; Yuhang Cao; Haodong Duan; Jiaqi Wang 003; Yixin Cao 002; Aixin Sun (ACL (Findings), 2025)

InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model. - Yuhang Zang; Xiaoyi Dong; Pan Zhang 001; Yuhang Cao; Ziyu Liu; Shengyuan Ding; Shenxi Wu; Yubo Ma; Haodong Duan; Wenwei Zhang; Kai Chen 026; Dahua Lin; et al. (ACL (Findings), 2025)

Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction. - Rui Qian 001; Shuangrui Ding; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CVPR, 2025)

ByTheWay: Boost Your Text-to-Video Generation Model to Higher Quality in a Training-free Way. - Jiazi Bu; Pengyang Ling; Pan Zhang 001; Tong Wu; Xiaoyi Dong; Yuhang Zang; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CVPR, 2025)

OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding? - Junbo Niu; Yifei Li; Ziyang Miao; Chunjiang Ge; Yuanhang Zhou; Qihao He; Xiaoyi Dong; Haodong Duan; Shuangrui Ding; Rui Qian 001; Pan Zhang 001; Yuhang Zang; et al. (CVPR, 2025)

Conical Visual Concentration for Efficient Large Vision-Language Models. - Long Xing; Qidong Huang; Xiaoyi Dong; Jiajie Lu; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Conghui He; Jiaqi Wang 003; Feng Wu; Dahua Lin (CVPR, 2025)

MotionClone: Training-Free Motion Cloning for Controllable Video Generation. - Pengyang Ling; Jiazi Bu; Pan Zhang 001; Xiaoyi Dong; Yuhang Zang; Tong Wu; Huaian Chen; Jiaqi Wang 003; Yi Jin 002 (ICLR, 2025)

MIA-DPO: Multi-Image Augmented Direct Preference Optimization For Large Vision-Language Models. - Ziyu Liu; Yuhang Zang; Xiaoyi Dong; Pan Zhang 001; Yuhang Cao; Haodong Duan; Conghui He; Yuanjun Xiong; Dahua Lin; Jiaqi Wang 003 (ICLR, 2025)

Pattern Integration and Enhancement Vision Transformer for Self-Supervised Learning in Remote Sensing. - Kaixuan Lu; Ruiqian Zhang; Xiao Huang 003; Yuxing Xie; Xiaogang Ning; Hanchao Zhang; Mengke Yuan; Pan Zhang 001; Tao Wang 119; Tongkui Liao (IEEE Trans. Geosci. Remote. Sens., 2025)

BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning. - Beichen Zhang; Yuhong Liu; Xiaoyi Dong; Yuhang Zang; Pan Zhang 001; Haodong Duan; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CoRR, 2025)

RelightVid: Temporal-Consistent Diffusion Model for Video Relighting. - Ye Fang; Zeyi Sun 002; Shangzhan Zhang; Tong Wu; Yinghao Xu 001; Pan Zhang 001; Jiaqi Wang 003; Gordon Wetzstein; Dahua Lin (CoRR, 2025)

VideoRoPE: What Makes for Good Video Rotary Position Embedding? - Xilin Wei; Xiaoran Liu; Yuhang Zang; Xiaoyi Dong; Pan Zhang 001; Yuhang Cao; Jian Tong; Haodong Duan; Qipeng Guo; Jiaqi Wang 003; Xipeng Qiu; Dahua Lin (CoRR, 2025)

Light-A-Video: Training-free Video Relighting via Progressive Light Fusion. - Yujie Zhou; Jiazi Bu; Pengyang Ling; Pan Zhang 001; Tong Wu; Qidong Huang; Jinsong Li 001; Xiaoyi Dong; Yuhang Zang; Yuhang Cao; Anyi Rao; Jiaqi Wang 003; et al. (CoRR, 2025)

SongGen: A Single Stage Auto-regressive Transformer for Text-to-Song Generation. - Zihan Liu; Shuangrui Ding; Zhixiong Zhang; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CoRR, 2025)

HiFlow: Training-free High-Resolution Image Generation with Flow-Aligned Guidance. - Jiazi Bu; Pengyang Ling; Yujie Zhou; Pan Zhang 001; Tong Wu; Xiaoyi Dong; Yuhang Zang; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CoRR, 2025)

MM-IFEngine: Towards Multimodal Instruction Following. - Shengyuan Ding; Shenxi Wu; Xiangyu Zhao; Yuhang Zang; Haodong Duan; Xiaoyi Dong; Pan Zhang 001; Yuhang Cao; Dahua Lin; Jiaqi Wang 003 (CoRR, 2025)

ScaleCap: Inference-Time Scalable Image Captioning via Dual-Modality Debiasing. - Long Xing; Qidong Huang; Xiaoyi Dong; Pan Zhang 001; Yuhang Zang; Yuhang Cao; Jinsong Li 001; Shuangrui Ding; Weiming Zhang 001; Nenghai Yu; Jiaqi Wang 003; Feng Wu; et al. (CoRR, 2025)