A variational image segmentation method exploring both intensity means and texture patterns. - Yafeng Li; Qijun Zhao; Xiangchu Feng; Weiwei Wang 005; Renrui Zhang; An Yan 004 (Signal Process. Image Commun., 2019)

End-to-End Object Detection with Adaptive Clustering Transformer. - Minghang Zheng; Peng Gao 007; Renrui Zhang; Kunchang Li 002; Hongsheng Li 001; Hao Dong 003 (BMVC, 2021)

Dual-stream Network for Visual Recognition. - Mingyuan Mao; Peng Gao 007; Renrui Zhang; Honghui Zheng; Teli Ma; Yan Peng; Errui Ding; Baochang Zhang 001; Shumin Han (NeurIPS, 2021)

Differential Privacy Protection and Game Analysis of Intelligent Transportation Data. - Junming Zhang; Jingru Wang; Shigong Long; Lun Wang; Xuejiao Wang; Renrui Zhang (PAAP, 2021)

Dual-stream Network for Visual Recognition. - Mingyuan Mao; Renrui Zhang; Honghui Zheng; Peng Gao 007; Teli Ma; Yan Peng; Errui Ding; Shumin Han (CoRR, 2021)

Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling. - Renrui Zhang; Rongyao Fang; Wei Zhang 056; Peng Gao 007; Kunchang Li 002; Jifeng Dai; Yu Qiao 001; Hongsheng Li 001 (CoRR, 2021)

DSPoint: Dual-scale Point Cloud Recognition with High-frequency Fusion. - Renrui Zhang; Ziyao Zeng; Ziyu Guo; Xinben Gao; Kexue Fu 001; Jianbo Shi (CoRR, 2021)

VT-CLIP: Enhancing Vision-Language Models with Visual-guided Texts. - Renrui Zhang; Longtian Qiu; Wei Zhang; Ziyao Zeng (CoRR, 2021)

PointCLIP: Point Cloud Understanding by CLIP. - Renrui Zhang; Ziyu Guo; Wei Zhang 056; Kunchang Li 002; Xupeng Miao; Bin Cui 001; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (CVPR, 2022)

Exploring Resolution and Degradation Clues as Self-supervised Signal for Low Quality Object Detection. - Ziteng Cui; Yingying Zhu 004; Lin Gu 003; Guo-Jun Qi; Xiaoxiao Li; Renrui Zhang; Zenghui Zhang; Tatsuya Harada (ECCV (9), 2022)

Frozen CLIP Models are Efficient Video Learners. - Ziyi Lin; Shijie Geng; Renrui Zhang; Peng Gao 007; Gerard de Melo; Xiaogang Wang 001; Jifeng Dai; Yu Qiao 001; Hongsheng Li 001 (ECCV (35), 2022)

Tip-Adapter: Training-Free Adaption of CLIP for Few-Shot Classification. - Renrui Zhang; Wei Zhang 056; Rongyao Fang; Peng Gao 007; Kunchang Li 002; Jifeng Dai; Yu Qiao 001; Hongsheng Li 001 (ECCV (35), 2022)

Can Language Understand Depth? - Renrui Zhang; Ziyao Zeng; Ziyu Guo; Yafeng Li (ACM Multimedia, 2022)

Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-training. - Renrui Zhang; Ziyu Guo; Peng Gao 007; Rongyao Fang; Bin Zhao 001; Dong Wang 004; Yu Qiao 001; Hongsheng Li 001 (NeurIPS, 2022)

Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning. - Kexue Fu 001; Peng Gao 007; Renrui Zhang; Hongsheng Li 001; Yu Qiao 001; Manning Wang (CoRR, 2022)

MonoDETR: Depth-aware Transformer for Monocular 3D Object Detection. - Renrui Zhang; Han Qiu 010; Tai Wang; Xuanzhuo Xu; Ziyu Guo; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (CoRR, 2022)

POS-BERT: Point Cloud One-Stage BERT Pre-Training. - Kexue Fu 001; Peng Gao 007; Shaolei Liu; Renrui Zhang; Yu Qiao 001; Manning Wang (CoRR, 2022)

Can Language Understand Depth? - Renrui Zhang; Ziyao Zeng; Ziyu Guo (CoRR, 2022)

Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classification. - Renrui Zhang; Zhang Wei; Rongyao Fang; Peng Gao 007; Kunchang Li 002; Jifeng Dai; Yu Qiao 001; Hongsheng Li 001 (CoRR, 2022)

Collaboration of Pre-trained Models Makes Better Few-shot Learner. - Renrui Zhang; Hanqiu Deng; Bohao Li; Wei Zhang 056; Hao Dong 003; Hongsheng Li 001; Peng Gao 007; Yu Qiao 001 (CoRR, 2022)

EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual and Language Learning. - Yanmin Wu; Xinhua Cheng; Renrui Zhang; Zesen Cheng; Jian Zhang 018 (CoRR, 2022)

PointCLIP V2: Adapting CLIP for Powerful 3D Open-world Learning. - Xiangyang Zhu; Renrui Zhang; Bowei He; Ziyao Zeng; Shanghang Zhang; Peng Gao 007 (CoRR, 2022)

TiG-BEV: Multi-view BEV 3D Object Detection via Target Inner-Geometry Learning. - Peixiang Huang; Li Liu; Renrui Zhang; Song Zhang; Xinli Xu; Baichao Wang; Guoyi Liu (CoRR, 2022)

Decorate the Newcomers: Visual Domain Prompt for Continual Test Time Adaptation. - Yulu Gan; Yan Bai; Yihang Lou; Xianzheng Ma; Renrui Zhang; Nian Shi; Lin Luo (AAAI, 2023)

CALIP: Zero-Shot Enhancement of CLIP with Parameter-Free Attention. - Ziyu Guo; Renrui Zhang; Longtian Qiu; Xianzheng Ma; Xupeng Miao; Xuming He 001; Bin Cui 001 (AAAI, 2023)

Dynamic Embedding Size Search with Minimum Regret for Streaming Recommender System. - Bowei He; Xu He; Renrui Zhang; Yingxue Zhang 001; Ruiming Tang; Chen Ma 001 (CIKM, 2023)

iQuery: Instruments as Queries for Audio-Visual Sound Separation. - Jiaben Chen; Renrui Zhang; Dongze Lian; Jiaqi Yang; Ziyao Zeng; Jianbo Shi (CVPR, 2023)

PiMAE: Point Cloud and Image Interactive Masked Autoencoders for 3D Object Detection. - Anthony Chen; Kevin Zhang; Renrui Zhang; Zihan Wang; Yuheng Lu; Yandong Guo; Shanghang Zhang (CVPR, 2023)

EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Grounding. - Yanmin Wu; Xinhua Cheng; Renrui Zhang; Zesen Cheng; Jian Zhang 018 (CVPR, 2023)

Prompt, Generate, Then Cache: Cascade of Foundation Models Makes Strong Few-Shot Learners. - Renrui Zhang; Xiangfei Hu; Bohao Li; Siyuan Huang 004; Hanqiu Deng; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (CVPR, 2023)

Learning 3D Representations from 2D Pre-Trained Models via Image-to-Point Masked Autoencoders. - Renrui Zhang; Liuhui Wang; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (CVPR, 2023)

Starting from Non-Parametric Networks for 3D Point Cloud Analysis. - Renrui Zhang; Liuhui Wang; Yali Wang 001; Peng Gao 007; Hongsheng Li 001; Jianbo Shi (CVPR, 2023)

MonoDETR: Depth-guided Transformer for Monocular 3D Object Detection. - Renrui Zhang; Han Qiu 010; Tai Wang; Ziyu Guo; Ziteng Cui; Yu Qiao 001; Hongsheng Li 001; Peng Gao 007 (ICCV, 2023)

SparseMAE: Sparse Training Meets Masked Autoencoders. - Aojun Zhou; Yang Li 116; Zipeng Qin; Jianbo Liu; Junting Pan; Renrui Zhang; Rui Zhao 001; Peng Gao 007; Hongsheng Li 001 (ICCV, 2023)

PointCLIP V2: Prompting CLIP and GPT for Powerful 3D Open-world Learning. - Xiangyang Zhu; Renrui Zhang; Bowei He; Ziyu Guo; Ziyao Zeng; Zipeng Qin; Shanghang Zhang; Peng Gao 007 (ICCV, 2023)

Not All Features Matter: Enhancing Few-shot CLIP with Adaptive Prior Refinement. - Xiangyang Zhu; Renrui Zhang; Bowei He; Aojun Zhou; Dong Wang 004; Bin Zhao 001; Peng Gao 007 (ICCV, 2023)

Retrieving-to-Answer: Zero-Shot Video Question Answering with Frozen Large Language Models. - Junting Pan; Ziyi Lin; Yuying Ge; Xiatian Zhu; Renrui Zhang; Yi Wang 074; Yu Qiao 001; Hongsheng Li 001 (ICCV (Workshops), 2023)

Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training. - Ziyu Guo; Renrui Zhang; Longtian Qiu; Xianzhi Li; Pheng-Ann Heng (IJCAI, 2023)

Revisiting Event-Based Video Frame Interpolation. - Jiaben Chen; Yichen Zhu; Dongze Lian; Jiaqi Yang; Yifu Wang; Renrui Zhang; Xinhang Liu; Shenhan Qian; Laurent Kneip; Shenghua Gao (IROS, 2023)

JourneyDB: A Benchmark for Generative Image Understanding. - Keqiang Sun; Junting Pan; Yuying Ge; Hao Li 069; Haodong Duan; Xiaoshi Wu; Renrui Zhang; Aojun Zhou; Zipeng Qin; Yi Wang 074; Jifeng Dai; Yu Qiao 001; et al. (NeurIPS, 2023)

DS-Point: A Dual-Scale 3D Framework for Point Cloud Understanding. - Renrui Zhang; Ziyao Zeng; Ziyu Guo; Borui Chen; Guangnan Zhang; Xilan Liu (SMC, 2023)

Nearest Neighbors Meet Deep Neural Networks for Point Cloud Analysis. - Renrui Zhang; Liuhui Wang; Ziyu Guo; Jianbo Shi (WACV, 2023)

Mimic before Reconstruct: Enhancing Masked Autoencoders with Feature Mimicking. - Peng Gao 007; Renrui Zhang; Rongyao Fang; Ziyi Lin; Hongyang Li 001; Hongsheng Li 001; Qiao Yu (CoRR, 2023)

Parameter is Not All You Need: Starting from Non-Parametric Networks for 3D Point Cloud Analysis. - Renrui Zhang; Liuhui Wang; Yali Wang 001; Peng Gao 007; Hongsheng Li 001; Jianbo Shi (CoRR, 2023)

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention. - Renrui Zhang; Jiaming Han; Aojun Zhou; Xiangfei Hu; Shilin Yan; Pan Lu; Hongsheng Li 001; Peng Gao 007; Yu Qiao 001 (CoRR, 2023)

ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidance. - Ziyu Guo; Yiwen Tang; Renrui Zhang; Dong Wang 028; Zhigang Wang 002; Bin Zhao 001; Xuelong Li 001 (CoRR, 2023)

LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model. - Peng Gao 007; Jiaming Han; Renrui Zhang; Ziyi Lin; Shijie Geng; Aojun Zhou; Wei Zhang 056; Pan Lu; Conghui He; Xiangyu Yue 001; Hongsheng Li 001; Yu Qiao 001 (CoRR, 2023)

Personalize Segment Anything Model with One Shot. - Renrui Zhang; Zhengkai Jiang 001; Ziyu Guo; Shilin Yan; Junting Pan; Hao Dong 003; Peng Gao 007; Hongsheng Li 001 (CoRR, 2023)

Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation. - Shilin Yan; Renrui Zhang; Ziyu Guo; Wenchao Chen; Wei Zhang; Hongyang Li 001; Yu Qiao 001; Zhongjiang He; Peng Gao 007 (CoRR, 2023)

Less is More: Towards Efficient Few-shot 3D Semantic Segmentation via Training-free Networks. - Xiangyang Zhu; Renrui Zhang; Bowei He; Ziyu Guo; Jiaming Liu 003; Hao Dong 003; Peng Gao 007 (CoRR, 2023)

Point-Bind & Point-LLM: Aligning Point Cloud with Multi-modality for 3D Understanding, Generation, and Instruction Following. - Ziyu Guo; Renrui Zhang; Xiangyang Zhu; Yiwen Tang; Xianzheng Ma; Jiaming Han; Kexin Chen 003; Peng Gao 007; Xianzhi Li; Hongsheng Li 001; Pheng-Ann Heng (CoRR, 2023)

ImageBind-LLM: Multi-modality Instruction Tuning. - Jiaming Han; Renrui Zhang; Wenqi Shao; Peng Gao 007; Peng Xu; Han Xiao 010; Kaipeng Zhang; Chris Liu; Song Wen 006; Ziyu Guo; Xudong Lu; Shuai Ren; et al. (CoRR, 2023)

RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision. - Mingjie Pan; Jiaming Liu 003; Renrui Zhang; Peixiang Huang; Xiaoqi Li 009; Li Liu; Shanghang Zhang (CoRR, 2023)

NOC: High-Quality Neural Object Cloning with 3D Lifting of Segment Anything. - Xiaobao Wei; Renrui Zhang; Jiarui Wu; Jiaming Liu 003; Ming Lu; Yandong Guo; Shanghang Zhang (CoRR, 2023)

Improving Compositional Text-to-image Generation with Large Vision-Language Models. - Song Wen 001; Guian Fang; Renrui Zhang; Peng Gao 007; Hao Dong 003; Dimitris N. Metaxas (CoRR, 2023)

SPHINX: The Joint Mixing of Weights, Tasks, and Visual Embeddings for Multi-modal Large Language Models. - Ziyi Lin; Chris Liu; Renrui Zhang; Peng Gao 007; Longtian Qiu; Han Xiao 010; Han Qiu 010; Chen Lin; Wenqi Shao; Keqin Chen; Jiaming Han; Siyuan Huang 004; et al. (CoRR, 2023)

ChatIllusion: Efficient-Aligning Interleaved Generation ability with Visual Instruction Model. - Xiaowei Chi; Yijiang Liu; Zhengkai Jiang 001; Rongyu Zhang; Ziyi Lin; Renrui Zhang; Peng Gao 007; Chaoyou Fu; Shanghang Zhang; Qifeng Liu; Yike Guo (CoRR, 2023)

3DAxiesPrompts: Unleashing the 3D Spatial Task Capabilities of GPT-4V. - Dingning Liu; Xiaomeng Dong; Renrui Zhang; Xu Luo; Peng Gao 007; Xiaoshui Huang; Yongshun Gong; Zhihui Wang 001 (CoRR, 2023)

Language-Assisted 3D Scene Understanding. - Yanmin Wu; Qiankun Gao; Renrui Zhang; Jian Zhang 018 (CoRR, 2023)

A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise. - Chaoyou Fu; Renrui Zhang; Zihan Wang; Yubo Huang; Zhengye Zhang; Longtian Qiu; Gaoxiang Ye; Yunhang Shen; Mengdan Zhang; Peixian Chen; Sirui Zhao; Shaohui Lin; et al. (CoRR, 2023)

Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation. - Jiaming Liu 003; Ran Xu 013; Senqiao Yang; Renrui Zhang; Qizhe Zhang; Zehui Chen; Yandong Guo; Shanghang Zhang (CoRR, 2023)

Parsing All Adverse Scenes: Severity-Aware Semantic Segmentation with Mask-Enhanced Cross-Domain Consistency. - Fuhao Li; Ziyang Gong; Yupeng Deng 002; Xianzheng Ma; Renrui Zhang; Zhenming Ji; Xiangwei Zhu; Hong Zhang (AAAI, 2024)

Referred by Multi-Modality: A Unified Temporal Transformer for Video Object Segmentation. - Shilin Yan; Renrui Zhang; Ziyu Guo; Wenchao Chen; Wei Zhang 016; Hongyang Li 001; Yu Qiao 001; Hao Dong 003; Zhongjiang He; Peng Gao 007 (AAAI, 2024)

FM-OV3D: Foundation Model-Based Cross-Modal Knowledge Blending for Open-Vocabulary 3D Detection. - Dongmei Zhang; Chang Li; Renrui Zhang; Shenghao Xie; Wei Xue 002; Xiaodong Xie; Shanghang Zhang (AAAI, 2024)

ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation. - Xiaoqi Li 020; Mingxu Zhang; Yiran Geng; Haoran Geng; Yuxing Long; Yan Shen 035; Renrui Zhang; Jiaming Liu 003; Hao Dong 003 (CVPR, 2024)

OneTracker: Unifying Visual Object Tracking with Foundation Models and Efficient Tuning. - Lingyi Hong; Shilin Yan; Renrui Zhang; Wanyun Li; Xinyu Zhou; Pinxue Guo; Kaixun Jiang; Yiting Chen; Jinglun Li; Zhaoyu Chen 001; Wenqiang Zhang (CVPR, 2024)

Continual-MAE: Adaptive Distribution Masked Autoencoders for Continual Test-Time Adaptation. - Jiaming Liu 003; Ran Xu 013; Senqiao Yang; Renrui Zhang; Qizhe Zhang; Zehui Chen; Yandong Guo; Shanghang Zhang (CVPR, 2024)

Cloud-Device Collaborative Learning for Multimodal Large Language Models. - Guanqun Wang; Jiaming Liu 003; Chenxuan Li; Yuan Zhang 020; Junpeng Ma; Xinyu Wei; Kevin Zhang; Maurice Chong; Renrui Zhang; Yijiang Liu; Shanghang Zhang (CVPR, 2024)

NTO3D: Neural Target Object 3D Reconstruction with Segment Anything. - Xiaobao Wei; Renrui Zhang; Jiarui Wu; Jiaming Liu 003; Ming Lu; Yandong Guo; Shanghang Zhang (CVPR, 2024)

Gradient-based Parameter Selection for Efficient Fine-Tuning. - Zhi Zhang 009; Qizhe Zhang; Zijun Gao; Renrui Zhang; Ekaterina Shutova; Shiji Zhou; Shanghang Zhang (CVPR, 2024)

No Time to Train: Empowering Non-Parametric Networks for Few-Shot 3D Scene Segmentation. - Xiangyang Zhu; Renrui Zhang; Bowei He; Ziyu Guo; Jiaming Liu 003; Han Xiao 010; Chaoyou Fu; Hao Dong 003; Peng Gao 007 (CVPR, 2024)

SPHINX: A Mixer of Weights, Visual Embeddings and Image Scales for Multi-modal Large Language Models. - Ziyi Lin; Dongyang Liu; Renrui Zhang; Peng Gao 007; Longtian Qiu; Han Xiao 010; Han Qiu 010; Wenqi Shao; Keqin Chen; Jiaming Han; Siyuan Huang 004; Yichi Zhang; et al. (ECCV (62), 2024)

PanoVOS: Bridging Non-panoramic and Panoramic Views with Transformer for Video Segmentation. - Shilin Yan; Xiaohao Xu; Renrui Zhang; Lingyi Hong; Wenchao Chen; Wenqiang Zhang; Wei Zhang (ECCV (9), 2024)

MATHVERSE: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? - Renrui Zhang; Dongzhi Jiang; Yichi Zhang; Haokun Lin; Ziyu Guo; Pengshuo Qiu; Aojun Zhou; Pan Lu; Kai-Wei Chang; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (ECCV (8), 2024)

Unleashing the Potentials of Likelihood Composition for Multi-modal Language Models. - Shitian Zhao; Renrui Zhang; Xu Luo; Yan Wang; Shanghang Zhang; Peng Gao 007 (EMNLP (Findings), 2024)

ViDA: Homeostatic Visual Domain Adapter for Continual Test Time Adaptation. - Jiaming Liu 003; Senqiao Yang; Peidong Jia; Renrui Zhang; Ming Lu; Yandong Guo; Wei Xue 002; Shanghang Zhang (ICLR, 2024)

MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning. - Ke Wang 036; Houxing Ren; Aojun Zhou; Zimu Lu; Sichun Luo; Weikang Shi; Renrui Zhang; Linqi Song; Mingjie Zhan; Hongsheng Li 001 (ICLR, 2024)

Personalize Segment Anything Model with One Shot. - Renrui Zhang; Zhengkai Jiang 001; Ziyu Guo; Shilin Yan; Junting Pan; Hao Dong 003; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (ICLR, 2024)

LLaMA-Adapter: Efficient Fine-tuning of Large Language Models with Zero-initialized Attention. - Renrui Zhang; Jiaming Han; Chris Liu; Aojun Zhou; Pan Lu; Yu Qiao 001; Hongsheng Li 001; Peng Gao 007 (ICLR, 2024)

SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models. - Dongyang Liu; Renrui Zhang; Longtian Qiu; Siyuan Huang 004; Weifeng Lin; Shitian Zhao; Shijie Geng; Ziyi Lin; Peng Jin; Kaipeng Zhang; Wenqi Shao; Chao Xu; et al. (ICML, 2024)

SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models. - Xudong Lu; Aojun Zhou; Yuhui Xu; Renrui Zhang; Peng Gao 007; Hongsheng Li 001 (ICML, 2024)

MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI. - Kaining Ying; Fanqing Meng; Jin Wang; Zhiqian Li; Han Lin; Yue Yang; Hao Zhang 117; Wenbo Zhang 009; Yuqi Lin; Shuo Liu; Jiayi Lei; Quanfeng Lu; et al. (ICML, 2024)

RenderOcc: Vision-Centric 3D Occupancy Prediction with 2D Rendering Supervision. - Mingjie Pan; Jiaming Liu 003; Renrui Zhang; Peixiang Huang; Xiaoqi Li 020; Hongwei Xie; Bing Wang; Li Liu; Shanghang Zhang (ICRA, 2024)

Knowledge Refinement: An Interpretable Analytics for Travel Behaviors Based on Knowledge Automation. - Peijun Ye 001; Renrui Zhang; Shichao Ge (ITSC, 2024)

CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching. - Dongzhi Jiang; Guanglu Song; Xiaoshi Wu; Renrui Zhang; Dazhong Shen; Zhuofan Zong; Yu Liu 015; Hongsheng Li 001 (NeurIPS, 2024)

RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation. - Jiaming Liu 003; Mengzhen Liu; Zhenyu Wang 002; Pengju An; Xiaoqi Li 020; Kaichen Zhou; Senqiao Yang; Renrui Zhang; Yandong Guo; Shanghang Zhang (NeurIPS, 2024)

SPHINX-X: Scaling Data and Parameters for a Family of Multi-modal Large Language Models. - Peng Gao 007; Renrui Zhang; Chris Liu; Longtian Qiu; Siyuan Huang 004; Weifeng Lin; Shitian Zhao; Shijie Geng; Ziyi Lin; Peng Jin; Kaipeng Zhang; Wenqi Shao; et al. (CoRR, 2024)

MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems? - Renrui Zhang; Dongzhi Jiang; Yichi Zhang; Haokun Lin; Ziyu Guo; Pengshuo Qiu; Aojun Zhou; Pan Lu; Kai-Wei Chang; Peng Gao 007; Hongsheng Li 001 (CoRR, 2024)

Lumina-T2X: Transforming Text into Any Modality, Resolution, and Duration via Flow-based Large Diffusion Transformers. - Peng Gao 007; Le Zhuo; Dongyang Liu; Ruoyi Du; Xu Luo; Longtian Qiu; Yuhang Zhang; Chen Lin; Rongjie Huang 001; Shijie Geng; Renrui Zhang; Junlin Xi; et al. (CoRR, 2024)

TerDiT: Ternary Diffusion Models with Transformers. - Xudong Lu; Aojun Zhou; Ziyi Lin; Qi Liu; Yuhui Xu; Renrui Zhang; Yafei Wen; Shuai Ren; Peng Gao 007; Junchi Yan; Hongsheng Li 001 (CoRR, 2024)

Self-Corrected Multimodal Large Language Model for End-to-End Robot Manipulation. - Jiaming Liu 003; Chenxuan Li; Guanqun Wang; Lily Lee; Kaichen Zhou; Sixiang Chen; Chuyan Xiong; Jiaxin Ge; Renrui Zhang; Shanghang Zhang (CoRR, 2024)

TripletMix: Triplet Data Augmentation for 3D Understanding. - Jiaze Wang; Yi Wang; Ziyu Guo; Renrui Zhang; Donghao Zhou; Guangyong Chen; Anfeng Liu; Pheng-Ann Heng (CoRR, 2024)

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis. - Chaoyou Fu; Yuhan Dai; Yondong Luo; Lei Li; Shuhuai Ren; Renrui Zhang; Zihan Wang; Chenyu Zhou; Yunhang Shen; Mengdan Zhang; Peixian Chen; Yanwei Li; et al. (CoRR, 2024)

RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation. - Jiaming Liu 003; Mengzhen Liu; Zhenyu Wang 002; Lily Lee; Kaichen Zhou; Pengju An; Senqiao Yang; Renrui Zhang; Yandong Guo; Shanghang Zhang (CoRR, 2024)

LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models. - Feng Li 040; Renrui Zhang; Hao Zhang 097; Yuanhan Zhang; Bo Li 080; Wei Li 190; Zejun Ma; Chunyuan Li (CoRR, 2024)

MAVIS: Mathematical Visual Instruction Tuning. - Renrui Zhang; Xinyu Wei; Dongzhi Jiang; Yichi Zhang; Ziyu Guo; Chengzhuo Tong; Jiaming Liu 003; Aojun Zhou; Bin Wei; Shanghang Zhang; Peng Gao 007; Hongsheng Li 001 (CoRR, 2024)

LLaVA-OneVision: Easy Visual Task Transfer. - Bo Li 080; Yuanhan Zhang; Dong Guo; Renrui Zhang; Feng Li 040; Hao Zhang 097; Kaichen Zhang; Yanwei Li; Ziwei Liu 002; Chunyuan Li (CoRR, 2024)

SAM2Point: Segment Any 3D as Videos in Zero-shot and Promptable Manners. - Ziyu Guo; Renrui Zhang; Xiangyang Zhu; Chengzhuo Tong; Peng Gao 007; Chunyuan Li; Pheng-Ann Heng (CoRR, 2024)

MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Engines. - Dongzhi Jiang; Renrui Zhang; Ziyu Guo; Yanmin Wu; Jiayi Lei; Pengshuo Qiu; Pan Lu; Zehui Chen; Guanglu Song; Peng Gao 007; Yu Liu 015; Chunyuan Li; et al. (CoRR, 2024)

PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions. - Weifeng Lin; Xinyu Wei; Renrui Zhang; Le Zhuo; Shitian Zhao; Siyuan Huang 004; Junlin Xi; Yu Qiao 001; Peng Gao 007; Hongsheng Li 001 (CoRR, 2024)

CoPESD: A Multi-Level Surgical Motion Dataset for Training Large Vision-Language Models to Co-Pilot Endoscopic Submucosal Dissection. - Guankun Wang; Han Xiao 010; Huxin Gao; Renrui Zhang; Long Bai 008; Xiaoxiao Yang; Zhen Li 026; Hongsheng Li 001; Hongliang Ren 001 (CoRR, 2024)

Training-free Regional Prompting for Diffusion Transformers. - Anthony Chen; Jianjin Xu; Wenzhao Zheng; Gaole Dai; Yida Wang; Renrui Zhang; Haofan Wang; Shanghang Zhang (CoRR, 2024)

Point Cloud Understanding via Attention-Driven Contrastive Learning. - Yi Wang; Jiaze Wang; Ziyu Guo; Renrui Zhang; Donghao Zhou; Guangyong Chen; Anfeng Liu; Pheng-Ann Heng (CoRR, 2024)

Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulation. - Yueru Jia; Jiaming Liu 003; Sixiang Chen; Chenyang Gu; Zhilue Wang; Longzan Luo; Lily Lee; Pengwei Wang 004; Zhongyuan Wang 006; Renrui Zhang; Shanghang Zhang (CoRR, 2024)

Chimera: Improving Generalist Model with Domain-Specific Experts. - Tianshuo Peng; Mingsheng Li; Hongbin Zhou; Renqiu Xia; Renrui Zhang; Lei Bai 001; Song Mao; Bin Wang 065; Conghui He; Aojun Zhou; Botian Shi; Tao Chen 003; et al. (CoRR, 2024)

TAR3D: Creating High-Quality 3D Assets via Next-Part Prediction. - Xuying Zhang; Yutong Liu; Yangguang Li 001; Renrui Zhang; Yufei Liu; Kai Wang 001; Wanli Ouyang; Zhiwei Xiong; Peng Gao 007; Qibin Hou; Ming-Ming Cheng (CoRR, 2024)

CLIP-Adapter: Better Vision-Language Models with Feature Adapters. - Peng Gao 007; Shijie Geng; Renrui Zhang; Teli Ma; Rongyao Fang; Yongfeng Zhang; Hongsheng Li 001; Yu Qiao 001 (Int. J. Comput. Vis., 2024)

Mimic before Reconstruct: Enhancing Masked Autoencoders with Feature Mimicking. - Peng Gao 007; Ziyi Lin; Renrui Zhang; Rongyao Fang; Hongyang Li 001; Hongsheng Li 001; Yu Qiao 001 (Int. J. Comput. Vis., 2024)

MM-Mixing: Multi-Modal Mixing Alignment for 3D Understanding. - Jiaze Wang; Yi Wang; Ziyu Guo; Renrui Zhang; Donghao Zhou; Guangyong Chen; Anfeng Liu; Pheng-Ann Heng (AAAI, 2025)

LiDAR-LLM: Exploring the Potential of Large Language Models for 3D LiDAR Understanding. - Senqiao Yang; Jiaming Liu 003; Renrui Zhang; Mingjie Pan; Ziyu Guo; Xiaoqi Li 009; Zehui Chen; Peng Gao 007; Hongsheng Li 001; Yandong Guo; Shanghang Zhang (AAAI, 2025)

SciVerse: Unveiling the Knowledge Comprehension and Visual Reasoning of LMMs on Multi-modal Scientific Problems. - Ziyu Guo; Renrui Zhang; Hao Chen 011; Jialin Gao; Dongzhi Jiang; Jiaze Wang; Pheng-Ann Heng (ACL (Findings), 2025)

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis. - Chaoyou Fu; Yuhan Dai; Yongdong Luo; Lei Li; Shuhuai Ren; Renrui Zhang; Zihan Wang; Chenyu Zhou; Yunhang Shen; Mengdan Zhang; Peixian Chen; Yanwei Li; et al. (CVPR, 2025)

Lift3D Policy: Lifting 2D Foundation Models for Robust 3D Robotic Manipulation. - Yueru Jia; Jiaming Liu 003; Sixiang Chen; Chenyang Gu; Zhilue Wang; Longzan Luo; Xiaoqi Li 009; Pengwei Wang 004; Zhongyuan Wang 006; Renrui Zhang; Shanghang Zhang (CVPR, 2025)

Let's Verify and Reinforce Image Generation Step by Step. - Renrui Zhang; Chengzhuo Tong; Zhizheng Zhao; Ziyu Guo; Haoquan Zhang; Manyuan Zhang; Jiaming Liu 003; Peng Gao 007; Hongsheng Li 001 (CVPR, 2025)

Lumina-T2X: Scalable Flow-based Large Diffusion Transformer for Flexible Resolution Generation. - Peng Gao 007; Le Zhuo; Dongyang Liu; Ruoyi Du; Xu Luo; Longtian Qiu; Yuhang Zhang; Rongjie Huang 001; Shijie Geng; Renrui Zhang; Junlin Xie; Wenqi Shao; et al. (ICLR, 2025)

MMSearch: Unveiling the Potential of Large Models as Multi-modal Search Engines. - Dongzhi Jiang; Renrui Zhang; Ziyu Guo; Yanmin Wu; Jiayi Lei; Pengshuo Qiu; Pan Lu; Zehui Chen; Guanglu Song; Peng Gao 007; Yu Liu 015; Chunyuan Li; et al. (ICLR, 2025)

LLaVA-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Models. - Feng Li 040; Renrui Zhang; Hao Zhang 097; Yuanhan Zhang; Bo Li 080; Wei Li 190; Zejun Ma; Chunyuan Li (ICLR, 2025)

PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions. - Weifeng Lin; Xinyu Wei; Renrui Zhang; Le Zhuo; Shitian Zhao; Siyuan Huang 004; Junlin Xie; Peng Gao 007; Hongsheng Li 001 (ICLR, 2025)

MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine. - Renrui Zhang; Xinyu Wei; Dongzhi Jiang; Ziyu Guo; Yichi Zhang; Chengzhuo Tong; Jiaming Liu 003; Aojun Zhou; Shanghang Zhang; Peng Gao 007; Hongsheng Li 001 (ICLR, 2025)

3DAxisPrompt: Promoting the 3D grounding and reasoning in GPT-4o. - Dingning Liu; Cheng Wang 026; Peng Gao 007; Renrui Zhang; Xinzhu Ma; Yuan Meng; Zhihui Wang 001 (Neurocomputing, 2025)

LLaVA-OneVision: Easy Visual Task Transfer. - Bo Li 080; Yuanhan Zhang; Dong Guo; Renrui Zhang; Feng Li 040; Hao Zhang 097; Kaichen Zhang; Peiyuan Zhang; Yanwei Li; Ziwei Liu 002; Chunyuan Li (Trans. Mach. Learn. Res., 2025)

Language-Assisted 3D Scene Understanding. - Yanmin Wu; Qiankun Gao; Renrui Zhang; Haijie Li; Jian Zhang 018 (IEEE Trans. Multim., 2025)

IMAGINE-E: Image Generation Intelligence Evaluation of State-of-the-art Text-to-Image Models. - Jiayi Lei; Renrui Zhang; Xiangfei Hu; Weifeng Lin; Zhen Li 026; Wenjian Sun; Ruoyi Du; Le Zhuo; Zhongyu Li 002; Xinyue Li 001; Shitian Zhao; Ziyu Guo; et al. (CoRR, 2025)

Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step. - Ziyu Guo; Renrui Zhang; Chengzhuo Tong; Zhizheng Zhao; Peng Gao 007; Hongsheng Li 001; Pheng-Ann Heng (CoRR, 2025)

MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency. - Dongzhi Jiang; Renrui Zhang; Ziyu Guo; Yanwei Li; Yu Qi; Xinyan Chen; Liuhui Wang; Jianhan Jin; Claire Guo; Shen Yan; Bo Zhang 069; Chaoyou Fu; et al. (CoRR, 2025)

PiSA: A Self-Augmented Data Engine and Training Strategy for 3D Understanding with Large Models. - Zilu Guo; Hongbin Lin; Zhihao Yuan; Chaoda Zheng; Pengshuo Qiu; Dongzhi Jiang; Renrui Zhang; Chun-Mei Feng 001; Zhen Li 026 (CoRR, 2025)

HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model. - Jiaming Liu 003; Hao Chen 011; Pengju An; Zhuoyang Liu; Renrui Zhang; Chenyang Gu; Xiaoqi Li 020; Ziyu Guo; Sixiang Chen; Mengzhen Liu; Chengkai Hou; Mengdi Zhao; et al. (CoRR, 2025)

Concept-as-Tree: Synthetic Data is All You Need for VLM Personalization. - Ruichuan An; Kai Zeng; Ming Lu; Sihan Yang; Renrui Zhang; Huitong Ji; Qizhe Zhang; Yulin Luo; Hao Liang; Wentao Zhang (CoRR, 2025)

Detect Anything 3D in the Wild. - Hanxue Zhang; Haoran Jiang; Qingsong Yao; Yanan Sun 005; Renrui Zhang; Hao Zhao 002; Hongyang Li 001; Hongzi Zhu; Zetong Yang (CoRR, 2025)

TrustGeoGen: Scalable and Formal-Verified Data Engine for Trustworthy Multi-modal Geometric Problem Solving. - Daocheng Fu; Zijun Chen; Renqiu Xia; Qi Liu; Yuan Feng 001; Hongbin Zhou; Renrui Zhang; Shiyang Feng; Peng Gao 007; Junchi Yan; Botian Shi; Bo Zhang 069; et al. (CoRR, 2025)

From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuning. - Le Zhuo; Liangbing Zhao; Sayak Paul; Yue Liao; Renrui Zhang; Yi Xin 003; Peng Gao 007; Mohamed Elhoseiny; Hongsheng Li 001 (CoRR, 2025)

T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT. - Dongzhi Jiang; Ziyu Guo; Renrui Zhang; Zhuofan Zong; Hao Li 069; Le Zhuo; Shilin Yan; Pheng-Ann Heng; Hongsheng Li 001 (CoRR, 2025)

UniCTokens: Boosting Personalized Understanding and Generation via Unified Concept Tokens. - Ruichuan An; Sihan Yang; Renrui Zhang; Zijun Shen; Ming Lu; Gaole Dai; Hao Liang; Ziyu Guo; Shilin Yan; Yulin Luo; Bocheng Zou; Chaoqun Yang; et al. (CoRR, 2025)

Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPO. - Chengzhuo Tong; Ziyu Guo; Renrui Zhang; Wenyu Shan; Xinyu Wei; Zhenghao Xing; Hongsheng Li 001; Pheng-Ann Heng (CoRR, 2025)

Adaptive Classifier-Free Guidance via Dynamic Low-Confidence Masking. - Pengxiang Li; Shilin Yan; Joey Tsai; Renrui Zhang; Ruichuan An; Ziyu Guo; Xiaowei Gao (CoRR, 2025)

MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs. - Jiakang Yuan; Tianshuo Peng; Yilei Jiang; Yiting Lu; Renrui Zhang; Kaituo Feng; Chaoyou Fu; Tao Chen 003; Lei Bai 001; Bo Zhang 069; Xiangyu Yue 001 (CoRR, 2025)

Fast-in-Slow: A Dual-System Foundation Model Unifying Fast Manipulation within Slow Reasoning. - Hao Chen 011; Jiaming Liu 003; Chenyang Gu; Zhuoyang Liu; Renrui Zhang; Xiaoqi Li 020; Xiao He; Yandong Guo; Chi-Wing Fu; Shanghang Zhang; Pheng-Ann Heng (CoRR, 2025)

Perceive Anything: Recognize, Explain, Caption, and Segment Anything in Images and Videos. - Weifeng Lin; Xinyu Wei; Ruichuan An; Tianhe Ren; Tingwei Chen; Renrui Zhang; Ziyu Guo; Wentao Zhang 001; Lei Zhang 006; Hongsheng Li 001 (CoRR, 2025)

MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning. - Xinyan Chen; Renrui Zhang; Dongzhi Jiang; Aojun Zhou; Shilin Yan; Weifeng Lin; Hongsheng Li 001 (CoRR, 2025)

AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulation. - Sixiang Chen; Jiaming Liu 003; Siyuan Qian; Han Jiang 003; Lily Li; Renrui Zhang; Zhuoyang Liu; Chenyang Gu; Chengkai Hou; Pengwei Wang 004; Zhongyuan Wang 006; Shanghang Zhang (CoRR, 2025)

Lumina-mGPT 2.0: Stand-Alone AutoRegressive Image Modeling. - Yi Xin 003; Juncheng Yan; Qi Qin; Zhen Li 026; Dongyang Liu; Shicheng Li; Victor Shea-Jay Huang; Yupeng Zhou; Renrui Zhang; Le Zhuo; Tiancheng Han; Xiaoqing Sun; et al. (CoRR, 2025)

MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Models. - Fan Zhang; Zebang Cheng; Chong Deng; Haoxuan Li; Zheng Lian; Qian Chen; Huadai Liu; Wen Wang; Yifan Zhang 004; Renrui Zhang; Ziyu Guo; Zhihong Zhu; et al. (CoRR, 2025)

Quantization Meets dLLMs: A Systematic Study of Post-training Quantization for Diffusion LLMs. - Haokun Lin; Haobo Xu; Yichen Wu; Ziyu Guo; Renrui Zhang; Zhichao Lu; Ying Wei 001; Qingfu Zhang 001; Zhenan Sun (CoRR, 2025)