Chaoyou Fu

According to our database, Chaoyou Fu authored at least 62 papers between 2017 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Thyme: Think Beyond Images.

Yifan Zhang, Xingyu Lu, Shukang Yin, Chaoyou Fu, Wei Chen, Xiao Hu, Bin Wen, Kaiyu Jiang, Changyi Liu, Tianke Zhang, Haonan Fan, Kaibing Chen, Jiankang Chen, Haojie Ding, Kaiyu Tang, Zhang Zhang, Liang Wang, Fan Yang, Tingting Gao, Guorui Zhou

CoRR, August, 2025

Zooming from Context to Cue: Hierarchical Preference Optimization for Multi-Image MLLMs.

Xudong Li, Mengdan Zhang, Peixian Chen, Xiawu Zheng, Yan Zhang, Jingyuan Zheng, Yunhang Shen, Ke Li, Chaoyou Fu, Xin Sun, Rongrong Ji

CoRR, May, 2025

MME-VideoOCR: Evaluating OCR-Based Capabilities of Multimodal LLMs in Video Scenarios.

Yang Shi, Huanqian Wang, Wulin Xie, Huanyao Zhang, Lijie Zhao, Yifan Zhang, Xinfeng Li, Chaoyou Fu, Zhuoer Wen, Wenting Liu, Zhuoran Zhang, Xinlong Chen, Bohan Zeng, Sihan Yang, Yuanxing Zhang, Pengfei Wan, Haotian Wang, Wenjing Yang

CoRR, May, 2025

MME-Reasoning: A Comprehensive Benchmark for Logical Reasoning in MLLMs.

Jiakang Yuan, Tianshuo Peng, Yilei Jiang, Yiting Lu, Renrui Zhang, Kaituo Feng, Chaoyou Fu, Tao Chen, Lei Bai, Bo Zhang, Xiangyu Yue

CoRR, May, 2025

VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model.

Zuwei Long, Yunhang Shen, Chaoyou Fu, Heting Gao, Lijiang Li, Peixian Chen, Mengdan Zhang, Hang Shao, Jian Li, Jinlong Peng, Haoyu Cao, Ke Li, Rongrong Ji, Xing Sun

CoRR, May, 2025

R1-Reward: Training Multimodal Reward Model Through Stable Reinforcement Learning.

Yifan Zhang, Xingyu Lu, Xiao Hu, Chaoyou Fu, Bin Wen, Tianke Zhang, Changyi Liu, Kaiyu Jiang, Kaibing Chen, Kaiyu Tang, Haojie Ding, Jiankang Chen, Fan Yang, Zhang Zhang, Tingting Gao, Liang Wang

CoRR, May, 2025

MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models.

Wulin Xie, Yifan Zhang, Chaoyou Fu, Yang Shi, Bingyan Nie, Hongkai Chen, Zhang Zhang, Liang Wang, Tieniu Tan

CoRR, April, 2025

Aligning Multimodal LLM with Human Preference: A Survey.

Tao Yu, Yifan Zhang, Chaoyou Fu, Junkang Wu, Jinda Lu, Kun Wang, Xingyu Lu, Yunhang Shen, Guibin Zhang, Dingjie Song, Yibo Yan, Tianlong Xu, Qingsong Wen, Zhang Zhang, Yan Huang, Liang Wang, Tieniu Tan

CoRR, March, 2025

QuoTA: Query-oriented Token Assignment via CoT Query Decouple for Long Video Comprehension.

Yongdong Luo, Wang Chen, Xiawu Zheng, Weizhong Huang, Shukang Yin, Haojia Lin, Chaoyou Fu, Jinfa Huang, Jiayi Ji, Jiebo Luo, Rongrong Ji

CoRR, March, 2025

MM-RLHF: The Next Step Forward in Multimodal LLM Alignment.

Yifan Zhang, Tao Yu, Haochen Tian, Chaoyou Fu, Peiyan Li, Jianshu Zeng, Wulin Xie, Yang Shi, Huanyu Zhang, Junkang Wu, Xue Wang, Yibo Hu, Bin Wen, Fan Yang, Zhang Zhang, Tingting Gao, Di Zhang, Liang Wang, Rong Jin, Tieniu Tan

CoRR, February, 2025

MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency.

Dongzhi Jiang, Renrui Zhang, Ziyu Guo, Yanwei Li, Yu Qi, Xinyan Chen, Liuhui Wang, Jianhan Jin, Claire Guo, Shen Yan, Bo Zhang, Chaoyou Fu, Peng Gao, Hongsheng Li

CoRR, February, 2025

Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy.

Yunhang Shen, Chaoyou Fu, Shaoqi Dong, Xiong Wang, Yifan Zhang, Peixian Chen, Mengdan Zhang, Haoyu Cao, Ke Li, Xiawu Zheng, Yan Zhang, Yiyi Zhou, Ran He, Caifeng Shan, Rongrong Ji, Xing Sun

CoRR, February, 2025

LUCY: Linguistic Understanding and Control Yielding Early Stage of Her.

Heting Gao, Hang Shao, Xiong Wang, Chaofan Qiu, Yunhang Shen, Siqi Cai, Yuchen Shi, Zihan Xu, Zuwei Long, Yike Zhang, Shaoqi Dong, Chaoyou Fu, Ke Li, Long Ma, Xing Sun

CoRR, January, 2025

VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction.

Chaoyou Fu, Haojia Lin, Xiong Wang, Yifan Zhang, Yunhang Shen, Xiaoyu Liu, Haoyu Cao, Zuwei Long, Heting Gao, Ke Li, Long Ma, Xiawu Zheng, Rongrong Ji, Xing Sun, Caifeng Shan, Ran He

CoRR, January, 2025

Learning Interleaved Image-Text Comprehension in Vision-Language Large Models.

Chenyu Zhou, Mengdan Zhang, Peixian Chen, Chaoyou Fu, Yunhang Shen, Xiawu Zheng, Xing Sun, Rongrong Ji

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?

Yifan Zhang, Huanyu Zhang, Haochen Tian, Chaoyou Fu, Shuangqing Zhang, Junfei Wu, Feng Li, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis.

Chaoyou Fu, Yuhan Dai, Yongdong Luo, Lei Li, Shuhuai Ren, Renrui Zhang, Zihan Wang, Chenyu Zhou, Yunhang Shen, Mengdan Zhang, Peixian Chen, Yanwei Li, Shaohui Lin, Sirui Zhao, Ke Li, Tong Xu, Xiawu Zheng, Enhong Chen, Caifeng Shan, Ran He, Xing Sun

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Caption.

Tiehan Fan, Kepan Nan, Rui Xie, Penghao Zhou, Zhenheng Yang, Chaoyou Fu, Xiang Li, Jian Yang, Ying Tai

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

2024

Dynamic Graph Memory Bank for Video Inpainting.

Xiaoqiang Zhou, Chaoyou Fu, Huaibo Huang, Ran He

IEEE Trans. Circuits Syst. Video Technol., November, 2024

InstanceCap: Improving Text-to-Video Generation via Instance-aware Structured Caption.

Tiehan Fan, Kepan Nan, Rui Xie, Penghao Zhou, Zhenheng Yang, Chaoyou Fu, Xiang Li, Jian Yang, Ying Tai

CoRR, 2024

T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs.

Shukang Yin, Chaoyou Fu, Sirui Zhao, Yunhang Shen, Chunjiang Ge, Yan Yang, Zuwei Long, Yuhan Dai, Tong Xu, Xing Sun, Ran He, Caifeng Shan, Enhong Chen

CoRR, 2024

MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMs.

Chaoyou Fu, Yifan Zhang, Shukang Yin, Bo Li, Xinyu Fang, Sirui Zhao, Haodong Duan, Xing Sun, Ziwei Liu, Liang Wang, Caifeng Shan, Ran He

CoRR, 2024

MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning.

Ziliang Gan, Yu Lu, Dong Zhang, Haohan Li, Che Liu, Jian Liu, Ji Liu, Haipang Wu, Chaoyou Fu, Zenglin Xu, Rongjunchen Zhang, Yong Dai

CoRR, 2024

Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM.

Xiong Wang, Yangze Li, Chaoyou Fu, Yunhang Shen, Lei Xie, Ke Li, Xing Sun, Long Ma

CoRR, 2024

MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?

Yifan Zhang, Huanyu Zhang, Haochen Tian, Chaoyou Fu, Shuangqing Zhang, Junfei Wu, Feng Li, Kun Wang, Qingsong Wen, Zhang Zhang, Liang Wang, Rong Jin, Tieniu Tan

CoRR, 2024

VITA: Towards Open-Source Interactive Omni Multimodal LLM.

Chaoyou Fu, Haojia Lin, Zuwei Long, Yunhang Shen, Meng Zhao, Yifan Zhang, Xiong Wang, Di Yin, Long Ma, Xiawu Zheng, Ran He, Rongrong Ji, Yunsheng Wu, Caifeng Shan, Xing Sun

CoRR, 2024

VEGA: Learning Interleaved Image-Text Comprehension in Vision-Language Large Models.

Chenyu Zhou, Mengdan Zhang, Peixian Chen, Chaoyou Fu, Yunhang Shen, Xiawu Zheng, Xing Sun, Rongrong Ji

CoRR, 2024

Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models.

Yifan Zhang, Qingsong Wen, Chaoyou Fu, Xue Wang, Zhang Zhang, Liang Wang, Rong Jin

CoRR, 2024

Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis.

Chaoyou Fu, Yuhan Dai, Yondong Luo, Lei Li, Shuhuai Ren, Renrui Zhang, Zihan Wang, Chenyu Zhou, Yunhang Shen, Mengdan Zhang, Peixian Chen, Yanwei Li, Shaohui Lin, Sirui Zhao, Ke Li, Tong Xu, Xiawu Zheng, Enhong Chen, Rongrong Ji, Xing Sun

CoRR, 2024

Woodpecker: hallucination correction for multimodal large language models.

Shukang Yin, Chaoyou Fu, Sirui Zhao, Tong Xu, Hao Wang, Dianbo Sui, Yunhang Shen, Ke Li, Xing Sun, Enhong Chen

Sci. China Inf. Sci., 2024

Cantor: Inspiring Multimodal Chain-of-Thought of MLLM.

Timin Gao, Peixian Chen, Mengdan Zhang, Chaoyou Fu, Yunhang Shen, Yan Zhang, Shengchuan Zhang, Xiawu Zheng, Xing Sun, Liujuan Cao, Rongrong Ji

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

TGMAE: Self-supervised Micro-Expression Recognition with Temporal Gaussian Masked Autoencoder.

Shifeng Liu, Xinglong Mao, Sirui Zhao, Chaoyou Fu, Ying Yu, Tong Xu, Enhong Chen

Proceedings of the IEEE International Conference on Multimedia and Expo, 2024

No Time to Train: Empowering Non-Parametric Networks for Few-Shot 3D Scene Segmentation.

Xiangyang Zhu, Renrui Zhang, Bowei He, Ziyu Guo, Jiaming Liu, Han Xiao, Chaoyou Fu, Hao Dong, Peng Gao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Aligning and Prompting Everything All at Once for Universal Visual Perception.

Yunhang Shen, Chaoyou Fu, Peixian Chen, Mengdan Zhang, Ke Li, Xing Sun, Yunsheng Wu, Shaohui Lin, Rongrong Ji

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

Towards Lightweight Pixel-Wise Hallucination for Heterogeneous Face Recognition.

Chaoyou Fu, Xiaoqiang Zhou, Weizan He, Ran He

IEEE Trans. Pattern Anal. Mach. Intell., July, 2023

Audio-Driven Dubbing for User Generated Contents via Style-Aware Semi-Parametric Synthesis.

Linsen Song, Wayne Wu, Chaoyou Fu, Chen Change Loy, Ran He

IEEE Trans. Circuits Syst. Video Technol., March, 2023

Iterative embedding distillation for open world vehicle recognition.

Junxian Duan, Xiang Wu, Yibo Hu, Chaoyou Fu, Zi Wang, Ran He

Pattern Recognit., 2023

A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise.

Chaoyou Fu, Renrui Zhang, Zihan Wang, Yubo Huang, Zhengye Zhang, Longtian Qiu, Gaoxiang Ye, Yunhang Shen, Mengdan Zhang, Peixian Chen, Sirui Zhao, Shaohui Lin, Deqiang Jiang, Di Yin, Peng Gao, Ke Li, Hongsheng Li, Xing Sun

CoRR, 2023

ChatIllusion: Efficient-Aligning Interleaved Generation ability with Visual Instruction Model.

Xiaowei Chi, Yijiang Liu, Zhengkai Jiang, Rongyu Zhang, Ziyi Lin, Renrui Zhang, Peng Gao, Chaoyou Fu, Shanghang Zhang, Qifeng Liu, Yike Guo

CoRR, 2023

A Survey on Multimodal Large Language Models.

Shukang Yin, Chaoyou Fu, Sirui Zhao, Ke Li, Xing Sun, Tong Xu, Enhong Chen

CoRR, 2023

MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models.

Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Xu Lin, Zhenyu Qiu, Wei Lin, Jinrui Yang, Xiawu Zheng, Ke Li, Xing Sun, Rongrong Ji

CoRR, 2023

CAPro: Webly Supervised Learning with Cross-modality Aligned Prototypes.

Yulei Qin, Xingyu Chen, Yunhang Shen, Chaoyou Fu, Yun Gu, Ke Li, Xing Sun, Rongrong Ji

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Multi-modal Queried Object Detection in the Wild.

Yifan Xu, Mengdan Zhang, Chaoyou Fu, Peixian Chen, Xiaoshan Yang, Ke Li, Changsheng Xu

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Heterogeneous Face Recognition via Face Synthesis With Identity-Attribute Disentanglement.

Ziming Yang, Jian Liang, Chaoyou Fu, Mandi Luo, Xiaoyu Zhang

IEEE Trans. Inf. Forensics Secur., 2022

Deep momentum uncertainty hashing.

Chaoyou Fu, Guoli Wang, Xiang Wu, Qian Zhang, Ran He

Pattern Recognit., 2022

DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition.

Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, Ran He

IEEE Trans. Pattern Anal. Mach. Intell., 2022

Rethinking Image Cropping: Exploring Diverse Compositions from Global Views.

Gengyun Jia, Huaibo Huang, Chaoyou Fu, Ran He

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

High-Fidelity Face Manipulation With Extreme Poses and Expressions.

Chaoyou Fu, Yibo Hu, Xiang Wu, Guoli Wang, Qian Zhang, Ran He

IEEE Trans. Inf. Forensics Secur., 2021

Learning Causal Representation for Face Transfer across Large Appearance Gap.

Gege Gao, Huaibo Huang, Chaoyou Fu, Ran He

CoRR, 2021

Everything's Talkin': Pareidolia Face Reenactment.

Linsen Song, Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, Ran He

CoRR, 2021

CM-NAS: Rethinking Cross-Modality Neural Architectures for Visible-Infrared Person Re-Identification.

Chaoyou Fu, Yibo Hu, Xiang Wu, Hailin Shi, Tao Mei, Ran He

CoRR, 2021

CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification.

Chaoyou Fu, Yibo Hu, Xiang Wu, Hailin Shi, Tao Mei, Ran He

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

Self-Augmented Heterogeneous Face Recognition.

Zongcai Sun, Chaoyou Fu, Mandi Luo, Ran He

Proceedings of the International IEEE Joint Conference on Biometrics, 2021

Pareidolia Face Reenactment.

Linsen Song, Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, Ran He

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Information Bottleneck Disentanglement for Identity Swapping.

Gege Gao, Huaibo Huang, Chaoyou Fu, Zhaoyang Li, Ran He

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

AOT: Appearance Optimal Transport Based Identity Swapping for Forgery Detection.

Hao Zhu, Chaoyou Fu, Qianyi Wu, Wayne Wu, Chen Qian, Ran He

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Cross-Spectral Face Hallucination via Disentangling Independent Factors.

Boyan Duan, Chaoyou Fu, Yi Li, Xingguang Song, Ran He

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

Pose Agnostic Cross-spectral Hallucination via Disentangling Independent Factors.

Boyan Duan, Chaoyou Fu, Yi Li, Xingguang Song, Ran He

CoRR, 2019

High Fidelity Face Manipulation with Extreme Pose and Expression.

Chaoyou Fu, Yibo Hu, Xiang Wu, Guoli Wang, Qian Zhang, Ran He

CoRR, 2019

Dual Variational Generation for Low Shot Heterogeneous Face Recognition.

Chaoyou Fu, Xiang Wu, Yibo Hu, Huaibo Huang, Ran He

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Neurons Merging Layer: Towards Progressive Redundancy Reduction for Deep Supervised Hashing.

Chaoyou Fu, Liangchen Song, Xiang Wu, Guoli Wang, Ran He

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, 2019

2017

Global Perception Feedback Convolutional Neural Networks.

Chaoyou Fu, Xiang Wu, Jing Dong, Ran He

Proceedings of the Advances in Image and Graphics Technologies - 12th Chinese conference, 2017