Difei Gao

According to our database, Difei Gao authored at least 56 papers between 2015 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

ShowUI-Aloha: Human-Taught GUI Agent.

Yichun Zhang, Xiangwu Guo, Yauhong Goh, Jessica Hu, Zhiheng Chen, Xin Wang, Difei Gao, Mike Zheng Shou

CoRR, January, 2026

2025

AUTO-Explorer: Automated Data Collection for GUI Agent.

Xiangwu Guo, Difei Gao, Mike Zheng Shou

CoRR, November, 2025

Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation.

David Junhao Zhang, Jay Zhangjie Wu, Jia-Wei Liu, Rui Zhao, Lingmin Ran, Yuchao Gu, Difei Gao, Mike Zheng Shou

Int. J. Comput. Vis., April, 2025

EmoAgent: Multi-Agent Collaboration of Plan, Edit, and Critic, for Affective Image Manipulation.

Qi Mao, Haobo Hu, Yujie He, Difei Gao, Haokun Chen, Libiao Jin

CoRR, March, 2025

WorldGUI: Dynamic Testing for Comprehensive Desktop GUI Automation.

Henry Hengyuan Zhao, Difei Gao, Mike Zheng Shou

CoRR, February, 2025

HOVER: Hyperbolic Video-Text Retrieval.

Jun Wen, Yufeng Chen, Ruiqi Shi, Wei Ji, Menglin Yang, Difei Gao, Junsong Yuan, Roger Zimmermann

IEEE Trans. Image Process., 2025

GUI-Narrator: Detecting and Captioning Computer GUI Actions.

Qinchen Wu, Difei Gao, Qinghong Lin, Zhuoyu Wu, Mike Zheng Shou

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

Can I Trust You? Advancing GUI Task Automation with Action Trust Score.

Haiyang Mei, Difei Gao, Xiaopeng Wei, Xin Yang, Mike Zheng Shou

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

Grounding Multimodal Large Language Model in GUI World.

Weixian Lei, Difei Gao, Mike Zheng Shou

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Factorized Learning for Temporally Grounded Video-Language Models.

Wenzheng Zeng, Difei Gao, Mike Zheng Shou, Hwee Tou Ng

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

ShowUI: One Vision-Language-Action Model for GUI Visual Agent.

Kevin Qinghong Lin, Linjie Li, Difei Gao, Zhengyuan Yang, Shiwei Wu, Zechen Bai, Stan Weixian Lei, Lijuan Wang, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

2024

Event Graph Guided Compositional Spatial-Temporal Reasoning for Video Question Answering.

Ziyi Bai, Ruiping Wang, Difei Gao, Xilin Chen

IEEE Trans. Image Process., 2024

ShowUI: One Vision-Language-Action Model for GUI Visual Agent.

Kevin Qinghong Lin, Linjie Li, Difei Gao, Zhengyuan Yang, Shiwei Wu, Zechen Bai, Weixian Lei, Lijuan Wang, Mike Zheng Shou

CoRR, 2024

The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Use.

Siyuan Hu, Mingyu Ouyang, Difei Gao, Mike Zheng Shou

CoRR, 2024

GUI Action Narrator: Where and When Did That Action Take Place?

Qinchen Wu, Difei Gao, Kevin Qinghong Lin, Zhuoyu Wu, Xiangwu Guo, Peiran Li, Weichen Zhang, Hengxu Wang, Mike Zheng Shou

CoRR, 2024

LOVA3: Learning to Visual Question Answering, Asking and Assessment.

Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Mike Zheng Shou

CoRR, 2024

LOVA3: Learning to Visual Question Answering, Asking and Assessment.

Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Zechen Bai, Mike Zheng Shou

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

VideoGUI: A Benchmark for GUI Automation from Instructional Videos.

Kevin Qinghong Lin, Linjie Li, Difei Gao, Qinchen Wu, Mingyi Yan, Zhengyuan Yang, Lijuan Wang, Mike Zheng Shou

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

AssistEditor: Multi-Agent Collaboration for GUI Workflow Automation in Video Creation.

Difei Gao, Siyuan Hu, Zechen Bai, Qinghong Lin, Mike Zheng Shou

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Delocate: Detection and Localization for Deepfake Videos with Randomly-Located Tampered Traces.

Juan Hu, Xin Liao, Difei Gao, Satoshi Tsutsui, Qian Wang, Zheng Qin, Mike Zheng Shou

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024

AssistGPT: Towards Multi-modal Agent for Human-Centric AI Assistant.

Difei Gao, Siyuan Hu, Qinghong Lin, Mike Zheng Shou

Proceedings of the 5th International Workshop on Human-centric Multimedia Analysis, 2024

Learning Video Context as Interleaved Multimodal Sequences.

Kevin Qinghong Lin, Pengchuan Zhang, Difei Gao, Xide Xia, Joya Chen, Ziteng Gao, Jinheng Xie, Xuhong Xiao, Mike Zheng Shou

Proceedings of the Computer Vision - ECCV 2024, 2024

VIT-LENS: Towards Omni-modal Representations.

Weixian Lei, Yixiao Ge, Kun Yi, Jianfeng Zhang, Difei Gao, Dylan Sun, Yuying Ge, Ying Shan, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

AssistGUI: Task-Oriented PC Graphical User Interface Automation.

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

VideoLLM-online: Online Video Large Language Model for Streaming Video.

Joya Chen, Zhaoyang Lv, Shiwei Wu, Kevin Qinghong Lin, Chenan Song, Difei Gao, Jia-Wei Liu, Ziteng Gao, Dongxing Mao, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

CRIC: A VQA Dataset for Compositional Reasoning on Vision and Commonsense.

Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen

IEEE Trans. Pattern Anal. Mach. Intell., May, 2023

ASSISTGUI: Task-Oriented Desktop Graphical User Interface Automation.

Difei Gao, Lei Ji, Zechen Bai, Mingyu Ouyang, Peiran Li, Dongxing Mao, Qinchen Wu, Weichen Zhang, Peiyi Wang, Xiangwu Guo, Hengxu Wang, Luowei Zhou, Mike Zheng Shou

CoRR, 2023

ViT-Lens-2: Gateway to Omni-modal Intelligence.

Weixian Lei, Yixiao Ge, Kun Yi, Jianfeng Zhang, Difei Gao, Dylan Sun, Yuying Ge, Ying Shan, Mike Zheng Shou

CoRR, 2023

CVPR 2023 Text Guided Video Editing Competition.

Jay Zhangjie Wu, Xiuyu Li, Difei Gao, Zhen Dong, Jinbin Bai, Aishani Singh, Xiaoyu Xiang, Youzeng Li, Zuwei Huang, Yuanxi Sun, Rui He, Feng Hu, Junhua Hu, Hai Huang, Hanyu Zhu, Xu Cheng, Jie Tang, Mike Zheng Shou, Kurt Keutzer, Forrest N. Iandola

CoRR, 2023

Recap: Detecting Deepfake Video with Unpredictable Tampered Traces via Recovering Faces and Mapping Recovered Faces.

Juan Hu, Xin Liao, Difei Gao, Satoshi Tsutsui, Qian Wang, Zheng Qin, Mike Zheng Shou

CoRR, 2023

GroundNLQ @ Ego4D Natural Language Queries Challenge 2023.

Zhijian Hou, Lei Ji, Difei Gao, Wanjun Zhong, Kun Yan, Chao Li, Wing-Kwong Chan, Chong-Wah Ngo, Nan Duan, Mike Zheng Shou

CoRR, 2023

AssistGPT: A General Multi-modal Assistant that can Plan, Execute, Inspect, and Learn.

Difei Gao, Lei Ji, Luowei Zhou, Kevin Qinghong Lin, Joya Chen, Zihan Fan, Mike Zheng Shou

CoRR, 2023

Mover: Mask and Recovery based Facial Part Consistency Aware Method for Deepfake Video Detection.

Juan Hu, Xin Liao, Difei Gao, Satoshi Tsutsui, Qian Wang, Zheng Qin, Mike Zheng Shou

CoRR, 2023

DeepfakeMAE: Facial Part Consistency Aware Masked Autoencoder for Deepfake Video Detection.

Juan Hu, Xin Liao, Difei Gao, Satoshi Tsutsui, Zheng Qin, Mike Zheng Shou

CoRR, 2023

Learning to Learn: How to Continuously Teach Humans and Machines.

Parantak Singh, You Li, Ankur Sikarwar, Weixian Lei, Difei Gao, Morgan B. Talbot, Ying Sun, Mike Zheng Shou, Gabriel Kreiman, Mengmi Zhang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

UniVTG: Towards Unified Video-Language Temporal Grounding.

Kevin Qinghong Lin, Pengchuan Zhang, Joya Chen, Shraman Pramanick, Difei Gao, Alex Jinpeng Wang, Rui Yan, Mike Zheng Shou

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

GazeVQA: A Video Question Answering Dataset for Multiview Eye-Gaze Task-Oriented Collaborations.

Muhammet Furkan Ilaslan, Chenan Song, Joya Chen, Difei Gao, Weixian Lei, Qianli Xu, Joo Lim, Mike Zheng Shou

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

MIST : Multi-modal Iterative Spatial-Temporal Transformer for Long-form Video Question Answering.

Difei Gao, Luowei Zhou, Lei Ji, Linchao Zhu, Yi Yang, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

Affordance Grounding from Demonstration Video to Target Image.

Joya Chen, Difei Gao, Kevin Qinghong Lin, Mike Zheng Shou

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023

CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding.

Zhijian Hou, Wanjun Zhong, Lei Ji, Difei Gao, Kun Yan, Wing Kwong Chan, Chong-Wah Ngo, Mike Zheng Shou, Nan Duan

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task.

Stan Weixian Lei, Difei Gao, Jay Zhangjie Wu, Yuxuan Wang, Wei Liu, Mengmi Zhang, Mike Zheng Shou

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

An Efficient COarse-to-fiNE Alignment Framework @ Ego4D Natural Language Queries Challenge 2022.

Zhijian Hou, Wanjun Zhong, Lei Ji, Difei Gao, Kun Yan, Wing Kwong Chan, Chong-Wah Ngo, Zheng Shou, Nan Duan

CoRR, 2022

Egocentric Video-Language Pretraining @ Ego4D Challenge 2022.

Kevin Qinghong Lin, Alex Jinpeng Wang, Mattia Soldan, Michael Wray, Rui Yan, Eric Zhongcong Xu, Difei Gao, Rong-Cheng Tu, Wenzhe Zhao, Weijie Kong, Chengfei Cai, Hongfa Wang, Dima Damen, Bernard Ghanem, Wei Liu, Mike Zheng Shou

CoRR, 2022

Egocentric Video-Language Pretraining.

Kevin Qinghong Lin, Alex Jinpeng Wang, Mattia Soldan, Michael Wray, Rui Yan, Eric Zhongcong Xu, Difei Gao, Rong-Cheng Tu, Wenzhe Zhao, Weijie Kong, Chengfei Cai, Hongfa Wang, Dima Damen, Bernard Ghanem, Wei Liu, Mike Zheng Shou

CoRR, 2022

GEB+: A benchmark for generic event boundary captioning, grounding and text-based retrieval.

Yuxuan Wang, Difei Gao, Licheng Yu, Stan Weixian Lei, Matt Feiszli, Mike Zheng Shou

CoRR, 2022

Egocentric Video-Language Pretraining.

Kevin Qinghong Lin, Jinpeng Wang, Mattia Soldan, Michael Wray, Rui Yan, Eric Zhongcong Xu, Difei Gao, Rong-Cheng Tu, Wenzhe Zhao, Weijie Kong, Chengfei Cai, Hongfa Wang, Dima Damen, Bernard Ghanem, Wei Liu, Mike Zheng Shou

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistant.

Weixian Lei, Difei Gao, Yuxuan Wang, Dongxing Mao, Zihan Liang, Lingmin Ran, Mike Zheng Shou

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

AssistQ: Affordance-Centric Question-Driven Task Completion for Egocentric Assistant.

Benita Wong, Joya Chen, You Wu, Stan Weixian Lei, Dongxing Mao, Difei Gao, Mike Zheng Shou

Proceedings of the Computer Vision - ECCV 2022, 2022

GEB+: A Benchmark for Generic Event Boundary Captioning, Grounding and Retrieval.

Yuxuan Wang, Difei Gao, Licheng Yu, Weixian Lei, Matt Feiszli, Mike Zheng Shou

Proceedings of the Computer Vision - ECCV 2022, 2022

2021

AssistSR: Affordance-centric Question-driven Video Segment Retrieval.

Stan Weixian Lei, Yuxuan Wang, Dongxing Mao, Difei Gao, Mike Zheng Shou

CoRR, 2021

Env-QA: A Video Question Answering Benchmark for Comprehensive Understanding of Dynamic Environments.

Difei Gao, Ruiping Wang, Ziyi Bai, Xilin Chen

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

2020

Learning to Recognize Visual Concepts for Visual Question Answering With Structural Label Space.

Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen

IEEE J. Sel. Top. Signal Process., 2020

Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text.

Difei Gao, Ke Li, Ruiping Wang, Shiguang Shan, Xilin Chen

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2019

From Two Graphs to N Questions: A VQA Dataset for Compositional Reasoning on Vision and Commonsense.

Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen

CoRR, 2019

2017

Visual Textbook Network: Watch Carefully before Answering Visual Questions.

Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen

Proceedings of the British Machine Vision Conference 2017, 2017

2015

Correlated warped Gaussian processes for gender-specific age estimation.

Difei Gao, Lili Pan, Risheng Liu, Rui Chen, Mei Xie

Proceedings of the 2015 IEEE International Conference on Image Processing, 2015