Pengfei Wan

According to our database, Pengfei Wan authored at least 209 papers between 2012 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

DecMem: Towards Minute-Long Consistent World Generation with Decoupled Memory.

Zhenhao Yang, Xiaoshi Wu, Zhengyao Lv, Xiaoyu Shi, Xintao Wang, Pengfei Wan, Kun Gai, Kwan-Yee K. Wong

CoRR, May, 2026

LatentOmni: Rethinking Omni-Modal Understanding via Unified Audio-Visual Latent Reasoning.

Yifan Dai, Zhenhua Wu, Bohan Zeng, Daili Hua, Jialing Liu, Bozhou Li, Yuran Wang, Chengzhuo Tong, Hao Liang, Xiaochen Ma, Junbo Niu, Tianyu Guo, Yang Shi, Yue Ding, Yiyan Ji, Bingyin Mei, Yushuo Guan, Yuanxing Zhang, Pengfei Wan, Fangcheng Fu, Wentao Zhang

CoRR, May, 2026

Artifact-Bench: Evaluating MLLMs on Detecting and Assessing the Artifacts of AI-Generated Videos.

Yuqi Tang, Yang Shi, Zhuoran Zhang, Qixun Wang, Xuehai Bai, Yue Ding, Ruizhe Chen, Bohan Zeng, Xinlong Chen, Xuanyu Zhu, Bozhou Li, Yuran Wang, Yifan Dai, Chengzhuo Tong, Xinyu Liu, Yiyan Ji, Yujie Wei, Yuhao Dong, Shilin Yan, Fengxiang Wang, Yifan Zhang, Haotian Wang, Yuanxing Zhang, Pengfei Wan

CoRR, May, 2026

UniCustom: Unified Visual Conditioning for Multi-Reference Image Generation.

Yiyan Xu, Qiulin Wang, Wenjie Wang, Yunyao Mao, Xintao Wang, Pengfei Wan, Kun Gai, Fuli Feng

CoRR, May, 2026

Think, then Score: Decoupled Reasoning and Scoring for Video Reward Modeling.

Yuan Wang, Ouxiang Li, Yulong Xu, Borui Liao, Jiajun Liang, Jinghan Li, Meng Wang, Xintao Wang, Pengfei Wan, Kuien Liu, Xiang Wang

CoRR, May, 2026

Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning.

Zhicheng Zhang, Wentao Gu, Weicheng Wang, Yongjie Zhu, Wenyu Qin, Meng Wang, Pengfei Wan, Jufeng Yang

CoRR, April, 2026

LIVE: Leveraging Image Manipulation Priors for Instruction-based Video Editing.

Weicheng Wang, Zhicheng Zhang, Zhongqi Zhang, Juncheng Zhou, Yongjie Zhu, Wenyu Qin, Meng Wang, Pengfei Wan, Jufeng Yang

CoRR, April, 2026

OpenWorldLib: A Unified Codebase and Definition of Advanced World Models.

DataFlow Team, Bohan Zeng, Daili Hua, Kaixin Zhu, Yifan Dai, Bozhou Li, Yuran Wang, Chengzhuo Tong, Yifan Yang, Mingkun Chang, Jianbin Zhao, Zhou Liu, Hao Liang, Xiaochen Ma, Ruichuan An, Junbo Niu, Zimo Meng, Tianyi Bai, Meiyi Qiang, Huanyao Zhang, Zhiyou Xiao, Tianyu Guo, Qinhan Yu, Runhao Zhao, Zhengpin Li, Xinyi Huang, Yisheng Pan, Yiwen Tang, Yang Shi, Yue Ding, Xinlong Chen, Hongcheng Gao, Minglei Shi, Jialong Wu, Zekun Wang, Yuanxing Zhang, Xintao Wang, Pengfei Wan, Yiren Song, Mike Zheng Shou, Wentao Zhang

CoRR, April, 2026

ShotStream: Streaming Multi-Shot Video Generation for Interactive Storytelling.

Yawen Luo, Xiaoyu Shi, Junhao Zhuang, Yutian Chen, Quande Liu, Xintao Wang, Pengfei Wan, Tianfan Xue

CoRR, March, 2026

Out of Sight but Not Out of Mind: Hybrid Memory for Dynamic Video World Models.

Kaijin Chen, Dingkang Liang, Xin Zhou, Yikang Ding, Xiaoqiang Liu, Pengfei Wan, Xiang Bai

CoRR, March, 2026

Beyond the Golden Data: Resolving the Motion-Vision Quality Dilemma via Timestep Selective Training.

Xiangyang Luo, Qingyu Li, Yuming Li, Guanbo Huang, Yongjie Zhu, Wenyu Qin, Meng Wang, Pengfei Wan, Shao-Lun Huang

CoRR, March, 2026

Kling-MotionControl Technical Report.

Jialu Chen, Yikang Ding, Zhixue Fang, Kun Gai, Kang He, Xu He, Jingyun Hua, Mingming Lao, Xiaohan Li, Hui Liu, Jiwen Liu, Xiaoqiang Liu, Fan Shi, Xiaoyu Shi, Peiqin Sun, Songlin Tang, Pengfei Wan, Tiancheng Wen, Zhiyong Wu, Haoxian Zhang, Runze Zhao, Yuanxing Zhang, Yan Zhou

CoRR, March, 2026

Embed-RL: Reinforcement Learning for Reasoning-Driven Multimodal Embeddings.

Haonan Jiang, Yuji Wang, Yongjie Zhu, Xin Lu, Wenyu Qin, Meng Wang, Pengfei Wan, Yansong Tang

CoRR, February, 2026

TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions.

Linli Yao, Yuancheng Wei, Yaojie Zhang, Lei Li, Xinlong Chen, Feifan Song, Ziyue Wang, Kun Ouyang, Yuanxin Liu, Lingpeng Kong, Qi Liu, Pengfei Wan, Kun Gai, Yuanxing Zhang, Xu Sun

CoRR, February, 2026

IM-Animation: An Implicit Motion Representation for Identity-decoupled Character Animation.

Zhufeng Xu, Xuan Gao, Feng-Lin Liu, Haoxian Zhang, Zhixue Fang, Yu-Kun Lai, Xiaoqiang Liu, Pengfei Wan, Lin Gao

CoRR, February, 2026

CineScene: Implicit 3D as Effective Scene Representation for Cinematic Video Generation.

Kaiyi Huang, Yukun Huang, Yu Li, Jianhong Bai, Xintao Wang, Zinan Lin, Xuefei Ning, Jiwen Yu, Pengfei Wan, Yu Wang, Xihui Liu

CoRR, February, 2026

Stable Velocity: A Variance Perspective on Flow Matching.

Donglin Yang, Yongxing Zhang, Xin Yu, Liang Hou, Xin Tao, Pengfei Wan, Xiaojuan Qi, Renjie Liao

CoRR, February, 2026

OmniSIFT: Modality-Asymmetric Token Compression for Efficient Omni-modal Large Language Models.

Yue Ding, Yiyan Ji, Jungang Li, Xuyang Liu, Xinlong Chen, Junfei Wu, Bozhou Li, Bohan Zeng, Yang Shi, Yushuo Guan, Yuanxing Zhang, Jiaheng Liu, Qiang Liu, Pengfei Wan, Liang Wang

CoRR, February, 2026

3D-Aware Implicit Motion Control for View-Adaptive Human Video Generation.

Zhixue Fang, Xu He, Songlin Tang, Haoxian Zhang, Qingfeng Li, Xiaoqiang Liu, Pengfei Wan, Kun Gai

CoRR, February, 2026

Semantic Routing: Exploring Multi-Layer LLM Feature Weighting for Diffusion Transformers.

Bozhou Li, Yushuo Guan, Haolin Li, Bohan Zeng, Yiyan Ji, Yue Ding, Pengfei Wan, Kun Gai, Yuanxing Zhang, Wentao Zhang

CoRR, February, 2026

Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks.

Bohan Zeng, Kaixin Zhu, Daili Hua, Bozhou Li, Chengzhuo Tong, Yuran Wang, Xinyi Huang, Yifan Dai, Zixiang Zhang, Yifan Yang, Zhou Liu, Hao Liang, Xiaochen Ma, Ruichuan An, Tianyi Bai, Hongcheng Gao, Junbo Niu, Yang Shi, Xinlong Chen, Yue Ding, Minglei Shi, Kai Zeng, Yiwen Tang, Yuanxing Zhang, Pengfei Wan, Xintao Wang, Wentao Zhang

CoRR, February, 2026

DiaDem: Advancing Dialogue Descriptions in Audiovisual Video Captioning for Multimodal Large Language Models.

Xinlong Chen, Weihong Lin, Jingyun Hua, Linli Yao, Yue Ding, Bozhou Li, Bohan Zeng, Yang Shi, Qiang Liu, Yuanxing Zhang, Pengfei Wan, Liang Wang, Tieniu Tan

CoRR, January, 2026

A Mechanistic View on Video Generation as World Models: State and Dynamics.

Luozhou Wang, Zhifei Chen, Yihua Du, Dongyu Yan, Wenhang Ge, Guibao Shen, Xinli Xu, Leyi Wu, Man Chen, Tianshuo Xu, Peiran Ren, Xin Tao, Pengfei Wan, Ying-Cong Chen

CoRR, January, 2026

SALAD: Achieve High-Sparsity Attention via Efficient Linear Attention Tuning for Video Diffusion Transformer.

Tongcheng Fang, Hanling Zhang, Ruiqi Xie, Zhuo Han, Xin Tao, Tianchen Zhao, Pengfei Wan, Wenbo Ding, Wanli Ouyang, Xuefei Ning, Yu Wang

CoRR, January, 2026

CoF-T2I: Video Models as Pure Visual Reasoners for Text-to-Image Generation.

Chengzhuo Tong, Mingkun Chang, Shenglong Zhang, Yuran Wang, Cheng Liang, Zhizheng Zhao, Ruichuan An, Bohan Zeng, Yang Shi, Yifan Dai, Ziming Zhao, Guanbin Li, Pengfei Wan, Yuanxing Zhang, Wentao Zhang

CoRR, January, 2026

VINO: A Unified Visual Generator with Interleaved OmniModal Context.

Junyi Chen, Tong He, Zhoujie Fu, Pengfei Wan, Kun Gai, Weicai Ye

CoRR, January, 2026

FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusion.

Xiangyang Luo, Qingyu Li, Xiaokun Liu, Wenyu Qin, Miao Yang, Meng Wang, Pengfei Wan, Di Zhang, Kun Gai, Shao-Lun Huang

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

Bridging Cognitive Gap: Hierarchical Description Learning for Artistic Image Aesthetics Assessment.

Henglin Liu, Nisha Huang, Chang Liu, Jiangpeng Yan, Huijuan Huang, Jixuan Ying, Tong-Yee Lee, Pengfei Wan, Xiangyang Ji

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

Boosting Resolution Generalization of Diffusion Transformers with Randomized Positional Encodings.

Liang Hou, Cong Liu, Mingwu Zheng, Xin Tao, Pengfei Wan, Di Zhang, Kun Gai

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

2025

From Inpainting to Editing: A Self-Bootstrapping Framework for Context-Rich Visual Dubbing.

Xu He, Haoxian Zhang, Hejia Chen, Changyuan Zheng, Liyang Chen, Songlin Tang, Jiehui Huang, Xiaoqiang Liu, Pengfei Wan, Zhiyong Wu

CoRR, December, 2025

GARDO: Reinforcing Diffusion Models without Reward Hacking.

Haoran He, Yuxiao Ye, Jie Liu, Jiajun Liang, Zhiyong Wang, Ziyang Yuan, Xintao Wang, Hangyu Mao, Pengfei Wan, Ling Pan

CoRR, December, 2025

SemanticGen: Video Generation in Semantic Space.

Jianhong Bai, Xiaoshi Wu, Xintao Wang, Xiao Fu, Yuanxing Zhang, Qinghe Wang, Xiaoyu Shi, Menghan Xia, Zuozhu Liu, Haoji Hu, Pengfei Wan, Kun Gai

CoRR, December, 2025

Visual-Aware CoT: Achieving High-Fidelity Visual Consistency in Unified Models.

Zixuan Ye, Quande Liu, Cong Wei, Yuanxing Zhang, Xintao Wang, Pengfei Wan, Kun Gai, Wenhan Luo

CoRR, December, 2025

GRAN-TED: Generating Robust, Aligned, and Nuanced Text Embedding for Diffusion Models.

Bozhou Li, Sihan Yang, Yushuo Guan, Ruichuan An, Xinlong Chen, Yang Shi, Pengfei Wan, Wentao Zhang, Yuanxing Zhang

CoRR, December, 2025

MemFlow: Flowing Adaptive Memory for Consistent and Efficient Long Video Narratives.

Sihui Ji, Xi Chen, Shuai Yang, Xin Tao, Pengfei Wan, Hengshuang Zhao

CoRR, December, 2025

KlingAvatar 2.0 Technical Report.

Jialu Chen, Yikang Ding, Zhixue Fang, Kun Gai, Yuan Gao, Kang He, Jingyun Hua, Boyuan Jiang, Mingming Lao, Xiaohan Li, Hui Liu, Jiwen Liu, Xiaoqiang Liu, Yuan Liu, Shun Lu, Yongsen Mao, Yingchao Shao, Huafeng Shi, Xiaoyu Shi, Peiqin Sun, Songlin Tang, Pengfei Wan, Chao Wang, Xuebo Wang, Haoxian Zhang, Yuanxing Zhang, Yan Zhou

CoRR, December, 2025

SVG-T2I: Scaling Up Text-to-Image Latent Diffusion Model Without Variational Autoencoder.

Minglei Shi, Haolin Wang, Borui Zhang, Wenzhao Zheng, Bohan Zeng, Ziyang Yuan, Xiaoshi Wu, Yuanxing Zhang, Huan Yang, Xintao Wang, Pengfei Wan, Kun Gai, Jie Zhou, Jiwen Lu

CoRR, December, 2025

Astra: General Interactive World Model with Autoregressive Denoising.

Yixuan Zhu, Jiaqi Feng, Wenzhao Zheng, Yuan Gao, Xin Tao, Pengfei Wan, Jie Zhou, Jiwen Lu

CoRR, December, 2025

UnityVideo: Unified Multi-Modal Multi-Task Learning for Enhancing World-Aware Video Generation.

Jiehui Huang, Yuechen Zhang, Xu He, Yuan Gao, Zhi Cen, Bin Xia, Yan Zhou, Xin Tao, Pengfei Wan, Jiaya Jia

CoRR, December, 2025

MultiShotMaster: A Controllable Multi-Shot Video Generation Framework.

Qinghe Wang, Xiaoyu Shi, Baolu Li, Weikang Bian, Quande Liu, Huchuan Lu, Xintao Wang, Pengfei Wan, Kun Gai, Xu Jia

CoRR, December, 2025

Monet: Reasoning in Latent Visual Space Beyond Images and Language.

Qixun Wang, Yang Shi, Yifei Wang, Yuanxing Zhang, Pengfei Wan, Kun Gai, Xianghua Ying, Yisen Wang

CoRR, November, 2025

A Reason-then-Describe Instruction Interpreter for Controllable Video Generation.

Shengqiong Wu, Weicai Ye, Yuanxing Zhang, Jiahao Wang, Quande Liu, Xintao Wang, Pengfei Wan, Kun Gai, Hao Fei, Tat-Seng Chua

CoRR, November, 2025

Decoupling Complexity from Scale in Latent Diffusion Model.

Tianxiong Zhong, Xingye Tian, Xuebo Wang, Boyuan Jiang, Xin Tao, Pengfei Wan

CoRR, November, 2025

Simulating the Visual World with Artificial Intelligence: A Roadmap.

Jingtong Yue, Ziqi Huang, Zhaoxi Chen, Xintao Wang, Pengfei Wan, Ziwei Liu

CoRR, November, 2025

MVU-Eval: Towards Multi-Video Understanding Evaluation for Multimodal LLMs.

Tianhao Peng, Haochen Wang, Yuanxing Zhang, Zekun Wang, Zili Wang, Ge Zhang, Jian Yang, Shihao Li, Yanghai Wang, Xintao Wang, Houyi Li, Wei Ji, Pengfei Wan, Wenhao Huang, Zhaoxiang Zhang, Jiaheng Liu

CoRR, November, 2025

RelightMaster: Precise Video Relighting with Multi-plane Light Images.

Weikang Bian, Xiaoyu Shi, Zhaoyang Huang, Jianhong Bai, Qinghe Wang, Xintao Wang, Pengfei Wan, Kun Gai, Hongsheng Li

CoRR, November, 2025

MotionCrafter: Plug-and-Play Motion Guidance for Diffusion Models.

Yuxin Zhang, Weiming Dong, Fan Tang, Nisha Huang, Haibin Huang, Chongyang Ma, Pengfei Wan, Tong-Yee Lee, Changsheng Xu

IEEE Trans. Vis. Comput. Graph., October, 2025

NeRFFaceShop: Learning a Photo-Realistic 3D-Aware Generative Model of Animatable and Relightable Heads From Large-Scale in-the-Wild Videos.

Kaiwen Jiang, Feng-Lin Liu, Shu-Yu Chen, Pengfei Wan, Yuan Zhang, Yu-Kun Lai, Hongbo Fu, Lin Gao

IEEE Trans. Vis. Comput. Graph., October, 2025

A-SDM: Accelerating Stable Diffusion Through Model Assembly and Feature Inheritance Strategies.

Jinchao Zhu, Yuxuan Wang, Siyuan Pan, Pengfei Wan, Di Zhang, Gao Huang

IEEE Trans. Neural Networks Learn. Syst., October, 2025

OmniX: From Unified Panoramic Generation and Perception to Graphics-Ready 3D Scenes.

Yukun Huang, Jiwen Yu, Yanning Zhou, Jianan Wang, Xintao Wang, Pengfei Wan, Xihui Liu

CoRR, October, 2025

VFXMaster: Unlocking Dynamic Visual Effect Generation via In-Context Learning.

Baolu Li, Yiming Zhang, Qinghe Wang, Liqian Ma, Xiaoyu Shi, Xintao Wang, Pengfei Wan, Zhenfei Yin, Yunzhi Zhuge, Huchuan Lu, Xu Jia

CoRR, October, 2025

GRPO-Guard: Mitigating Implicit Over-Optimization in Flow Matching via Regulated Clipping.

Jing Wang, Jiajun Liang, Jie Liu, Henglin Liu, Gongye Liu, Jun Zheng, Wanyuan Pang, Ao Ma, Zhenyu Xie, Xintao Wang, Meng Wang, Pengfei Wan, Xiaodan Liang

CoRR, October, 2025

Latent Diffusion Model without Variational Autoencoder.

Minglei Shi, Haolin Wang, Wenzhao Zheng, Ziyang Yuan, Xiaoshi Wu, Xintao Wang, Pengfei Wan, Jie Zhou, Jiwen Lu

CoRR, October, 2025

Terra: Explorable Native 3D World Model with Point Latents.

Yuanhui Huang, Weiliang Chen, Wenzhao Zheng, Xin Tao, Pengfei Wan, Jie Zhou, Jiwen Lu

CoRR, October, 2025

Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention.

Zhen Yang, Mingyang Zhang, Feng Chen, Ganggui Ding, Liang Hou, Xin Tao, Pengfei Wan, Ying-Cong Chen

CoRR, October, 2025

PhysMaster: Mastering Physical Representation for Video Generation via Reinforcement Learning.

Sihui Ji, Xi Chen, Xin Tao, Pengfei Wan, Hengshuang Zhao

CoRR, October, 2025

Mitigating the Noise Shift for Denoising Generative Models via Noise Awareness Guidance.

Jincheng Zhong, Boyuan Jiang, Xin Tao, Pengfei Wan, Kun Gai, Mingsheng Long

CoRR, October, 2025

AdaViewPlanner: Adapting Video Diffusion Models for Viewpoint Planning in 4D Scenes.

Yu Li, Menghan Xia, Gongye Liu, Jianhong Bai, Xintao Wang, Conglang Zhang, Yuxuan Lin, Ruihang Chu, Pengfei Wan, Yujiu Yang

CoRR, October, 2025

VR-Thinker: Boosting Video Reward Models through Thinking-with-Image Reasoning.

Qunzhong Wang, Jie Liu, Jiajun Liang, Yilei Jiang, Yuanxing Zhang, Jinyuan Chen, Yaozhi Zheng, Xintao Wang, Pengfei Wan, Xiangyu Yue, Jiaheng Liu

CoRR, October, 2025

AVoCaDO: An Audiovisual Video Captioner Driven by Temporal Orchestration.

Xinlong Chen, Yue Ding, Weihong Lin, Jingyun Hua, Linli Yao, Yang Shi, Bozhou Li, Yuanxing Zhang, Qiang Liu, Pengfei Wan, Liang Wang, Tieniu Tan

CoRR, October, 2025

VideoCanvas: Unified Video Completion from Arbitrary Spatiotemporal Patches via In-Context Conditioning.

Minghong Cai, Qiulin Wang, Zongli Ye, Wenze Liu, Quande Liu, Weicai Ye, Xintao Wang, Pengfei Wan, Kun Gai, Xiangyu Yue

CoRR, October, 2025

UniVideo: Unified Understanding, Generation, and Editing for Videos.

Cong Wei, Quande Liu, Zixuan Ye, Qiulin Wang, Xintao Wang, Pengfei Wan, Kun Gai, Wenhu Chen

CoRR, October, 2025

UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution.

Shian Du, Menghan Xia, Chang Liu, Quande Liu, Xintao Wang, Pengfei Wan, Xiangyang Ji

CoRR, October, 2025

Free Lunch Alignment of Text-to-Image Diffusion Models without Preference Image Pairs.

Jia Jun Cheng Xian, Muchen Li, Haotian Yang, Xin Tao, Pengfei Wan, Leonid Sigal, Renjie Liao

CoRR, September, 2025

OpenGPT-4o-Image: A Comprehensive Dataset for Advanced Image Generation and Editing.

Zhihong Chen, Xuehai Bai, Yang Shi, Chaoyou Fu, Huanyu Zhang, Haotian Wang, Xiaoyan Sun, Zhang Zhang, Liang Wang, Yuanxing Zhang, Pengfei Wan, Yifan Zhang

CoRR, September, 2025

RealUnify: Do Unified Models Truly Benefit from Unification? A Comprehensive Benchmark.

Yang Shi, Yuhao Dong, Yue Ding, Yuran Wang, Xuanyu Zhu, Sheng Zhou, Wenting Liu, Haochen Tian, Rundong Wang, Huanqian Wang, Zuyan Liu, Bohan Zeng, Ruizhe Chen, Qixun Wang, Zhuoran Zhang, Xinlong Chen, Chengzhuo Tong, Bozhou Li, Chaoyou Fu, Qiang Liu, Haotian Wang, Wenjing Yang, Yuanxing Zhang, Pengfei Wan, Yifan Zhang, Ziwei Liu

CoRR, September, 2025

HunyuanImage 3.0 Technical Report.

Siyu Cao, Hangting Chen, Peng Chen, Yiji Cheng, Yutao Cui, Xinchi Deng, Ying Dong, Kipper Gong, Tianpeng Gu, Xiusen Gu, Tiankai Hang, Duojun Huang, Jie Jiang, Zhengkai Jiang, Weijie Kong, Changlin Li, Donghao Li, Junzhe Li, Xin Li, Yang Li, Zhenxi Li, Zhimin Li, Jiaxin Lin, Linus, Lucaz Liu, Shu Liu, Songtao Liu, Yu Liu, Yuhong Liu, Yanxin Long, Fanbin Lu, Qinglin Lu, Yuyang Peng, Yuanbo Peng, Xiangwei Shen, Yixuan Shi, Jiale Tao, Yangyu Tao, Qi Tian, Pengfei Wan, Chunyu Wang, Kai Wang, Lei Wang, Linqing Wang, Lucas Wang, Qixun Wang, Weiyan Wang, Hao Wen, Bing Wu, Jianbing Wu, Yue Wu, Senhao Xie, Fang Yang, Miles Yang, Xiaofeng Yang, Xuan Yang, Zhantao Yang, Jingmiao Yu, Zheng Yuan, Chao Zhang, Jian-Wei Zhang, Peizhen Zhang, Shi-Xue Zhang, Tao Zhang, Weigang Zhang, Yepeng Zhang, Yingfang Zhang, Zihao Zhang, Zijian Zhang, Penghao Zhao, Zhiyuan Zhao, Xuefei Zhe, Jianchen Zhu, Zhao Zhong

CoRR, September, 2025

VC-Agent: An Interactive Agent for Customized Video Dataset Collection.

Yidan Zhang, Mutian Xu, Yiming Hao, Kun Zhou, Jiahao Chang, Xiaoqiang Liu, Pengfei Wan, Hongbo Fu, Xiaoguang Han

CoRR, September, 2025

Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesis.

Yikang Ding, Jiwen Liu, Wenyuan Zhang, Zekun Wang, Wentao Hu, Liyuan Cui, Mingming Lao, Yingchao Shao, Hui Liu, Xiaohan Li, Ming Chen, Xiaoqiang Liu, Yu-Shen Liu, Pengfei Wan

CoRR, September, 2025

Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?

Ouxiang Li, Yuan Wang, Xinting Hu, Huijuan Huang, Rui Chen, Jiarong Ou, Xin Tao, Pengfei Wan, Xiaojuan Qi, Fuli Feng

CoRR, September, 2025

MIDAS: Multimodal Interactive Digital-humAn Synthesis via Real-time Autoregressive Video Generation.

Ming Chen, Liyuan Cui, Wenyuan Zhang, Haoxian Zhang, Yan Zhou, Xiaohan Li, Songlin Tang, Jiwen Liu, Borui Liao, Hejia Chen, Xiaoqiang Liu, Pengfei Wan

CoRR, August, 2025

Score Augmentation for Diffusion Models.

Liang Hou, Yuan Gao, Boyuan Jiang, Xin Tao, Qi Yan, Renjie Liao, Pengfei Wan, Di Zhang, Kun Gai

CoRR, August, 2025

DVIS++: Improved Decoupled Framework for Universal Video Segmentation.

Tao Zhang, Xingye Tian, Yikang Zhou, Shunping Ji, Xuebo Wang, Xin Tao, Yuan Zhang, Pengfei Wan, Zhongyuan Wang, Yu Wu

IEEE Trans. Pattern Anal. Mach. Intell., July, 2025

VMoBA: Mixture-of-Block Attention for Video Diffusion Models.

Jianzong Wu, Liang Hou, Haotian Yang, Xin Tao, Ye Tian, Pengfei Wan, Di Zhang, Yunhai Tong

CoRR, June, 2025

SimpleGVR: A Simple Baseline for Latent-Cascaded Video Super-Resolution.

Liangbin Xie, Yu Li, Shian Du, Menghan Xia, Xintao Wang, Fanghua Yu, Ziyan Chen, Pengfei Wan, Jiantao Zhou, Chao Dong

CoRR, June, 2025

FilMaster: Bridging Cinematic Principles and Generative AI for Automated Film Generation.

Kaiyi Huang, Yukun Huang, Xintao Wang, Zinan Lin, Xuefei Ning, Pengfei Wan, Di Zhang, Yu Wang, Xihui Liu

CoRR, June, 2025

VersaVid-R1: A Versatile Video Understanding and Reasoning Model from Question Answering to Captioning Tasks.

Xinlong Chen, Yuanxing Zhang, Yushuo Guan, Bohan Zeng, Yang Shi, Sihan Yang, Pengfei Wan, Qiang Liu, Liang Wang, Tieniu Tan

CoRR, June, 2025

UNIC: Unified In-Context Video Editing.

Zixuan Ye, Xuanhua He, Quande Liu, Qiulin Wang, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Qifeng Chen, Wenhan Luo

CoRR, June, 2025

FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformers.

Xuanhua He, Quande Liu, Zixuan Ye, Weicai Ye, Qiulin Wang, Xintao Wang, Qifeng Chen, Pengfei Wan, Di Zhang, Kun Gai

CoRR, June, 2025

Learning Video Generation for Robotic Manipulation with Collaborative Trajectory Control.

Xiao Fu, Xintao Wang, Xian Liu, Jianhong Bai, Runsen Xu, Pengfei Wan, Di Zhang, Dahua Lin

CoRR, June, 2025

OmniSync: Towards Universal Lip Synchronization via Diffusion Transformers.

Ziqiao Peng, Jiwen Liu, Haoxian Zhang, Xiaoqiang Liu, Songlin Tang, Pengfei Wan, Di Zhang, Hongyan Liu, Jun He

CoRR, May, 2025

MME-VideoOCR: Evaluating OCR-Based Capabilities of Multimodal LLMs in Video Scenarios.

Yang Shi, Huanqian Wang, Wulin Xie, Huanyao Zhang, Lijie Zhao, Yifan Zhang, Xinfeng Li, Chaoyou Fu, Zhuoer Wen, Wenting Liu, Zhuoran Zhang, Xinlong Chen, Bohan Zeng, Sihan Yang, Yuanxing Zhang, Pengfei Wan, Haotian Wang, Wenjing Yang

CoRR, May, 2025

Scaling Image and Video Generation via Test-Time Evolutionary Search.

Haoran He, Jiajun Liang, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Ling Pan

CoRR, May, 2025

VFRTok: Variable Frame Rates Video Tokenizer with Duration-Proportional Information Assumption.

Tianxiong Zhong, Xingye Tian, Boyuan Jiang, Xuebo Wang, Xin Tao, Pengfei Wan, Zhiwei Zhang

CoRR, May, 2025

Flow-GRPO: Training Flow Matching Models via Online RL.

Jie Liu, Gongye Liu, Jiajun Liang, Yangguang Li, Jiaheng Liu, Xintao Wang, Pengfei Wan, Di Zhang, Wanli Ouyang

CoRR, May, 2025

A Survey of Interactive Generative Video.

Jiwen Yu, Yiran Qin, Haoxuan Che, Quande Liu, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Hao Chen, Xihui Liu

CoRR, April, 2025

SPF-Portrait: Towards Pure Portrait Customization with Semantic Pollution-Free Fine-tuning.

Xiaole Xian, Zhichao Liao, Qingyu Li, Wenyu Qin, Pengfei Wan, Weicheng Xie, Long Zeng, Linlin Shen, Pingfa Feng

CoRR, April, 2025

Any2Caption:Interpreting Any Condition to Caption for Controllable Video Generation.

Shengqiong Wu, Weicai Ye, Jiahao Wang, Quande Liu, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Shuicheng Yan, Hao Fei, Tat-Seng Chua

CoRR, March, 2025

HumanAesExpert: Advancing a Multi-Modality Foundation Model for Human Image Aesthetic Assessment.

Zhichao Liao, Xiaokun Liu, Wenyu Qin, Qingyu Li, Qiulin Wang, Pengfei Wan, Di Zhang, Long Zeng, Pingfa Feng

CoRR, March, 2025

SARGes: Semantically Aligned Reliable Gesture Generation via Intent Chain.

Nan Gao, Yihua Bao, Dongdong Weng, Jiayi Zhao, Jia Li, Yan Zhou, Pengfei Wan, Di Zhang

CoRR, March, 2025

FullDiT: Multi-Task Video Generative Foundation Model with Full Attention.

Xuan Ju, Weicai Ye, Quande Liu, Qiulin Wang, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Qiang Xu

CoRR, March, 2025

Position: Interactive Generative Video as Next-Generation Game Engine.

Jiwen Yu, Yiran Qin, Haoxuan Che, Quande Liu, Xintao Wang, Pengfei Wan, Di Zhang, Xihui Liu

CoRR, March, 2025

DiffMoE: Dynamic Token Selection for Scalable Diffusion Transformers.

Minglei Shi, Ziyang Yuan, Haotian Yang, Xintao Wang, Mingwu Zheng, Xin Tao, Wenliang Zhao, Wenzhao Zheng, Jie Zhou, Jiwen Lu, Pengfei Wan, Di Zhang, Kun Gai

CoRR, March, 2025

MTV-Inpaint: Multi-Task Long Video Inpainting.

Shiyuan Yang, Zheng Gu, Liang Hou, Xin Tao, Pengfei Wan, Xiaodong Chen, Jing Liao

CoRR, March, 2025

ExGes: Expressive Human Motion Retrieval and Modulation for Audio-Driven Gesture Synthesis.

Xukun Zhou, Fengxin Li, Ming Chen, Yan Zhou, Pengfei Wan, Di Zhang, Yeying Jin, Zhaoxin Fan, Hongyan Liu, Jun He

CoRR, March, 2025

RectifiedHR: Enable Efficient High-Resolution Image Generation via Energy Rectification.

Zhen Yang, Guibao Shen, Liang Hou, Mushui Liu, Luozhou Wang, Xin Tao, Pengfei Wan, Di Zhang, Ying-Cong Chen

CoRR, March, 2025

FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems.

Borui Liao, Yulong Xu, Jiao Ou, Kaiyuan Yang, Weihua Jian, Pengfei Wan, Di Zhang

CoRR, February, 2025

Improving Video Generation with Human Feedback.

Jie Liu, Gongye Liu, Jiajun Liang, Ziyang Yuan, Xiaokun Liu, Mingwu Zheng, Xiele Wu, Qiulin Wang, Wenyu Qin, Menghan Xia, Xintao Wang, Xiaohong Liu, Fei Yang, Pengfei Wan, Di Zhang, Kun Gai, Yujiu Yang, Wanli Ouyang

CoRR, January, 2025

GameFactory: Creating New Games with Generative Interactive Videos.

Jiwen Yu, Yiran Qin, Xintao Wang, Pengfei Wan, Di Zhang, Xihui Liu

CoRR, January, 2025

ConceptMaster: Multi-Concept Video Customization on Diffusion Transformer Models Without Test-Time Tuning.

Yuzhou Huang, Ziyang Yuan, Quande Liu, Qiulin Wang, Xintao Wang, Ruimao Zhang, Pengfei Wan, Di Zhang, Kun Gai

CoRR, January, 2025

DiffCap: Diffusion-Based Real-Time Human Motion Capture Using Sparse IMUs and a Monocular Camera.

Shaohua Pan, Xinyu Yi, Yan Zhou, Weihua Jian, Yuan Zhang, Pengfei Wan, Feng Xu

IEEE Trans. Vis. Comput. Graph., 2025

Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrieval.

Jiwen Yu, Jianhong Bai, Yiran Qin, Quande Liu, Xintao Wang, Pengfei Wan, Di Zhang, Xihui Liu

Proceedings of the SIGGRAPH Asia 2025 Conference Papers, 2025

CamCloneMaster: Enabling Reference-based Camera Control for Video Generation.

Yawen Luo, Xiaoyu Shi, Jianhong Bai, Menghan Xia, Tianfan Xue, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai

Proceedings of the SIGGRAPH Asia 2025 Conference Papers, 2025

Motion Inversion for Video Customization.

Luozhou Wang, Ziyang Mai, Guibao Shen, Yixun Liang, Xin Tao, Pengfei Wan, Di Zhang, Yijun Li, Ying-Cong Chen

Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference, 2025

CineMaster: A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation.

Qinghe Wang, Yawen Luo, Xiaoyu Shi, Xu Jia, Huchuan Lu, Tianfan Xue, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai

Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference, 2025

GSHeadRelight: Fast Relightability for 3D Gaussian Head Synthesis.

Henglei Lv, Bailin Deng, Jianzhu Guo, Xiaoqiang Liu, Pengfei Wan, Di Zhang, Lin Gao

Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference, 2025

Training-Free Efficient Video Generation via Dynamic Token Carving.

Yuechen Zhang, Jinbo Xing, Bin Xia, Shaoteng Liu, Bohao Peng, Xin Tao, Pengfei Wan, Eric Lo, Jiaya Jia

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

VidEmo: Affective-Tree Reasoning for Emotion-Centric Video Foundation Models.

Zhicheng Zhang, Weicheng Wang, Yongjie Zhu, Wenyu Qin, Pengfei Wan, Di Zhang, Jufeng Yang

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

MME-VideoOCR: Evaluating OCR-Based Capabilities of Multimodal LLMs in Video Scenarios.

Yang Shi, Huanqian Wang, Wulin Xie, Huanyao Zhang, Lijie Zhao, Yifan Zhang, Xinfeng Li, Chaoyou Fu, Zhuoer Wen, Wenting Liu, Zhuoran Zhang, Xinlong Chen, Bohan Zeng, Sihan Yang, Yushuo Guan, Zhang Zhang, Liang Wang, Haoxuan Li, Zhouchen Lin, Yuanxing Zhang, Pengfei Wan, Haotian Wang, Wenjing Yang

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

Improving Video Generation with Human Feedback.

Jie Liu, Gongye Liu, Jiajun Liang, Ziyang Yuan, Xiaokun Liu, Mingwu Zheng, Xiele Wu, Qiulin Wang, Menghan Xia, Xintao Wang, Xiaohong Liu, Fei Yang, Pengfei Wan, Di Zhang, Kun Gai, Yujiu Yang, Wanli Ouyang

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

EditWorld: Simulating World Dynamics for Instruction-Following Image Editing.

Bohan Zeng, Ling Yang, Jiaming Liu, Minghao Xu, Yuanxing Zhang, Pengfei Wan, Wentao Zhang, Shuicheng Yan

Proceedings of the 33rd ACM International Conference on Multimedia, 2025

MODA: MOdular Duplex Attention for Multimodal Perception, Cognition, and Emotion Understanding.

Zhicheng Zhang, Wuyou Xia, Chenxi Zhao, Zhou Yan, Xiaoqiang Liu, Yongjie Zhu, Wenyu Qin, Pengfei Wan, Di Zhang, Jufeng Yang

Proceedings of the Forty-second International Conference on Machine Learning, 2025

3DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generation.

Xiao Fu, Xian Liu, Xintao Wang, Sida Peng, Menghan Xia, Xiaoyu Shi, Ziyang Yuan, Pengfei Wan, Di Zhang, Dahua Lin

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Stable Segment Anything Model.

Qi Fan, Xin Tao, Lei Ke, Mingqiao Ye, Di Zhang, Pengfei Wan, Yu-Wing Tai, Chi-Keung Tang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Cafe-Talk: Generating 3D Talking Face Animation with Multimodal Coarse- and Fine-grained Control.

Hejia Chen, Haoxian Zhang, Shoulong Zhang, Xiaoqiang Liu, Sisi Zhuang, Yuan Zhang, Pengfei Wan, Di Zhang, Shuai Li

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints.

Jianhong Bai, Menghan Xia, Xintao Wang, Ziyang Yuan, Zuozhu Liu, Haoji Hu, Pengfei Wan, Di Zhang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

GameFactorly: Creating New Games with Generative Interactive Videos.

Jiwen Yu, Yiran Qin, Xintao Wang, Pengfei Wan, Di Zhang, Xihui Liu

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

BadVideo: Stealthy Backdoor Attack Against Text-to-Video Generation.

Ruotong Wang, Mingli Zhu, Jiarong Ou, Rui Chen, Xin Tao, Pengfei Wan, Baoyuan Wu

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

Imbalance in Balance: Online Concept Balancing in Generation Models.

Yukai Shi, Jiarong Ou, Rui Chen, Haotian Yang, Jiahao Wang, Xin Tao, Pengfei Wan, Di Zhang, Kun Gai

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

Scene Graph Guided Generation: Enable Accurate Relations Generation in Text-to-Image Models via Textural Rectification.

Guibao Shen, Luozhou Wang, Jiantao Lin, Wenhang Ge, Chaozhe Zhang, Xin Tao, Di Zhang, Pengfei Wan, Guangyong Chen, Yijun Li, Ying-Cong Chen

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

FullDiT: Video Generative Foundation Models with Multimodal Control via Full Attention.

Xuan Ju, Weicai Ye, Quande Liu, Qiulin Wang, Xintao Wang, Pengfei Wan, Di Zhang, Kun Gai, Qiang Xu

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

GGTalker: Talking Head Systhesis with Generalizable Gaussian Priors and Identity-Specific Adaptation.

Wentao Hu, Shunkai Li, Ziqiao Peng, Haoxian Zhang, Fan Shi, Xiaoqiang Liu, Pengfei Wan, Di Zhang, Hui Tian

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

How Far are AI-Generated Videos from Simulating the 3D Visual World: A Learned 3D Evaluation Approach.

Chirui Chang, Jiahui Liu, Zhengzhe Liu, Xiaoyang Lyu, Yi-Hua Huang, Xin Tao, Pengfei Wan, Di Zhang, Xiaojuan Qi

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

Recammaster: Camera-Controlled Generative Rendering From a Single Video.

Jianhong Bai, Menghan Xia, Xiao Fu, Xintao Wang, Lianrui Mu, Jinwen Cao, Zuozhu Liu, Haoji Hu, Xiang Bai, Pengfei Wan, Di Zhang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

SARGes: Semantically Aligned Reliable Gesture Generation via Intent Chain.

Nan Gao, Yihua Bao, Dongdong Weng, Jiayi Zhao, Jia Li, Yan Zhou, Pengfei Wan

Proceedings of the International Workshop on Generation and Evaluation of Non-verbal Behaviour for Embodied Agents, 2025

SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMs.

Yuanyang Yin, Yaqi Zhao, Yajie Zhang, Yuanxing Zhang, Ke Lin, Jiahao Wang, Xin Tao, Pengfei Wan, Wentao Zhang, Feng Zhao

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

RICO: Improving Accuracy and Completeness in Image Recaptioning via Visual Reconstruction.

Yuchi Wang, Yishuo Cai, Shuhuai Ren, Sihan Yang, Linli Yao, Yuanxin Liu, Yuanxing Zhang, Pengfei Wan, Xu Sun

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

Towards Precise Scaling Laws for Video Diffusion Transformers.

Yuanyang Yin, Yaqi Zhao, Mingwu Zheng, Ke Lin, Jiarong Ou, Rui Chen, Victor Shea-Jay Huang, Jiahao Wang, Xin Tao, Pengfei Wan, Di Zhang, Baoqun Yin, Wentao Zhang, Kun Gai

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

StyleMaster: Stylize Your Video with Artistic Generation and Translation.

Zixuan Ye, Huijuan Huang, Xintao Wang, Pengfei Wan, Di Zhang, Wenhan Luo

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Video Content.

Qiuheng Wang, Yukai Shi, Jiarong Ou, Rui Chen, Ke Lin, Jiahao Wang, Boyuan Jiang, Haotian Yang, Mingwu Zheng, Xin Tao, Fei Yang, Pengfei Wan, Di Zhang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulation.

Zhuoman Liu, Weicai Ye, Yan Luximon, Pengfei Wan, Di Zhang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

SketchVideo: Sketch-based Video Generation and Editing.

Feng-Lin Liu, Hongbo Fu, Xintao Wang, Weicai Ye, Pengfei Wan, Di Zhang, Lin Gao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

GPAvatar: High-fidelity Head Avatars by Learning Efficient Gaussian Projections.

Wei-Qi Feng, Dong Han, Ze-Kang Zhou, Shunkai Li, Xiaoqiang Liu, Pengfei Wan, Di Zhang, Miao Wang

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

PatchVSR: Breaking Video Diffusion Resolution Limits with Patch-wise Video Super-Resolution.

Shian Du, Menghan Xia, Chang Liu, Xintao Wang, Jing Wang, Pengfei Wan, Di Zhang, Xiangyang Ji

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

2024

Owl-1: Omni World Model for Consistent Long Video Generation.

Yuanhui Huang, Wenzhao Zheng, Yuan Gao, Xin Tao, Pengfei Wan, Di Zhang, Jie Zhou, Jiwen Lu

CoRR, 2024

SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpoints.

Jianhong Bai, Menghan Xia, Xintao Wang, Ziyang Yuan, Xiao Fu, Zuozhu Liu, Haoji Hu, Pengfei Wan, Di Zhang

CoRR, 2024

VIVID-10M: A Dataset and Baseline for Versatile and Interactive Video Local Editing.

Jiahao Hu, Tianxiong Zhong, Xuebo Wang, Boyuan Jiang, Xingye Tian, Fei Yang, Pengfei Wan, Di Zhang

CoRR, 2024

MotionGPT-2: A General-Purpose Motion-Language Model for Motion Generation and Understanding.

Yuan Wang, Di Huang, Yaqi Zhang, Wanli Ouyang, Jile Jiao, Xuetao Feng, Yan Zhou, Pengfei Wan, Shixiang Tang, Dan Xu

CoRR, 2024

SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMs.

Yuanyang Yin, Yaqi Zhao, Yajie Zhang, Ke Lin, Jiahao Wang, Xin Tao, Pengfei Wan, Di Zhang, Baoqun Yin, Wentao Zhang

CoRR, 2024

ViMo: Generating Motions from Casual Videos.

Liangdong Qiu, Chengxing Yu, Yanran Li, Zhao Wang, Haibin Huang, Chongyang Ma, Di Zhang, Pengfei Wan, Xiaoguang Han

CoRR, 2024

4Dynamic: Text-to-4D Generation with Hybrid Priors.

Yu-Jie Yuan, Leif Kobbelt, Jiwen Liu, Yuan Zhang, Pengfei Wan, Yu-Kun Lai, Lin Gao

CoRR, 2024

LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Control.

Jianzhu Guo, Dingyun Zhang, Xiaoqiang Liu, Zhizhou Zhong, Yuan Zhang, Pengfei Wan, Di Zhang

CoRR, 2024

VideoTetris: Towards Compositional Text-to-Video Generation.

Ye Tian, Ling Yang, Haotian Yang, Yuan Gao, Yufan Deng, Jingmin Chen, Xintao Wang, Zhaochen Yu, Xin Tao, Pengfei Wan, Di Zhang, Bin Cui

CoRR, 2024

SG-Adapter: Enhancing Text-to-Image Generation with Scene Graph Guidance.

Guibao Shen, Luozhou Wang, Jiantao Lin, Wenhang Ge, Chaozhe Zhang, Xin Tao, Yuan Zhang, Pengfei Wan, Zhongyuan Wang, Guangyong Chen, Yijun Li, Ying-Cong Chen

CoRR, 2024

UNIAA: A Unified Multi-modal Image Aesthetic Assessment Baseline and Benchmark.

Zhaokun Zhou, Qiulin Wang, Bin Lin, Yiwei Su, Rui Chen, Xin Tao, Amin Zheng, Li Yuan, Pengfei Wan, Di Zhang

CoRR, 2024

Motion Inversion for Video Customization.

Luozhou Wang, Guibao Shen, Yixun Liang, Xin Tao, Pengfei Wan, Di Zhang, Yijun Li, Yingcong Chen

CoRR, 2024

Towards Unified 3D Hair Reconstruction from Single-View Portraits.

Yujian Zheng, Yuda Qiu, Leyang Jin, Chongyang Ma, Haibin Huang, Di Zhang, Pengfei Wan, Xiaoguang Han

Proceedings of the SIGGRAPH Asia 2024 Conference Papers, 2024

VRMM: A Volumetric Relightable Morphable Head Model.

Haotian Yang, Mingwu Zheng, Chongyang Ma, Yu-Kun Lai, Pengfei Wan, Haibin Huang

Proceedings of the ACM SIGGRAPH 2024 Conference Papers, 2024

Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion.

Shiyuan Yang, Liang Hou, Haibin Huang, Chongyang Ma, Pengfei Wan, Di Zhang, Xiaodong Chen, Jing Liao

Proceedings of the ACM SIGGRAPH 2024 Conference Papers, 2024

I2V-Adapter: A General Image-to-Video Adapter for Diffusion Models.

Xun Guo, Mingwu Zheng, Liang Hou, Yuan Gao, Yufan Deng, Pengfei Wan, Di Zhang, Yufan Liu, Weiming Hu, Zhengjun Zha, Haibin Huang, Chongyang Ma

Proceedings of the ACM SIGGRAPH 2024 Conference Papers, 2024

VideoTetris: Towards Compositional Text-to-Video Generation.

Ye Tian, Ling Yang, Haotian Yang, Yuan Gao, Yufan Deng, Xintao Wang, Zhaochen Yu, Xin Tao, Pengfei Wan, Di Zhang, Bin Cui

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

PlacidDreamer: Advancing Harmony in Text-to-3D Generation.

Shuo Huang, Shikun Sun, Zixuan Wang, Xiaoyu Qin, Yanmin Xiong, Yuan Zhang, Pengfei Wan, Di Zhang, Jia Jia

Proceedings of the 32nd ACM International Conference on Multimedia, MM 2024, Melbourne, VIC, Australia, 28 October 2024, 2024

Agent Attention: On the Integration of Softmax and Linear Attention.

Dongchen Han, Tianzhu Ye, Yizeng Han, Zhuofan Xia, Siyuan Pan, Pengfei Wan, Shiji Song, Gao Huang

Proceedings of the Computer Vision - ECCV 2024, 2024

2023

Multi-Modal Face Stylization with a Generative Prior.

Mengtian Li, Yi Dong, Minxuan Lin, Haibin Huang, Pengfei Wan, Chongyang Ma

Comput. Graph. Forum, October, 2023

Snowflake Point Deconvolution for Point Cloud Completion and Generation With Skip-Transformer.

Peng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao, Pengfei Wan, Wen Zheng, Zhizhong Han

IEEE Trans. Pattern Anal. Mach. Intell., May, 2023

EM-Gaze: eye context correlation and metric learning for gaze estimation.

Jinchao Zhou, Guoan Li, Feng Shi, Xiaoyan Guo, Pengfei Wan, Miao Wang

Vis. Comput. Ind. Biomed. Art, 2023

Predicting Personalized Head Movement From Short Video and Speech Signal.

Ran Yi, Zipeng Ye, Zhiyao Sun, Juyong Zhang, Guo-Xin Zhang, Pengfei Wan, Hujun Bao, Yong-Jin Liu

IEEE Trans. Multim., 2023

PMP-Net++: Point Cloud Completion by Transformer-Enhanced Multi-Step Point Moving Paths.

Xin Wen, Peng Xiang, Zhizhong Han, Yan-Pei Cao, Pengfei Wan, Wen Zheng, Yu-Shen Liu

IEEE Trans. Pattern Anal. Mach. Intell., 2023

I2V-Adapter: A General Image-to-Video Adapter for Video Diffusion Models.

Xun Guo, Mingwu Zheng, Liang Hou, Yuan Gao, Yufan Deng, Chongyang Ma, Weiming Hu, Zhengjun Zha, Haibin Huang, Pengfei Wan, Di Zhang

CoRR, 2023

Stable Segment Anything Model.

Qi Fan, Xin Tao, Lei Ke, Mingqiao Ye, Yuan Zhang, Pengfei Wan, Zhongyuan Wang, Yu-Wing Tai, Chi-Keung Tang

CoRR, 2023

Temporal-Aware Refinement for Video-based Human Pose and Shape Recovery.

Ming Chen, Yan Zhou, Weihua Jian, Pengfei Wan, Zhongyuan Wang

CoRR, 2023

1st Place Solution for the 5th LSVOS Challenge: Video Instance Segmentation.

Tao Zhang, Xingye Tian, Yikang Zhou, Yu Wu, Shunping Ji, Cilin Yan, Xuebo Wang, Xin Tao, Yuan Zhang, Pengfei Wan

CoRR, 2023

1st Place Solution for PVUW Challenge 2023: Video Panoptic Segmentation.

Tao Zhang, Xingye Tian, Haoran Wei, Yu Wu, Shunping Ji, Xuebo Wang, Xin Tao, Yuan Zhang, Pengfei Wan

CoRR, 2023

Towards Practical Capture of High-Fidelity Relightable Avatars.

Haotian Yang, Mingwu Zheng, Wanquan Feng, Haibin Huang, Yu-Kun Lai, Pengfei Wan, Zhongyuan Wang, Chongyang Ma

Proceedings of the SIGGRAPH Asia 2023 Conference Papers, 2023

Augmentation-Aware Self-Supervision for Data-Efficient GAN Training.

Liang Hou, Qi Cao, Yige Yuan, Songtao Zhao, Chongyang Ma, Siyuan Pan, Pengfei Wan, Zhongyuan Wang, Huawei Shen, Xueqi Cheng

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Automatic Human Scene Interaction through Contact Estimation and Motion Adaptation.

Mingrui Zhang, Ming Chen, Yan Zhou, Li Chen, Weihua Jian, Pengfei Wan

Proceedings of the 31st ACM International Conference on Multimedia, 2023

DVIS: Decoupled Video Instance Segmentation Framework.

Tao Zhang, Xingye Tian, Yu Wu, Shunping Ji, Xuebo Wang, Yuan Zhang, Pengfei Wan

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

FEditNet: Few-Shot Editing of Latent Semantics in GAN Spaces.

Mengfei Xia, Yezhi Shu, Yuji Wang, Yu-Kun Lai, Qiang Li, Pengfei Wan, Zhongyuan Wang, Yong-Jin Liu

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Bridging CLIP and StyleGAN through Latent Alignment for Image Editing.

Wanfeng Zheng, Qiang Li, Xiaoyan Guo, Pengfei Wan, Zhongyuan Wang

CoRR, 2022

ITTR: Unpaired Image-to-Image Translation with Transformers.

Wanfeng Zheng, Qiang Li, Guoxin Zhang, Pengfei Wan, Zhongyuan Wang

CoRR, 2022

Debiased Self-Training for Semi-Supervised Learning.

Baixu Chen, Junguang Jiang, Ximei Wang, Pengfei Wan, Jianmin Wang, Mingsheng Long

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Learning an Inference-accelerated Network from a Pre-trained Model with Frequency-enhanced Feature Distillation.

Xuesong Niu, Jili Gu, Guoxin Zhang, Pengfei Wan, Zhongyuan Wang

Proceedings of the MM '22: The 30th ACM International Conference on Multimedia, Lisboa, Portugal, October 10, 2022

Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation.

Linfeng Zhang, Xin Chen, Xiaobing Tu, Pengfei Wan, Ning Xu, Kaisheng Ma

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Exploring Set Similarity for Dense Self-supervised Representation Learning.

Zhaoqing Wang, Qiang Li, Guoxin Zhang, Pengfei Wan, Wen Zheng, Nannan Wang, Mingming Gong, Tongliang Liu

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

Assessing a Single Image in Reference-Guided Image Synthesis.

Jiayi Guo, Chaoqun Du, Jiangshan Wang, Huijuan Huang, Pengfei Wan, Gao Huang

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Write-An-Animation: High-level Text-based Animation Editing with Character-Scene Interaction.

Jia-Qi Zhang, Xiang Xu, Zhi-Meng Shen, Zehuan Huang, Yang Zhao, Yan-Pei Cao, Pengfei Wan, Miao Wang

Comput. Graph. Forum, 2021

BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generation.

Mingcong Liu, Qiang Li, Zekui Qin, Guoxin Zhang, Pengfei Wan, Wen Zheng

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

SnowflakeNet: Point Cloud Completion by Snowflake Point Deconvolution with Skip-Transformer.

Peng Xiang, Xin Wen, Yu-Shen Liu, Yan-Pei Cao, Pengfei Wan, Wen Zheng, Zhizhong Han

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

PMP-Net: Point Cloud Completion by Learning Multi-Step Point Moving Paths.

Xin Wen, Peng Xiang, Zhizhong Han, Yan-Pei Cao, Pengfei Wan, Wen Zheng, Yu-Shen Liu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Cycle4Completion: Unpaired Point Cloud Completion Using Cycle Transformation With Missing Region Coding.

Xin Wen, Zhizhong Han, Yan-Pei Cao, Pengfei Wan, Wen Zheng, Yu-Shen Liu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

Camera-Space Hand Mesh Recovery via Semantic Aggregation and Adaptive 2D-1D Registration.

Xingyu Chen, Yufeng Liu, Chongyang Ma, Jianlong Chang, Huayan Wang, Tian Chen, Xiaoyan Guo, Pengfei Wan, Wen Zheng

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021

2020

Advancing Image Understanding in Poor Visibility Environments: A Collective Benchmark Study.

Wenhan Yang, Ye Yuan, Wenqi Ren, Jiaying Liu, Walter J. Scheirer, Zhangyang Wang, Taiheng Zhang, Qiaoyong Zhong, Di Xie, Shiliang Pu, Yuqiang Zheng, Yanyun Qu, Yuhong Xie, Liang Chen, Zhonghao Li, Chen Hong, Hao Jiang, Siyuan Yang, Yan Liu, Xiaochao Qu, Pengfei Wan, Shuai Zheng, Minhui Zhong, Taiyi Su, Lingzhi He, Yandong Guo, Yao Zhao, Zhenfeng Zhu, Jinxiu Liang, Jingwen Wang, Tianyi Chen, Yuhui Quan, Yong Xu, Bo Liu, Xin Liu, Qi Sun, Tingyu Lin, Xiaochuan Li, Feng Lu, Lin Gu, Shengdi Zhou, Cong Cao, Shifeng Zhang, Cheng Chi, Chubin Zhuang, Zhen Lei, Stan Z. Li, Shizheng Wang, Ruizhe Liu, Dong Yi, Zheming Zuo, Jianning Chi, Huan Wang, Kai Wang, Yixiu Liu, Xingyu Gao, Zhenyu Chen, Chang Guo, Yongzhou Li, Huicai Zhong, Jing Huang, Heng Guo, Jianfei Yang, Wenjuan Liao, Jiangang Yang, Liguo Zhou, Mingyue Feng, Likun Qin

IEEE Trans. Image Process., 2020

2019

High Bit-Depth Image Acquisition Framework Using Embedded Quantization Bias.

Pengfei Wan, Jiexiang Tan, Xiaocong Lian, Xiangyang Ji

IEEE Trans. Computational Imaging, 2019

GraphPoseGAN: 3D Hand Pose Estimation from a Monocular RGB Image via Adversarial Learning on Graphs.

Yiming He, Wei Hu, Siyuan Yang, Xiaochao Qu, Pengfei Wan, Zongming Guo

CoRR, 2019

NTIRE 2019 Challenge on Image Enhancement: Methods and Results.

Andrey Ignatov, Radu Timofte, Xiaochao Qu, Xingguang Zhou, Ting Liu, Pengfei Wan, Syed Waqas Zamir, Aditya Arora, Salman H. Khan, Fahad Shahbaz Khan, Ling Shao, Dongwon Park, Se Young Chun, Pablo Navarrete Michelini, Hanwen Liu, Dan Zhu, Zhiwei Zhong, Xianming Liu, Junjun Jiang, Debin Zhao, Muhammad Haris, Kazutoshi Akita, Tomoki Yoshida, Greg Shakhnarovich, Norimichi Ukita, Jie Liu, Cheolkon Jung, Raimondo Schettini, Simone Bianco, Claudio Cusano, Flavio Piccoli, Pengju Liu, Kai Zhang, Jingdong Liu, Jiye Liu, Hongzhi Zhang, Wangmeng Zuo, Nelson Chong Ngee Bow, Lai-Kuan Wong, John See, Jinghui Qin, Lishan Huang, Yukai Shi, Pengxu Wei, Wushao Wen, Liang Lin, Zheng Hui, Xiumei Wang, Xinbo Gao, Kanti Kumari, Vikas Kumar Anand, Mahendra Khened, Ganapathy Krishnamurthi

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

NTIRE 2019 Image Dehazing Challenge Report.

Codruta O. Ancuti, Cosmin Ancuti, Radu Timofte, Luc Van Gool, Lei Zhang, Ming-Hsuan Yang, Tiantong Guo, Xuelu Li, Venkateswararao Cherukuri, Vishal Monga, Hao Jiang, Siyuan Yang, Yan Liu, Xiaochao Qu, Pengfei Wan, Dongwon Park, Se Young Chun, Ming Hong, Jinying Huang, Yizi Chen, Shuxin Chen, Bomin Wang, Pablo Navarrete Michelini, Hanwen Liu, Dan Zhu, Jing Liu, Sanchayan Santra, Ranjan Mondal, Bhabatosh Chanda, Peter Morales, Tzofi Klinghoffer, Le Manh Quan, Yong-Guk Kim, Xiao Liang, Runde Li, Jinshan Pan, Jinhui Tang, Kuldeep Purohit, Maitreya Suin, A. N. Rajagopalan, Raimondo Schettini, Simone Bianco, Flavio Piccoli, Claudio Cusano, Luigi Celona, Sunhee Hwang, Yu Seung Ma, Hyeran Byun, Subrahmanyam Murala, Akshay Dudhane, Harshjeet Singh Aulakh, Tianxiang Zheng, Tao Zhang, Weining Qin, Runnan Zhou, Shanhu Wang, Jean-Philippe Tarel, Chuansheng Wang, Jiawei Wu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

2018

Range Scaling Global U-Net for Perceptual Image Enhancement on Mobile Devices.

Jie Huang, Pengfei Zhu, Mingrui Geng, Jiewen Ran, Xingguang Zhou, Chen Xing, Pengfei Wan, Xiangyang Ji

Proceedings of the Computer Vision - ECCV 2018 Workshops, 2018

2016

Image Bit-Depth Enhancement via Maximum A Posteriori Estimation of AC Signal.

Pengfei Wan, Gene Cheung, Dinei A. F. Florêncio, Cha Zhang, Oscar C. Au

IEEE Trans. Image Process., 2016

2015

Precision Enhancement of 3-D Surfaces from Compressed Multiview Depth Maps.

Pengfei Wan, Gene Cheung, Philip A. Chou, Dinei A. F. Florêncio, Cha Zhang, Oscar C. Au

IEEE Signal Process. Lett., 2015

Motion vector fields based video coding.

Amin Zheng, Yuan Yuan, Hong Zhang, Haitao Yang, Pengfei Wan, Oscar C. Au

Proceedings of the 2015 IEEE International Conference on Image Processing, 2015

2014

Precision Enhancement of 3D Surfaces from Multiple Compressed Depth Maps.

Pengfei Wan, Gene Cheung, Philip A. Chou, Dinei A. F. Florêncio, Cha Zhang, Oscar C. Au

CoRR, 2014

Solving dense stereo matching via quadratic programming.

Rui Ma, Oscar C. Au, Pengfei Wan, Wenxiu Sun, Lingfeng Xu, Luheng Jia

Proceedings of the 2014 IEEE Visual Communications and Image Processing Conference, 2014

A fast intermode decision algorithm based on analysis of inter prediction residual.

Luheng Jia, Oscar C. Au, Chi-Ying Tsui, Wei Dai, Pengfei Wan

Proceedings of the IEEE 16th International Workshop on Multimedia Signal Processing, 2014

Image bit-depth enhancement via maximum-a-posteriori estimation of graph AC component.

Pengfei Wan, Gene Cheung, Dinei A. F. Florêncio, Cha Zhang, Oscar C. Au

Proceedings of the 2014 IEEE International Conference on Image Processing, 2014

High bit-precision image acquisition and reconstruction by planned sensor distortion.

Pengfei Wan, Oscar C. Au, Jiahao Pang, Ketan Tang, Rui Ma

Proceedings of the 2014 IEEE International Conference on Image Processing, 2014

DCT coefficients generation model for film grain noise and its application in super-resolution.

Ting Sun, Luhong Liang, King Hung Chiu, Pengfei Wan, Oscar C. Au

Proceedings of the 2014 IEEE International Conference on Image Processing, 2014

Palette-based compound image compression in HEVC by exploiting non-local spatial correlation.

Wenjing Zhu, Oscar C. Au, Wei Dai, Haitao Yang, Rui Ma, Luheng Jia, Jin Zeng, Pengfei Wan

Proceedings of the IEEE International Conference on Acoustics, 2014

SSIM-based rate-distortion optimization in H.264.

Wei Dai, Oscar C. Au, Wenjing Zhu, Pengfei Wan, Wei Hu, Jiantao Zhou

Proceedings of the IEEE International Conference on Acoustics, 2014

Improved temporal psychovisual modulation for backward-compatible stereoscopic display.

Rui Ma, Oscar C. Au, Pengfei Wan, Lingfeng Xu, Wenxiu Sun, Wei Hu

Proceedings of the 2014 IEEE Global Conference on Signal and Information Processing, 2014

Fast binary motion estimation for screen content video coding.

Ting Sun, Pengfei Wan, Oscar C. Au, Wei Dai, Luheng Jia, Yuan Yuan, Amin Zheng, Rui Ma

Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2014

2013

3-D Motion Estimation for Visual Saliency Modeling.

Pengfei Wan, Yunlong Feng, Gene Cheung, Ivan V. Bajic, Oscar C. Au

IEEE Signal Process. Lett., 2013

Precision enhancement of 3D surfaces from multiple quantized depth maps.

Pengfei Wan, Gene Cheung, Philip A. Chou, Dinei Florêncio, Cha Zhang, Oscar C. Au

Proceedings of the 11th IVMSP Workshop: 3D Image/Video Technologies and Applications, 2013

Personal photo album compression and management.

Ruobing Zou, Oscar C. Au, Guyue Zhou, Wei Dai, Wei Hu, Pengfei Wan

Proceedings of the 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013), 2013

Optimal dependent bit allocation for AVS intra-frame coding via successive convex approximation.

Chao Pang, Oscar C. Au, Feng Zou, Xingyu Zhang, Wei Hu, Pengfei Wan

Proceedings of the IEEE International Conference on Image Processing, 2013

A robust interpolation-free approach for sub-pixel accuracy motion estimation.

Wei Dai, Oscar C. Au, Wenjing Zhu, Wei Hu, Pengfei Wan, Jiali Li

Proceedings of the IEEE International Conference on Image Processing, 2013

3D motion in visual saliency modeling.

Pengfei Wan, Yunlong Feng, Gene Cheung, Ivan V. Bajic, Oscar C. Au, Yusheng Ji

Proceedings of the IEEE International Conference on Acoustics, 2013

2012

From 2D Extrapolation to 1D Interpolation: Content Adaptive Image Bit-Depth Expansion.

Pengfei Wan, Oscar C. Au, Ketan Tang, Yuanfang Guo, Lu Fang

Proceedings of the 2012 IEEE International Conference on Multimedia and Expo, 2012

Image de-quantization via spatially varying sparsity prior.

Pengfei Wan, Oscar C. Au, Ketan Tang, Yuanfang Guo

Proceedings of the 19th IEEE International Conference on Image Processing, 2012

Super resolution for subpixel-based downsampled images.

Ketan Tang, Oscar C. Au, Lu Fang, Yuanfang Guo, Pengfei Wan, Lingfeng Xu

Proceedings of the Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, 2012