Corner Guided Curve Matching and its Application to Scene Reconstruction. - Ying Shan; Zhengyou Zhang (CVPR, 2000)

Curve Matching with Probabilistic Relaxation. - Ying Shan; Zhengyou Zhang (MVA, 2000)

Visual Screen: Transforming an Ordinary Screen into a Touch Screen. - Zhengyou Zhang; Ying Shan (MVA, 2000)

A Progressive Scheme for Stereo Matching. - Zhengyou Zhang; Ying Shan (SMILE, 2000)

Model-Based Bundle Adjustment with Application to Face Modeling. - Ying Shan; Zicheng Liu 001; Zhengyou Zhang (ICCV, 2001)

Cloning Your Own Face with a Desktop Camera. - Zhengyou Zhang; Zicheng Liu 001; Dennis Adler; Michael F. Cohen; Erik Hanson; Ying Shan (ICCV, 2001)

Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper. - Zhengyou Zhang; Ying Wu 001; Ying Shan; Steven Shafer (PUI, 2001)

Expressive expression mapping with ratio images. - Zicheng Liu 001; Ying Shan; Zhengyou Zhang (SIGGRAPH, 2001)

New Measurements and Corner-Guidance for Curve Matching with Probabilistic Relaxation. - Ying Shan; Zhengyou Zhang (Int. J. Comput. Vis., 2002)

Incremental motion estimation through modified bundle adjustment. - Zhengyou Zhang; Ying Shan (ICIP (2), 2003)

Linear Model Hashing and Batch RANSAC for Rapid and Accurate Object Recognition. - Ying Shan; Bogdan Matei; Harpreet S. Sawhney; Rakesh Kumar 001; Daniel F. Huber; Martial Hebert (CVPR (2), 2004)

Partial Object Matching with Shapeme Histograms. - Ying Shan; Harpreet S. Sawhney; Bogdan Matei; Rakesh Kumar 001 (ECCV (3), 2004)

Image-Based Surface Detail Transfer. - Zicheng Liu 001; Zhengyou Zhang; Ying Shan (IEEE Computer Graphics and Applications, 2004)

Robust and Rapid Generation of Animated Faces from Video Images: A Model-Based Modeling Approach. - Zhengyou Zhang; Zicheng Liu 001; Dennis Adler; Michael F. Cohen; Erik Hanson; Ying Shan (Int. J. Comput. Vis., 2004)

Vehicle Fingerprinting for Reacquisition and Tracking in Videos. - Yanlin Guo; Steven C. Hsu; Ying Shan; Harpreet S. Sawhney; Rakesh Kumar 001 (CVPR (2), 2005)

Unsupervised Learning of Discriminative Edge Measures for Vehicle Matching between Non-Overlapping Cameras. - Ying Shan; Harpreet S. Sawhney; Rakesh Kumar 001 (CVPR (1), 2005)

Vehicle Identification between Non-Overlapping Cameras without Direct Feature Matching. - Ying Shan; Harpreet S. Sawhney; Rakesh Kumar 001 (ICCV, 2005)

Clustering multiple image sequences with a sequence-to-sequence similarity measure. - Ying Shan; Harpreet S. Sawhney; Art Pope (Int. J. Pattern Recognit. Artif. Intell., 2005)

Learning Exemplar-Based Categorization for the Detection of Multi-View Multi-Pose Objects. - Ying Shan; Feng Han 002; Harpreet S. Sawhney; Rakesh Kumar 001 (CVPR (2), 2006)

Rapid Object Indexing Using Locality Sensitive Hashing and Joint 3D-Signature Space Estimation. - Bogdan Matei; Ying Shan; Harpreet S. Sawhney; Yi Tan; Rakesh Kumar 001; Daniel F. Huber; Martial Hebert (IEEE Trans. Pattern Anal. Mach. Intell., 2006)

Shapeme Histogram Projection and Matching for Partial Object Recognition. - Ying Shan; Harpreet S. Sawhney; Bogdan Matei; Rakesh Kumar 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2006)

PEET: Prototype Embedding and Embedding Transition for Matching Vehicles over Disparate Viewpoints. - Yanlin Guo; Ying Shan; Harpreet S. Sawhney; Rakesh Kumar 001 (CVPR, 2007)

Robust Object Matching for Persistent Tracking with Heterogeneous Features. - Yanlin Guo; Steven C. Hsu; Harpreet S. Sawhney; Rakesh Kumar 001; Ying Shan (IEEE Trans. Pattern Anal. Mach. Intell., 2007)

Discovering class specific composite features through discriminative sampling with Swendsen-Wang Cut. - Feng Han 002; Ying Shan; Harpreet S. Sawhney; Rakesh Kumar 001 (CVPR, 2008)

Solving partial differential equations on irregular domains with moving interfaces, with applications to superconformal electrodeposition in semiconductor manufacturing. - James A. Sethian; Ying Shan (J. Comput. Phys., 2008)

Unsupervised Learning of Discriminative Edge Measures for Vehicle Matching between Nonoverlapping Cameras. - Ying Shan; Harpreet S. Sawhney; Rakesh Kumar 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2008)

Efficient Scale-Space Spatiotemporal Saliency Tracking for Distortion-Free Video Retargeting. - Gang Hua 001; Cha Zhang; Zicheng Liu 001; Zhengyou Zhang; Ying Shan (ACCV (2), 2009)

NSM: A Security Mechanism for Object-Based Storage System. - Ying Shan; Nianmin Yao (CSIE (4), 2009)

Kernel PCA Regression for Missing Data Estimation in DNA Microarray Analysis. - Ying Shan; Guang Deng (ISCAS, 2009)

Internet Vision. - Shai Avidan; Simon Baker; Ying Shan (Proc. IEEE, 2010)

An Empirical Research on Designing and Promoting the Brand Logo of Yangshan Shuimi Peaches Based on the Theory of Brand Experience. - Liang Yin; Junmiao Wang; Ying Shan; Yi Jin; Zilin Sun; Weifeng Huang; Binbin Li 017 (HCI (20), 2013)

Deep Crossing: Web-Scale Modeling without Manually Crafted Combinatorial Features. - Ying Shan; T. Ryan Hoens; Jian Jiao 007; Haijing Wang; Dong Yu; J. C. Mao (KDD, 2016)

Deep Embedding Forest: Forest-based Serving with Deep Embedding Features. - Jie Zhu 007; Ying Shan; J. C. Mao; Dong Yu; Holakou Rahmanian; Yi Zhang (KDD, 2017)

Recurrent Binary Embedding for GPU-Enabled Exhaustive Retrieval from Billion-Scale Semantic Vectors. - Ying Shan; Jian Jiao 007; Jie Zhu 007; J. C. Mao (KDD, 2018)

Overview of the NLPCC 2019 Shared Task: Open Domain Conversation Evaluation. - Ying Shan; Anqi Cui; Luchen Tan; Kun Xiong (NLPCC (2), 2019)

Fast Video Object Segmentation Using the Global Context Module. - Yu Li 003; Zhuoran Shen; Ying Shan (ECCV (10), 2020)

Feature Augmented Memory with Global Attention Network for VideoQA. - Jiayin Cai; Chun Yuan; Cheng Shi; Lei Li 051; Yangyang Cheng; Ying Shan (IJCAI, 2020)

Dual Semantic Fusion Network for Video Object Detection. - Lijian Lin; Haosheng Chen 001; Honglun Zhang; Jun Liang; Yu Li 003; Ying Shan; Hanzi Wang (ACM Multimedia, 2020)

Detecting Interactions from Neural Networks via Topological Analysis. - Zirui Liu 001; Qingquan Song; Kaixiong Zhou; Ting-Hsiang Wang; Ying Shan; Xia Hu 001 (NeurIPS, 2020)

A Simple Yet Effective Method for Video Temporal Grounding with Cross-Modality Attention. - Binjie Zhang; Yu Li 003; Chun Yuan; Dejing Xu; Pin Jiang; Ying Shan (CoRR, 2020)

Towards Interaction Detection Using Topological Analysis on Neural Networks. - Zirui Liu 001; Qingquan Song; Kaixiong Zhou; Ting-Hsiang Wang; Ying Shan; Xia Hu 001 (CoRR, 2020)

Distilling Audio-Visual Knowledge by Compositional Contrastive Learning. - Yanbei Chen; Yongqin Xian; A. Sophia Koepke; Ying Shan; Zeynep Akata (CVPR, 2021)

Towards Real-World Blind Face Restoration With Generative Facial Prior. - Xintao Wang 002; Yu Li 003; Honglun Zhang; Ying Shan (CVPR, 2021)

Open-Book Video Captioning With Retrieve-Copy-Generate Network. - Ziqi Zhang; Zhongang Qi; Chunfeng Yuan; Ying Shan; Bing Li 001; Ying Deng; Weiming Hu (CVPR, 2021)

Instances as Queries. - Yuxin Fang; Shusheng Yang; Xinggang Wang; Yu Li 003; Chen Fang; Ying Shan; Bin Feng 001; Wenyu Liu 001 (ICCV, 2021)

Towards Vivid and Diverse Image Colorization with Generative Color Prior. - Yanze Wu; Xintao Wang 002; Yu Li 003; Honglun Zhang; Xun Zhao; Ying Shan (ICCV, 2021)

Crossover Learning for Fast Online Video Instance Segmentation. - Shusheng Yang; Yuxin Fang; Xinggang Wang; Yu Li 003; Chen Fang; Ying Shan; Bin Feng 001; Wenyu Liu 001 (ICCV, 2021)

Enforcing Temporal Consistency in Video Depth Estimation. - Siyuan Li; Yue Luo; Ye Zhu 003; Xun Zhao; Yu Li 003; Ying Shan (ICCVW, 2021)

Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data. - Xintao Wang 002; Liangbin Xie; Chao Dong 005; Ying Shan (ICCVW, 2021)

Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization. - Fa-Ting Hong; Jia-Chang Feng; Dan Xu 002; Ying Shan; Wei-Shi Zheng 001 (ACM Multimedia, 2021)

TransFusion: Multi-Modal Fusion for Video Tag Inference via Translation-based Knowledge Embedding. - Di Jin 003; Zhongang Qi; Yingmin Luo; Ying Shan (ACM Multimedia, 2021)

Semantic-Guided Relation Propagation Network for Few-shot Action Recognition. - Xiao Wang 001; Weirong Ye; Zhongang Qi; Xun Zhao; Guangge Wang; Ying Shan; Hanzi Wang (ACM Multimedia, 2021)

Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution. - Liangbin Xie; Xintao Wang 002; Chao Dong 005; Zhongang Qi; Ying Shan (NeurIPS, 2021)

A Generic Object Re-identification System for Short Videos. - Tairu Qiu; Guanxian Chen; Zhongang Qi; Bin Li 015; Ying Shan; Xiangyang Xue 001 (CoRR, 2021)

Tracking Instances as Queries. - Shusheng Yang; Yuxin Fang; Xinggang Wang; Yu Li 003; Ying Shan; Bin Feng 001; Wenyu Liu 001 (CoRR, 2021)

Dynamic Token Normalization Improves Vision Transformer. - Wenqi Shao; Yixiao Ge; Zhaoyang Zhang 004; Xuyuan Xu; Xiaogang Wang 001; Ying Shan; Ping Luo 002 (CoRR, 2021)

High-Accuracy Guide Star Catalogue Generation with a Machine Learning Classification Algorithm. - Jianming Zhang 004; Junxiang Lian; Zhaoxiang Yi; Shuwang Yang; Ying Shan (Sensors, 2021)

Robust Human Matting via Semantic Guidance. - Xiangguang Chen; Ye Zhu 003; Yu Li 003; Bingtao Fu; Lei Sun 009; Ying Shan; Shan Liu 001 (ACCV (2), 2022)

Bridging Video-text Retrieval with Multiple Choice Questions. - Yuying Ge; Yixiao Ge; Xihui Liu; Dian Li; Ying Shan; Xiaohu Qie; Ping Luo 002 (CVPR, 2022)

UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection. - Ye Liu 002; Siyuan Li; Yang Wu 001; Chang Wen Chen; Ying Shan; Xiaohu Qie (CVPR, 2022)

Object-aware Video-language Pre-training for Retrieval. - Alex Jinpeng Wang; Yixiao Ge; Guanyu Cai; Rui Yan 001; Xudong Lin 003; Ying Shan; Xiaohu Qie; Mike Zheng Shou (CVPR, 2022)

VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolution. - Liangbin Xie; Xintao Wang 002; Honglun Zhang; Chao Dong 005; Ying Shan (CVPR Workshops, 2022)

BTS: A Bi-lingual Benchmark for Text Segmentation in the Wild. - Xixi Xu; Zhongang Qi; Jianqi Ma; Honglun Zhang; Ying Shan; Xiaohu Qie (CVPR, 2022)

Temporally Efficient Vision Transformer for Video Instance Segmentation. - Shusheng Yang; Xinggang Wang; Yu Li 003; Yuxin Fang; Jiemin Fang; Wenyu Liu 001; Xun Zhao; Ying Shan (CVPR, 2022)

MILES: Visual BERT Pre-training with Injected Language Semantics for Video-Text Retrieval. - Yuying Ge; Yixiao Ge; Xihui Liu; Jinpeng Wang 001; Jianping Wu; Ying Shan; Xiaohu Qie; Ping Luo 002 (ECCV (35), 2022)

VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder. - Yuchao Gu; Xintao Wang 002; Liangbin Xie; Chao Dong 005; Gen Li 011; Ying Shan; Ming-Ming Cheng (ECCV (18), 2022)

mc-BEiT: Multi-choice Discretization for Image BERT Pre-training. - Xiaotong Li; Yixiao Ge; Kun Yi; Zixuan Hu; Ying Shan; Ling-Yu Duan (ECCV (30), 2022)

Metric Learning Based Interactive Modulation for Real-World Super-Resolution. - Chong Mou; Yanze Wu; Xintao Wang 002; Chao Dong 005; Jian Zhang 018; Ying Shan (ECCV (17), 2022)

Not All Models Are Equal: Predicting Model Transferability in a Self-challenging Fisher Space. - Wenqi Shao; Xun Zhao; Yixiao Ge; Zhaoyang Zhang 004; Lei Yang 059; Xiaogang Wang 001; Ying Shan; Ping Luo 002 (ECCV (34), 2022)

Audio-To-Symbolic Arrangement Via Cross-Modal Music Representation Learning. - Ziyu Wang 008; Dejing Xu; Gus Xia; Ying Shan (ICASSP, 2022)

Uncertainty Modeling for Out-of-Distribution Generalization. - Xiaotong Li; Yongxing Dai; Yixiao Ge; Jun Liu 036; Ying Shan; Lingyu Duan (ICLR, 2022)

Dynamic Token Normalization improves Vision Transformers. - Wenqi Shao; Yixiao Ge; Zhaoyang Zhang 004; Xuyuan Xu; Xiaogang Wang 001; Ying Shan; Ping Luo 002 (ICLR, 2022)

Hot-Refresh Model Upgrades with Regression-Free Compatible Training in Image Retrieval. - Binjie Zhang; Yixiao Ge; Yantao Shen 003; Yu Li 003; Chun Yuan; Xuyuan Xu; Yexin Wang; Ying Shan (ICLR, 2022)

Convolutional Transformer with Similarity-based Boundary Prediction for Action Segmentation. - Dazhao Du; Bing Su; Yu Li 003; Zhongang Qi; Lingyu Si; Ying Shan (ICTAI, 2022)

Towards Universal Backward-Compatible Representation Learning. - Binjie Zhang; Yixiao Ge; Yantao Shen 003; Shupeng Su; Fanzi Wu; Chun Yuan; Xuyuan Xu; Yexin Wang; Ying Shan (IJCAI, 2022)

A Hierarchical Speaker Representation Framework for One-shot Singing Voice Conversion. - Xu Li 015; Shansong Liu; Ying Shan (INTERSPEECH, 2022)

PC-Dance: Posture-controllable Music-driven Dance Synthesis. - Jibin Gao; Junfu Pu; Honglun Zhang; Ying Shan; Wei-Shi Zheng 001 (ACM Multimedia, 2022)

RepSR: Training Efficient VGG-style Super-Resolution Networks with Structural Re-Parameterization and Batch Normalization. - Xintao Wang 002; Chao Dong 005; Ying Shan (ACM Multimedia, 2022)

DeVRF: Fast Deformable Voxel Radiance Fields for Dynamic Scenes. - Jiawei Liu; Yan-Pei Cao; Weijia Mao; Wenqiao Zhang; David Junhao Zhang; Jussi Keppo; Ying Shan; Xiaohu Qie; Mike Zheng Shou (NeurIPS, 2022)

AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos. - Yanze Wu; Xintao Wang 002; Gen Li 011; Ying Shan (NeurIPS, 2022)

BridgeFormer: Bridging Video-text Retrieval with Multiple Choice Questions. - Yuying Ge; Yixiao Ge; Xihui Liu; Dian Li; Ying Shan; Xiaohu Qie; Ping Luo 002 (CoRR, 2022)

Hot-Refresh Model Upgrades with Regression-Alleviating Compatible Training in Image Retrieval. - Binjie Zhang; Yixiao Ge; Yantao Shen 003; Yu Li 003; Chun Yuan; Xuyuan Xu; Yexin Wang; Ying Shan (CoRR, 2022)

All in One: Exploring Unified Video-Language Pre-training. - Alex Jinpeng Wang; Yixiao Ge; Rui Yan 001; Yuying Ge; Xudong Lin 003; Guanyu Cai; Jianping Wu; Ying Shan; Xiaohu Qie; Mike Zheng Shou (CoRR, 2022)

Revitalize Region Feature for Democratizing Video-Language Pre-training. - Guanyu Cai; Yixiao Ge; Alex Jinpeng Wang; Rui Yan 001; Xudong Lin 003; Ying Shan; Lianghua He; Xiaohu Qie; Jianping Wu; Mike Zheng Shou (CoRR, 2022)

CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation. - Ziqi Zhang; Yuxin Chen; Zongyang Ma; Zhongang Qi; Chunfeng Yuan; Bing Li 001; Ying Shan; Weiming Hu (CoRR, 2022)

MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval. - Yuying Ge; Yixiao Ge; Xihui Liu; Alex Jinpeng Wang; Jianping Wu; Ying Shan; Xiaohu Qie; Ping Luo 002 (CoRR, 2022)

Privacy-Preserving Model Upgrades with Bidirectional Compatible Training in Image Retrieval. - Shupeng Su; Binjie Zhang; Yixiao Ge; Xuyuan Xu; Yexin Wang; Chun Yuan; Ying Shan (CoRR, 2022)

Efficient U-Transformer with Boundary-Aware Loss for Action Segmentation. - Dazhao Du; Bing Su; Yu Li 003; Zhongang Qi; Lingyu Si; Ying Shan (CoRR, 2022)

Weakly-supervised Action Localization via Hierarchical Mining. - Jia-Chang Feng; Fa-Ting Hong; Jia-Run Du; Zhongang Qi; Ying Shan; Xiaohu Qie; Wei-Shi Zheng 001; Jianping Wu (CoRR, 2022)

Self-Supervised Learning of Music-Dance Representation through Explicit-Implicit Rhythm Synchronization. - Jiashuo Yu; Junfu Pu; Ying Cheng 005; Rui Feng 001; Ying Shan (CoRR, 2022)

Music-driven Dance Regeneration with Controllable Key Pose Constraints. - Junfu Pu; Ying Shan (CoRR, 2022)

MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priors. - Zi-Xin Zou; Shi-Sheng Huang; Yan-Pei Cao; Tai-Jiang Mu; Ying Shan; Hongbo Fu 001 (CoRR, 2022)

Vis2Mus: Exploring Multimodal Representation Mapping for Controllable Music Generation. - Runbang Zhang; Yixiao Zhang 002; Kai Shao; Ying Shan; Gus Xia (CoRR, 2022)

Latent Video Diffusion Models for High-Fidelity Video Generation with Arbitrary Lengths. - Yingqing He; Tianyu Yang 003; Yong Zhang 034; Ying Shan; Qifeng Chen (CoRR, 2022)

Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis. - Yuchao Gu; Xintao Wang 002; Yixiao Ge; Ying Shan; Xiaohu Qie; Mike Zheng Shou (CoRR, 2022)

Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation. - Jay Zhangjie Wu; Yixiao Ge; Xintao Wang 002; Weixian Lei; Yuchao Gu; Wynne Hsu; Ying Shan; Xiaohu Qie; Mike Zheng Shou (CoRR, 2022)

Hybrid Warping Fusion for Video Frame Interpolation. - Yu Li 003; Ye Zhu 003; Ruoteng Li; Xintao Wang 002; Yue Luo; Ying Shan (Int. J. Comput. Vis., 2022)

Depth-Aware Shadow Removal. - Yanping Fu; Zhenyu Gai; Haifeng Zhao 001; Shaojie Zhang 002; Ying Shan; Yang Wu 001; Jin Tang 001 (Comput. Graph. Forum, 2022)

Tagging before Alignment: Integrating Multi-Modal Tags for Video-Text Retrieval. - Yizhen Chen; Jie Wang; Lijian Lin; Zhongang Qi; Jin Ma 003; Ying Shan (AAAI, 2023)

Accelerating the Training of Video Super-resolution Models. - Lijian Lin; Xintao Wang 002; Zhongang Qi; Ying Shan (AAAI, 2023)

Mitigating Artifacts in Real-World Video Super-resolution Models. - Liangbin Xie; Xintao Wang 002; Shuwei Shi; Jinjin Gu; Chao Dong 005; Ying Shan (AAAI, 2023)

What Does Your Face Sound Like? 3D Face Shape towards Voice. - Zhihan Yang; Zhiyong Wu 001; Ying Shan; Jia Jia 001 (AAAI, 2023)

Darwinian Model Upgrades: Model Evolving with Selective Compatibility. - Binjie Zhang; Shupeng Su; Yixiao Ge; Xuyuan Xu; Yexin Wang; Chun Yuan; Mike Zheng Shou; Ying Shan (AAAI, 2023)

DSRM: Boost Textual Adversarial Training with Distribution Shift Risk Minimization. - Songyang Gao; Shihan Dou; Yan Liu 002; Xiao Wang 001; Qi Zhang 001; Zhongyu Wei; Jin Ma 003; Ying Shan (ACL (1), 2023)

On the Universal Adversarial Perturbations for Efficient Data-free Adversarial Detection. - Songyang Gao; Shihan Dou; Qi Zhang 001; Xuanjing Huang 001; Jin Ma 003; Ying Shan (ACL (Findings), 2023)

A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition. - Limao Xiong; Jie Zhou 012; Qunxi Zhu; Xiao Wang 001; Yuanbin Wu; Qi Zhang 001; Tao Gui; Xuanjing Huang 001; Jin Ma 003; Ying Shan (ACL (Findings), 2023)

Characterizing the Impacts of Instances on Robustness. - Rui Zheng; Zhiheng Xi; Qin Liu 010; Wenbin Lai; Tao Gui; Qi Zhang 001; Xuanjing Huang 001; Jin Ma 003; Ying Shan; Weifeng Ge (ACL (Findings), 2023)

SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes. - Yiming Gao 007; Yan-Pei Cao; Ying Shan (CVPR, 2023)

HRDFuse: Monocular 360° Depth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributions. - Hao Ai; Zidong Cao; Yan-Pei Cao; Ying Shan; Lin Wang 025 (CVPR, 2023)

High-fidelity Facial Avatar Reconstruction from Monocular Video with Generative Priors. - Yunpeng Bai; Yanbo Fan; Xuan Wang 009; Yong Zhang 034; Jingxiang Sun; Chun Yuan; Ying Shan (CVPR, 2023)

NTIRE 2023 Challenge on 360° Omnidirectional Image and Video Super-Resolution: Datasets, Methods and Results. - Mingdeng Cao; Chong Mou; Fanghua Yu; Xintao Wang 002; Yinqiang Zheng; Jian Zhang 018; Chao Dong 005; Gen Li 011; Ying Shan; Radu Timofte; Xiaopeng Sun; Weiqi Li; et al. (CVPR Workshops, 2023)

Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields. - Yue Chen; Xingyu Chen; Xuan Wang 009; Qi Zhang 029; Yu Guo 006; Ying Shan; Fei Wang 008 (CVPR, 2023)

ViLEM: Visual-Language Error Modeling for Image-Text Retrieval. - Yuxin Chen; Zongyang Ma; Ziqi Zhang; Zhongang Qi; Chunfeng Yuan; Ying Shan; Bing Li 001; Weiming Hu; Xiaohu Qie; Jianping Wu (CVPR, 2023)

Improved Test-Time Adaptation for Domain Generalization. - Liang Chen; Yong Zhang 034; Yibing Song; Ying Shan; Lingqiao Liu (CVPR, 2023)

DPE: Disentanglement of Pose and Expression for General Video Portrait Editing. - Youxin Pang; Yong Zhang 034; Weize Quan; Yanbo Fan; Xiaodong Cun; Ying Shan; Dong-Ming Yan 001 (CVPR, 2023)

All in One: Exploring Unified Video-Language Pre-Training. - Jinpeng Wang 001; Yixiao Ge; Rui Yan 001; Yuying Ge; Kevin Qinghong Lin; Satoshi Tsutsui; Xudong Lin 003; Guanyu Cai; Jianping Wu; Ying Shan; Xiaohu Qie; Mike Zheng Shou (CVPR, 2023)

Accelerating Vision-Language Pretraining with Free Language Modeling. - Teng Wang; Yixiao Ge; Feng Zheng; Ran Cheng; Ying Shan; Xiaohu Qie; Ping Luo 002 (CVPR, 2023)

DropMAE: Masked Autoencoders with Spatial-Attention Dropout for Tracking Tasks. - Qiangqiang Wu; Tianyu Yang 003; Ziquan Liu; Baoyuan Wu; Ying Shan; Antoni B. Chan (CVPR, 2023)

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models. - Jiale Xu; Xintao Wang 002; Weihao Cheng 002; Yan-Pei Cao; Ying Shan; Xiaohu Qie; Shenghua Gao (CVPR, 2023)

RILS: Masked Visual Reconstruction in Language Semantic Space. - Shusheng Yang; Yixiao Ge; Kun Yi; Dian Li; Ying Shan; Xiaohu Qie; Xinggang Wang (CVPR, 2023)

3D GAN Inversion with Facial Symmetry Prior. - Fei Yin; Yong Zhang 034; Xuan Wang 009; Tengfei Wang 002; Xiaoyu Li 002; Yuan Gong 002; Yanbo Fan; Xiaodong Cun; Ying Shan; Cengiz Öztireli; Yujiu Yang (CVPR, 2023)

OSRT: Omnidirectional Image Super-Resolution with Distortion-aware Transformer. - Fanghua Yu; Xintao Wang 002; Mingdeng Cao; Gen Li 011; Ying Shan; Chao Dong 005 (CVPR, 2023)

SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation. - Wenxuan Zhang; Xiaodong Cun; Xuan Wang 009; Yong Zhang 034; Xi Shen; Yu Guo 006; Ying Shan; Fei Wang 008 (CVPR, 2023)

Skinned Motion Retargeting with Residual Perception of Motion Semantics & Geometry. - Jiaxu Zhang; Junwu Weng; Di Kang; Fang Zhao 006; Shaoli Huang; Xuefei Zhe; Linchao Bao; Ying Shan; Jue Wang 001; Zhigang Tu 001 (CVPR, 2023)

Learning Anchor Transformations for 3D Garment Animation. - Fang Zhao 006; Zekun Li 002; Shaoli Huang; Junwu Weng; Tianfei Zhou; Guo-Sen Xie; Jue Wang 001; Ying Shan (CVPR, 2023)

LayoutDiffusion: Controllable Diffusion Model for Layout-to-Image Generation. - Guangcong Zheng; Xianpan Zhou; Xuewei Li 003; Zhongang Qi; Ying Shan; Xi Li 001 (CVPR, 2023)

ERBNet: An Effective Representation Based Network for Unbiased Scene Graph Generation. - Wenxi Ma; Tianxiang Hou; Qianji Di; Zhongang Qi; Ying Shan; Hanzi Wang (ICASSP, 2023)

Enhancing the Vocal Range of Single-Speaker Singing Voice Synthesis with Melody-Unsupervised Pre-Training. - Shaohuan Zhou; Xu Li 015; Zhiyong Wu 001; Ying Shan; Helen Meng (ICASSP, 2023)

OmniZoomer: Learning to Move and Zoom in on Sphere at High-Resolution. - Zidong Cao; Hao Ai; Yan-Pei Cao; Ying Shan; Xiaohu Qie; Lin Wang 025 (ICCV, 2023)

MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editing. - Mingdeng Cao; Xintao Wang 002; Zhongang Qi; Ying Shan; Xiaohu Qie; Yinqiang Zheng (ICCV, 2023)

Unleashing Vanilla Vision Transformer with Masked Image Modeling for Object Detection. - Yuxin Fang; Shusheng Yang; Shijie Wang 007; Yixiao Ge; Ying Shan; Xinggang Wang (ICCV, 2023)

Exploring Model Transferability through the Lens of Potential Energy. - Xiaotong Li; Zixuan Hu; Yixiao Ge; Ying Shan; Ling-Yu Duan (ICCV, 2023)

HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video. - Jia-Wei Liu; Yan-Pei Cao; Tianyuan Yang; Zhongcong Xu; Jussi Keppo; Ying Shan; Xiaohu Qie; Mike Zheng Shou (ICCV, 2023)

Order-Prompted Tag Sequence Generation for Video Tagging. - Zongyang Ma; Ziqi Zhang; Yuxin Chen; Zhongang Qi; Yingmin Luo; Zekun Li 006; Chunfeng Yuan; Bing Li 001; Xiaohu Qie; Ying Shan; Weiming Hu (ICCV, 2023)

FateZero: Fusing Attentions for Zero-shot Text-based Video Editing. - Chenyang Qi; Xiaodong Cun; Yong Zhang 034; Chenyang Lei; Xintao Wang 002; Ying Shan; Qifeng Chen (ICCV, 2023)

Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation. - Jay Zhangjie Wu; Yixiao Ge; Xintao Wang 002; Stan Weixian Lei; Yuchao Gu; Yufei Shi 003; Wynne Hsu; Ying Shan; Xiaohu Qie; Mike Zheng Shou (ICCV, 2023)

Speech2Lip: High-fidelity Speech to Lip Generation by Learning from a Short Video. - Xiuzhe Wu; Pengfei Hu; Yang Wu 001; Xiaoyang Lyu; Yan-Pei Cao; Ying Shan; Wenming Yang; Zhongqian Sun; Xiaojuan Qi 001 (ICCV, 2023)

Masked Image Modeling with Denoising Contrast. - Kun Yi; Yixiao Ge; Xiaotong Li; Shusheng Yang; Dian Li; Jianping Wu; Ying Shan; Xiaohu Qie (ICLR, 2023)

Do We Really Need Temporal Convolutions in Action Segmentation? - Dazhao Du; Bing Su; Yu Li 003; Zhongang Qi; Lingyu Si; Ying Shan (ICME, 2023)

π-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation. - Chengyue Wu; Teng Wang; Yixiao Ge; Zeyu Lu; Ruisong Zhou; Ying Shan; Ping Luo 002 (ICML, 2023)

DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Models. - Liangbin Xie; Xintao Wang 002; Xiangyu Chen 006; Gen Li 011; Ying Shan; Jiantao Zhou 001; Chao Dong 005 (ICML, 2023)

SGAT4PASS: Spherical Geometry-Aware Transformer for PAnoramic Semantic Segmentation. - Xuewei Li 003; Tao Wu; Zhongang Qi; Gaoang Wang; Ying Shan; Xi Li 001 (IJCAI, 2023)

Prosody Modeling with 3D Visual Information for Expressive Video Dubbing. - Zhihan Yang; Shansong Liu; Xu Li 015; Haozhe Wu; Zhiyong Wu 001; Ying Shan; Jia Jia 001 (INTERSPEECH, 2023)

Binary Embedding-based Retrieval at Tencent. - Yukang Gan; Yixiao Ge; Chang Zhou; Shupeng Su; Zhouchuan Xu; Xuyuan Xu; Quanchao Hui; Xiang Chen; Yexin Wang; Ying Shan (KDD, 2023)

Toward Human Perception-Centric Video Thumbnail Generation. - Tao Yang; Fan Wang; Junfan Lin; Zhongang Qi; Yang Wu 001; Jing Xu; Ying Shan; Changwen Chen (ACM Multimedia, 2023)

VTLayout: A Multi-Modal Approach for Video Text Layout. - Yuxuan Zhao; Jin Ma 003; Zhongang Qi; Zehua Xie; Yu Luo; Qiusheng Kang; Ying Shan (ACM Multimedia, 2023)

PanoGRF: Generalizable Spherical Radiance Fields for Wide-baseline Panoramas. - Zheng Chen 016; Yan-Pei Cao; Yuan-Chen Guo; Chen Wang 049; Ying Shan; Song-Hai Zhang (NeurIPS, 2023)

Meta-Adapter: An Online Few-shot Learner for Vision-Language Model. - Cheng Cheng; Lin Song 002; Ruoyi Xue; Hang Wang; Hongbin Sun 001; Yixiao Ge; Ying Shan (NeurIPS, 2023)

Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models. - Yuchao Gu; Xintao Wang 002; Jay Zhangjie Wu; Yujun Shi; Yunpeng Chen; Zihan Fan; Wuyou Xiao; Rui Zhao 001; Shuning Chang; Weijia Wu 001; Yixiao Ge; Ying Shan; et al. (NeurIPS, 2023)

CL-NeRF: Continual Learning of Neural Radiance Fields for Evolving Scene Representation. - Xiuzhe Wu; Peng Dai 003; Weipeng Deng; Handi Chen; Yang Wu 001; Yan-Pei Cao; Ying Shan; Xiaojuan Qi 001 (NeurIPS, 2023)

GPT4Tools: Teaching Large Language Model to Use Tools via Self-instruction. - Rui Yang 010; Lin Song 002; Yanwei Li; Sijie Zhao; Yixiao Ge; Xiu Li 001; Ying Shan (NeurIPS, 2023)

Exploiting Contextual Objects and Relations for 3D Visual Grounding. - Li Yang; Chunfeng Yuan; Ziqi Zhang; Zhongang Qi; Yan Xu; Wei Liu 153; Ying Shan; Bing Li 001; Weiping Yang; Peng Li; Yan Wang; Weiming Hu (NeurIPS, 2023)

Inserting Anybody in Diffusion Models via Celeb Basis. - Ge Yuan; Xiaodong Cun; Yong Zhang 034; Maomao Li; Chenyang Qi; Xintao Wang 002; Ying Shan; Huicheng Zheng (NeurIPS, 2023)

NeRF-Texture: Texture Synthesis with Neural Radiance Fields. - Yihua Huang 002; Yan-Pei Cao; Yu-Kun Lai; Ying Shan; Lin Gao 004 (SIGGRAPH (Conference Paper Track), 2023)

NOFA: NeRF-based One-shot Facial Avatar Reconstruction. - Wangbo Yu; Yanbo Fan; Yong Zhang 034; Xuan Wang 009; Fei Yin; Yunpeng Bai; Yan-Pei Cao; Ying Shan; Yang Wu 001; Zhongqian Sun; Baoyuan Wu (SIGGRAPH (Conference Paper Track), 2023)

Interactive Story Visualization with Multiple Characters. - Yuan Gong 002; Youxin Pang; Xiaodong Cun; Menghan Xia; Yingqing He; Haoxin Chen; Longyue Wang; Yong Zhang 034; Xintao Wang 002; Ying Shan; Yujiu Yang (SIGGRAPH Asia, 2023)

VMesh: Hybrid Volume-Mesh Representation for Efficient View Synthesis. - Yuan-Chen Guo; Yan-Pei Cao; Chen Wang 049; Yu He; Ying Shan; Song-Hai Zhang (SIGGRAPH Asia, 2023)

Neural Point-based Volumetric Avatar: Surface-guided Neural Points for Efficient and Photorealistic Volumetric Head Avatar. - Cong Wang 045; Di Kang; Yan-Pei Cao; Linchao Bao; Ying Shan; Song-Hai Zhang (SIGGRAPH Asia, 2023)

Anti-Aliased Neural Implicit Surfaces with Encoding Level of Detail. - Yiyu Zhuang; Qi Zhang 029; Ying Feng; Hao Zhu 004; Yao Yao 008; Xiaoyu Li 002; Yan-Pei Cao; Ying Shan; Xun Cao (SIGGRAPH Asia, 2023)

Masked Visual Reconstruction in Language Semantic Space. - Shusheng Yang; Yixiao Ge; Kun Yi; Dian Li; Ying Shan; Xiaohu Qie; Xinggang Wang (CoRR, 2023)

T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models. - Chong Mou; Xintao Wang 002; Liangbin Xie; Jian Zhang 018; Zhongang Qi; Ying Shan; Xiaohu Qie (CoRR, 2023)

HMC: Hierarchical Mesh Coarsening for Skeleton-free Motion Retargeting. - Haoyu Wang; Shaoli Huang; Fang Zhao 006; Chun Yuan; Ying Shan (CoRR, 2023)

BoPR: Body-aware Part Regressor for Human Shape and Pose Estimation. - Yongkang Cheng; Shaoli Huang; Jifeng Ning; Ying Shan (CoRR, 2023)

VMesh: Hybrid Volume-Mesh Representation for Efficient View Synthesis. - Yuan-Chen Guo; Yan-Pei Cao; Chen Wang 049; Yu He; Ying Shan; Xiaohu Qie; Song-Hai Zhang (CoRR, 2023)

Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videos. - Yue Ma; Yingqing He; Xiaodong Cun; Xintao Wang 002; Ying Shan; Xiu Li 001; Qifeng Chen (CoRR, 2023)

TagGPT: Large Language Models are Zero-shot Multimodal Taggers. - Chen Li 046; Yixiao Ge; Jiayong Mao; Dian Li; Ying Shan (CoRR, 2023)

NeAI: A Pre-convoluted Representation for Plug-and-Play Neural Ambient Illumination. - Yiyu Zhuang; Qi Zhang 029; Xuan Wang 009; Hao Zhu 004; Ying Feng; Xiaoyu Li 002; Ying Shan; Xun Cao (CoRR, 2023)

HOSNeRF: Dynamic Human-Object-Scene Neural Radiance Fields from a Single Video. - Jiawei Liu; Yan-Pei Cao; Tianyuan Yang; Eric Zhongcong Xu; Jussi Keppo; Ying Shan; Xiaohu Qie; Mike Zheng Shou (CoRR, 2023)

SparseGNV: Generating Novel Views of Indoor Scenes with Sparse Input Views. - Weihao Cheng 002; Yan-Pei Cao; Ying Shan (CoRR, 2023)

What Makes for Good Visual Tokenizers for Large Language Models? - Guangzhi Wang; Yixiao Ge; Xiaohan Ding; Mohan S. Kankanhalli; Ying Shan (CoRR, 2023)

A Confidence-based Partial Label Learning Model for Crowd-Annotated Named Entity Recognition. - Limao Xiong; Jie Zhou 015; Qunxi Zhu; Xiao Wang 001; Yuanbin Wu; Qi Zhang 001; Tao Gui; Xuanjing Huang 001; Jin Ma 003; Ying Shan (CoRR, 2023)

TVTSv2: Learning Out-of-the-box Spatiotemporal Visual Representations at Scale. - Ziyun Zeng; Yixiao Ge; Zhan Tong; Xihui Liu; Shu-Tao Xia; Ying Shan (CoRR, 2023)

TaleCrafter: Interactive Story Visualization with Multiple Characters. - Yuan Gong 002; Youxin Pang; Xiaodong Cun; Menghan Xia; Yingqing He; Haoxin Chen; Longyue Wang; Yong Zhang 034; Xintao Wang 002; Ying Shan; Yujiu Yang (CoRR, 2023)

Sticker820K: Empowering Interactive Retrieval with Stickers. - Sijie Zhao; Yixiao Ge; Zhongang Qi; Lin Song 002; Xiaohan Ding; Zehua Xie; Ying Shan (CoRR, 2023)

InstructP2P: Learning to Edit 3D Point Clouds with Text Instructions. - Jiale Xu; Xintao Wang 002; Yan-Pei Cao; Weihao Cheng 002; Ying Shan; Shenghua Gao (CoRR, 2023)

TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter. - Binjie Zhang; Yixiao Ge; Xuyuan Xu; Ying Shan; Mike Zheng Shou (CoRR, 2023)

Towards Unseen Triples: Effective Text-Image-joint Learning for Scene Graph Generation. - Qianji Di; Wenxi Ma; Zhongang Qi; Tianxiang Hou; Ying Shan; Hanzi Wang (CoRR, 2023)

PTVD: A Large-Scale Plot-Oriented Multimodal Dataset Based on Television Dramas. - Chen Li 046; Xutan Peng; Teng Wang; Yixiao Ge; Mengyang Liu; Xuyuan Xu; Yexin Wang; Ying Shan (CoRR, 2023)

DreamDiffusion: Generating High-Quality Images from Brain EEG Signals. - Yunpeng Bai; Xintao Wang 002; Yan-Pei Cao; Yixiao Ge; Chun Yuan; Ying Shan (CoRR, 2023)

ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models. - Weihao Cheng 002; Yan-Pei Cao; Ying Shan (CoRR, 2023)

Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation. - Yingqing He; Menghan Xia; Haoxin Chen; Xiaodong Cun; Yuan Gong 002; Jinbo Xing; Yong Zhang 034; Xintao Wang 002; Chao Weng; Ying Shan; Qifeng Chen (CoRR, 2023)

Planting a SEED of Vision in Large Language Model. - Yuying Ge; Yixiao Ge; Ziyun Zeng; Xintao Wang 002; Ying Shan (CoRR, 2023)

GET3D-: Learning GET3D from Unconstrained Image Collections. - Fanghua Yu; Xintao Wang 002; Zheyuan Li; Yan-Pei Cao; Ying Shan; Chao Dong 005 (CoRR, 2023)

SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension. - Bohao Li 002; Rui Wang 092; Guangzhi Wang; Yuying Ge; Yixiao Ge; Ying Shan (CoRR, 2023)

Guide3D: Create 3D Avatars from Text and Image Guidance. - Yukang Cao; Yan-Pei Cao; Kai Han 001; Ying Shan; Kwan-Yee K. Wong (CoRR, 2023)

ViT-Lens: Towards Omni-modal Representations. - Weixian Lei; Yixiao Ge; Jianfeng Zhang; Dylan Sun 001; Kun Yi; Ying Shan; Mike Zheng Shou (CoRR, 2023)

StyleAdapter: A Single-Pass LoRA-Free Model for Stylized Image Generation. - Zhouxia Wang; Xintao Wang 002; Liangbin Xie; Zhongang Qi; Ying Shan; Wenping Wang 001; Ping Luo 002 (CoRR, 2023)

One For All: Video Conversation is Feasible Without Video Instruction Tuning. - Ruyang Liu; Chen Li 046; Yixiao Ge; Ying Shan; Thomas H. Li; Ge Li 002 (CoRR, 2023)

HiFi-123: Towards High-fidelity One Image to 3D Content Generation. - Wangbo Yu; Li Yuan 007; Yan-Pei Cao; Xiangjun Gao; Xiaoyu Li 002; Long Quan; Ying Shan; Yonghong Tian 001 (CoRR, 2023)

DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing. - Jiawei Liu; Yan-Pei Cao; Jay Zhangjie Wu; Weijia Mao; Yuchao Gu; Rui Zhao 001; Jussi Keppo; Ying Shan; Mike Zheng Shou (CoRR, 2023)

DynamiCrafter: Animating Open-domain Images with Video Diffusion Priors. - Jinbo Xing; Menghan Xia; Yong Zhang 034; Haoxin Chen; Xintao Wang 002; Tien-Tsin Wong; Ying Shan (CoRR, 2023)

VideoCrafter1: Open Diffusion Models for High-Quality Video Generation. - Haoxin Chen; Menghan Xia; Yingqing He; Yong Zhang 034; Xiaodong Cun; Shaoshu Yang; Jinbo Xing; Yaofang Liu; Qifeng Chen; Xintao Wang 002; Chao Weng; Ying Shan (CoRR, 2023)

CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models. - Ziyang Yuan; Mingdeng Cao; Xintao Wang 002; Zhongang Qi; Chun Yuan; Ying Shan (CoRR, 2023)

SemanticBoost: Elevating Motion Generation with Augmented Textual Cues. - Xin He; Shaoli Huang; Xiaohang Zhan; Chao Wen; Ying Shan (CoRR, 2023)

M2UGen: Multi-modal Music Understanding and Generation with the Power of Large Language Models. - Atin Sakkeer Hussain; Shansong Liu; Chenshuo Sun; Ying Shan (CoRR, 2023)

ViT-Lens-2: Gateway to Omni-modal Intelligence. - Weixian Lei; Yixiao Ge; Kun Yi; Jianfeng Zhang; Difei Gao; Dylan Sun 001; Yuying Ge; Ying Shan; Mike Zheng Shou (CoRR, 2023)

SEED-Bench-2: Benchmarking Multimodal Large Language Models. - Bohao Li 002; Yuying Ge; Yixiao Ge; Guangzhi Wang; Rui Wang 092; Ruimao Zhang; Ying Shan (CoRR, 2023)

StyleCrafter: Enhancing Stylized Text-to-Video Generation with Style Adapter. - Gongye Liu; Menghan Xia; Yong Zhang 034; Haoxin Chen; Jinbo Xing; Xintao Wang 002; Yujiu Yang; Ying Shan (CoRR, 2023)

MagicStick: Controllable Video Editing via Control Handle Transformations. - Yue Ma; Xiaodong Cun; Yingqing He; Chenyang Qi; Xintao Wang 002; Ying Shan; Xiu Li 001; Qifeng Chen (CoRR, 2023)

MotionCtrl: A Unified and Flexible Motion Controller for Video Generation. - Zhouxia Wang; Ziyang Yuan; Xintao Wang 002; Tianshui Chen; Menghan Xia; Ping Luo 002; Ying Shan (CoRR, 2023)

AnimateZero: Video Diffusion Models are Zero-Shot Image Animators. - Jiwen Yu; Xiaodong Cun; Chenyang Qi; Yong Zhang 034; Xintao Wang 002; Ying Shan; Jian Zhang 018 (CoRR, 2023)

AFL-Net: Integrating Audio, Facial, and Lip Modalities with Cross-Attention for Robust Speaker Diarization in the Wild. - Yongkang Yin; Xu Li 015; Ying Shan; Yuexian Zou (CoRR, 2023)

EgoPlan-Bench: Benchmarking Egocentric Embodied Planning with Multimodal Large Language Models. - Yi Chen 019; Yuying Ge; Yixiao Ge; Mingyu Ding; Bohao Li 002; Rui Wang 092; Ruifeng Xu 001; Ying Shan; Xihui Liu (CoRR, 2023)

VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation. - Jinguo Zhu; Xiaohan Ding; Yixiao Ge; Yuying Ge; Sijie Zhao; Hengshuang Zhao; Xiaohua Wang; Ying Shan (CoRR, 2023)

ACNet: Approaching-and-Centralizing Network for Zero-Shot Sketch-Based Image Retrieval. - Hao Ren 002; Ziqiang Zheng; Yang Wu 001; Hong Lu 001; Yang Yang 002; Ying Shan; Sai-Kit Yeung (IEEE Trans. Circuits Syst. Video Technol., 2023)

Task-Aware Dual-Representation Network for Few-Shot Action Recognition. - Xiao Wang 001; Weirong Ye; Zhongang Qi; Guangge Wang; Jianping Wu; Ying Shan; Xiaohu Qie; Hanzi Wang (IEEE Trans. Circuits Syst. Video Technol., 2023)

SparseGNV: Generating Novel Views of Indoor Scenes with Sparse RGB-D Images. - Weihao Cheng 002; Yan-Pei Cao; Ying Shan (AAAI, 2024)

SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy Views. - Shi-Sheng Huang; Zi-Xin Zou; Yichi Zhang; Yan-Pei Cao; Ying Shan (AAAI, 2024)

T2I-Adapter: Learning Adapters to Dig Out More Controllable Ability for Text-to-Image Diffusion Models. - Chong Mou; Xintao Wang 002; Liangbin Xie; Yanze Wu; Jian Zhang 018; Zhongang Qi; Ying Shan (AAAI, 2024)

SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model. - Tao Wu; Xuewei Li 003; Zhongang Qi; Di Hu; Xintao Wang 002; Ying Shan; Xi Li 001 (AAAI, 2024)

A Pre-convolved Representation for Plug-and-Play Neural Illumination Fields. - Yiyu Zhuang; Qi Zhang 029; Xuan Wang 009; Hao Zhu 004; Ying Feng; Xiaoyu Li 002; Ying Shan; Xun Cao (AAAI, 2024)

Sparse3D: Distilling Multiview-Consistent Diffusion for Object Reconstruction from Sparse Views. - Zixin Zou; Weihao Cheng 002; Yan-Pei Cao; Shi-Sheng Huang; Ying Shan; Song-Hai Zhang (AAAI, 2024)

LLaMA Pro: Progressive LLaMA with Block Expansion. - Chengyue Wu; Yukang Gan; Yixiao Ge; Zeyu Lu; Jiahao Wang; Ye Feng; Ying Shan; Ping Luo 002 (ACL (1), 2024)

Semantic Understanding in Natural Language Processing: Application of Graph Neural Networks in Relationship Extraction. - Ying Shan (CIPAE, 2024)

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models. - Yukang Cao; Yan-Pei Cao; Kai Han 001; Ying Shan; Kwan-Yee K. Wong (CVPR, 2024)

How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval? - Yuxin Chen; Zongyang Ma; Ziqi Zhang; Zhongang Qi; Chunfeng Yuan; Bing Li 001; Junfu Pu; Ying Shan; Xiaojuan Qi 001; Weiming Hu (CVPR, 2024)

VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models. - Haoxin Chen; Yong Zhang 034; Xiaodong Cun; Menghan Xia; Xintao Wang 002; Chao Weng; Ying Shan (CVPR, 2024)

YOLO-World: Real-Time Open-Vocabulary Object Detection. - Tianheng Cheng; Lin Song 002; Yixiao Ge; Wenyu Liu 001; Xinggang Wang; Ying Shan (CVPR, 2024)

UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition. - Xiaohan Ding; Yiyuan Zhang; Yixiao Ge; Sijie Zhao; Lin Song 002; Xiangyu Yue 001; Ying Shan (CVPR, 2024)

ConTex-Human: Free-View Rendering of Human from a Single Image with Texture-Consistent Synthesis. - Xiangjun Gao; Xiaoyu Li 002; Chaopeng Zhang; Qi Zhang 029; Yanpei Cao; Ying Shan; Long Quan (CVPR, 2024)

Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis. - Yuchao Gu; Xintao Wang 002; Yixiao Ge; Ying Shan; Mike Zheng Shou (CVPR, 2024)

SmartEdit: Exploring Complex Instruction-Based Image Editing with Multimodal Large Language Models. - Yuzhou Huang; Liangbin Xie; Xintao Wang 002; Ziyang Yuan; Xiaodong Cun; Yixiao Ge; Jiantao Zhou 001; Chao Dong 005; Rui Huang; Ruimao Zhang; Ying Shan (CVPR, 2024)

VIT-LENS: Towards Omni-modal Representations. - Weixian Lei; Yixiao Ge; Kun Yi; Jianfeng Zhang; Difei Gao; Dylan Sun 001; Yuying Ge; Ying Shan; Mike Zheng Shou (CVPR, 2024)

PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embedding. - Zhen Li 031; Mingdeng Cao; Xintao Wang 002; Zhongang Qi; Ming-Ming Cheng; Ying Shan (CVPR, 2024)

SEED-Bench: Benchmarking Multimodal Large Language Models. - Bohao Li 002; Yuying Ge; Yixiao Ge; Guangzhi Wang; Rui Wang 092; Ruimao Zhang; Ying Shan (CVPR, 2024)

GS-IR: 3D Gaussian Splatting for Inverse Rendering. - Zhihao Liang; Qi Zhang 029; Ying Feng; Ying Shan; Kui Jia (CVPR, 2024)

EvalCrafter: Benchmarking and Evaluating Large Video Generation Models. - Yaofang Liu; Xiaodong Cun; Xuebo Liu 002; Xintao Wang 002; Yong Zhang 034; Haoxin Chen; Yang Liu 005; Tieyong Zeng; Raymond Chan 001; Ying Shan (CVPR, 2024)

DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing. - Jia-Wei Liu; Yan-Pei Cao; Jay Zhangjie Wu; Weijia Mao; Yuchao Gu; Rui Zhao 001; Jussi Keppo; Ying Shan; Mike Zheng Shou (CVPR, 2024)

BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning. - Ruyang Liu; Chen Li 046; Yixiao Ge; Thomas H. Li; Ying Shan; Ge Li 002 (CVPR, 2024)

Programmable Motion Generation for Open-Set Motion Control Tasks. - Hanchao Liu; Xiaohang Zhan; Shaoli Huang; Tai-Jiang Mu; Ying Shan (CVPR, 2024)

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting. - Xian Liu; Xiaohang Zhan; Jiaxiang Tang; Ying Shan; Gang Zeng; Dahua Lin; Xihui Liu; Ziwei Liu 002 (CVPR, 2024)

DiffEditor: Boosting Accuracy and Flexibility on Diffusion-Based Image Editing. - Chong Mou; Xintao Wang 002; Jiechong Song; Ying Shan; Jian Zhang 018 (CVPR, 2024)

Low-Rank Approximation for Sparse Attention in Multi-Modal LLMs. - Lin Song 002; Yukang Chen; Shuai Yang; Xiaohan Ding; Yixiao Ge; Ying-Cong Chen; Ying Shan (CVPR, 2024)

Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities. - Yiyuan Zhang; Xiaohan Ding; Kaixiong Gong; Yixiao Ge; Ying Shan; Xiangyu Yue 001 (CVPR, 2024)

HumanRef: Single Image to 3D Human Generation via Reference-Guided Diffusion. - Jingbo Zhang 002; Xiaoyu Li 002; Qi Zhang 029; Yanpei Cao; Ying Shan; Jing Liao 001 (CVPR, 2024)

DreamDiffusion: High-Quality EEG-to-Image Generation with Temporal Masked Signal Modeling and CLIP Alignment. - Yunpeng Bai; Xintao Wang 002; Yan-Pei Cao; Yixiao Ge; Chun Yuan; Ying Shan (ECCV (31), 2024)

Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptation. - Lanqing Guo; Yingqing He; Haoxin Chen; Menghan Xia; Xiaodong Cun; Yufei Wang 006; Siyu Huang; Yong Zhang 034; Xintao Wang 002; Qifeng Chen; Ying Shan; Bihan Wen (ECCV (36), 2024)

Storytelling Video Generation with Retrieval Augmentation and Character Consistency. - Yingqing He; Menghan Xia; Haoxin Chen; Xiaodong Cun; Yuan Gong 002; Jinbo Xing; Yong Zhang 034; Xintao Wang 002; Chao Weng; Ying Shan; Qifeng Chen (ECCV Workshops (5), 2024)

BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion. - Xuan Ju; Xian Liu; Xintao Wang 002; Yuxuan Bian; Ying Shan; Qiang Xu 001 (ECCV (20), 2024)

ST-LLM: Large Language Models Are Effective Temporal Learners. - Ruyang Liu; Chen Li 046; Haoran Tang; Yixiao Ge; Ying Shan; Ge Li 002 (ECCV (57), 2024)

EA-VTR: Event-Aware Video-Text Retrieval. - Zongyang Ma; Ziqi Zhang; Yuxin Chen; Zhongang Qi; Chunfeng Yuan; Bing Li 001; Yingmin Luo; Xu Li 015; Xiaojuan Qi 001; Ying Shan; Weiming Hu (ECCV (52), 2024)

MOFA-Video: Controllable Image Animation via Generative Motion Field Adaptions in Frozen Image-to-Video Diffusion Model. - Muyao Niu; Xiaodong Cun; Xintao Wang 002; Yong Zhang 034; Ying Shan; Yinqiang Zheng (ECCV (19), 2024)

DynamiCrafter: Animating Open-Domain Images with Video Diffusion Priors. - Jinbo Xing; Menghan Xia; Yong Zhang 034; Hao Chen 011; Wangbo Yu; Hanyuan Liu; Gongye Liu; Xintao Wang 002; Ying Shan; Tien-Tsin Wong (ECCV (46), 2024)

Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing. - Tian-Xing Xu; Wenbo Hu 002; Yu-Kun Lai; Ying Shan; Song-Hai Zhang (ECCV (25), 2024)

Noise Calibration: Plug-and-Play Content-Preserving Video Enhancement Using Pre-trained Video Diffusion Models. - Qinyu Yang; Hao Chen 011; Yong Zhang 034; Menghan Xia; Xiaodong Cun; Zhixun Su; Ying Shan (ECCV (36), 2024)

DMiT: Deformable Mipmapped Tri-Plane Representation for Dynamic Scenes. - Jing-Wen Yang 002; Jia-Mu Sun; Yong-Liang Yang 002; Jie Yang 038; Ying Shan; Yan-Pei Cao; Lin Gao 004 (ECCV (55), 2024)

HiFi-123: Towards High-Fidelity One Image to 3D Content Generation. - Wangbo Yu; Li Yuan 007; Yan-Pei Cao; Xiangjun Gao; Xiaoyu Li 002; Wenbo Hu 002; Quan Long; Ying Shan; Yonghong Tian 001 (ECCV (73), 2024)

Music Understanding LLaMA: Advancing Text-to-Music Generation with Question Answering and Captioning. - Shansong Liu; Atin Sakkeer Hussain; Chenshuo Sun; Ying Shan (ICASSP, 2024)

Humtrans: A Novel Open-Source Dataset for Humming Melody Transcription and Beyond. - Shansong Liu; Xu Li 015; Dian Li; Ying Shan (ICASSP, 2024)

Unified Pretraining Target Based Video-Music Retrieval with Music Rhythm and Video Optical Flow Information. - Tianjun Mao; Shansong Liu; Yunxuan Zhang; Dian Li; Ying Shan (ICASSP, 2024)

Neural Concatenative Singing Voice Conversion: Rethinking Concatenation-Based Approach for One-Shot Singing Voice Conversion. - Binzhu Sha; Xu Li 015; Zhiyong Wu 001; Ying Shan; Helen Meng (ICASSP, 2024)

Making LLaMA SEE and Draw with SEED Tokenizer. - Yuying Ge; Sijie Zhao; Ziyun Zeng; Yixiao Ge; Chen Li 046; Xintao Wang 002; Ying Shan (ICLR, 2024)

ScaleCrafter: Tuning-free Higher-Resolution Visual Generation with Diffusion Models. - Yingqing He; Shaoshu Yang; Haoxin Chen; Xiaodong Cun; Menghan Xia; Yong Zhang 034; Xintao Wang 002; Ran He 001; Qifeng Chen; Ying Shan (ICLR, 2024)

DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Models. - Chong Mou; Xintao Wang 002; Jiechong Song; Ying Shan; Jian Zhang 018 (ICLR, 2024)

FreeNoise: Tuning-Free Longer Video Diffusion via Noise Rescheduling. - Haonan Qiu; Menghan Xia; Yong Zhang 034; Yingqing He; Xintao Wang 002; Ying Shan; Ziwei Liu 002 (ICLR, 2024)

TapMo: Shape-aware Motion Generation of Skeleton-free Characters. - Jiaxu Zhang; Shaoli Huang; Zhigang Tu 001; Xin Chen 040; Xiaohang Zhan; Gang Yu 002; Ying Shan (ICLR, 2024)

AFL-Net: Integrating Audio, Facial, and Lip Modalities with a Two-step Cross-attention for Robust Speaker Diarization in the Wild. - Yongkang Yin; Xu Li 015; Ying Shan; Yuexian Zou (INTERSPEECH, 2024)

SynopGround: A Large-Scale Dataset for Multi-Paragraph Video Grounding from TV Dramas and Synopses. - Chaolei Tan; Zihang Lin; Junfu Pu; Zhongang Qi; Wei-Yi Pei; Zhi Qu; Yexin Wang; Ying Shan; Wei-Shi Zheng 001; Jian-Fang Hu (ACM Multimedia, 2024)

CustomNet: Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models. - Ziyang Yuan; Mingdeng Cao; Xintao Wang 002; Zhongang Qi; Chun Yuan; Ying Shan (ACM Multimedia, 2024)

MiraData: A Large-Scale Video Dataset with Long Durations and Structured Captions. - Xuan Ju; Yiming Gao 007; Zhaoyang Zhang 004; Ziyang Yuan; Xintao Wang 002; Ailing Zeng; Yu Xiong; Qiang Xu 001; Ying Shan (NeurIPS, 2024)

E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding. - Ye Liu 002; Zongyang Ma; Zhongang Qi; Yang Wu 001; Ying Shan; Chang Wen Chen (NeurIPS, 2024)

ReVideo: Remake a Video with Motion and Content Control. - Chong Mou; Mingdeng Cao; Xintao Wang 002; Zhaoyang Zhang 004; Ying Shan; Jian Zhang 018 (NeurIPS, 2024)

MambaTree: Tree Topology is All You Need in State Space Model. - Yicheng Xiao; Lin Song 002; Shaoli Huang; Jiangshan Wang; Siyu Song; Yixiao Ge; Xiu Li 001; Ying Shan (NeurIPS, 2024)

CV-VAE: A Compatible Video VAE for Latent Generative Video Models. - Sijie Zhao; Yong Zhang 034; Xiaodong Cun; Shaoshu Yang; Muyao Niu; Xiaoyu Li 002; Wenbo Hu 002; Ying Shan (NeurIPS, 2024)

MotionCtrl: A Unified and Flexible Motion Controller for Video Generation. - Zhouxia Wang; Ziyang Yuan; Xintao Wang 002; Yaowei Li; Tianshui Chen; Menghan Xia; Ping Luo 002; Ying Shan (SIGGRAPH (Conference Paper Track), 2024)

RecDCL: Dual Contrastive Learning for Recommendation. - Dan Zhang; Yangliao Geng; Wenwen Gong; Zhongang Qi; Zhiyu Chen; Xing Tang 007; Ying Shan; Yuxiao Dong; Jie Tang 001 (WWW, 2024)

Towards A Better Metric for Text-to-Video Generation. - Jay Zhangjie Wu; Guian Fang; Haoning Wu 001; Xintao Wang 002; Yixiao Ge; Xiaodong Cun; David Junhao Zhang; Jia-Wei Liu; Yuchao Gu; Rui Zhao 001; Weisi Lin; Wynne Hsu; et al. (CoRR, 2024)

Supervised Fine-tuning in turn Improves Visual Foundation Models. - Xiaohu Jiang; Yixiao Ge; Yuying Ge; Chun Yuan; Ying Shan (CoRR, 2024)

Advances in 3D Generation: A Survey. - Xiaoyu Li 002; Qi Zhang 029; Di Kang; Weihao Cheng 002; Yiming Gao 007; Jingbo Zhang 002; Zhihao Liang; Jing Liao 001; Yan-Pei Cao; Ying Shan (CoRR, 2024)

DO3D: Self-supervised Learning of Decomposed Object-aware 3D Motion and Depth from Monocular Videos. - Xiuzhe Wu; Xiaoyang Lyu; Qihao Huang; Yong Liu; Yang Wu 001; Ying Shan; Xiaojuan Qi 001 (CoRR, 2024)

HRLAIF: Improvements in Helpfulness and Harmlessness in Open-domain Reinforcement Learning From AI Feedback. - Ang Li; Qiugen Xiao; Peng Cao; Jian Tang; Yi Yuan; Zijie Zhao; Xiaoyuan Chen; Liang Zhang; Xiangyang Li; Kaitong Yang; Weidong Guo; Yukang Gan; et al. (CoRR, 2024)

HeadEvolver: Text to Head Avatars via Locally Learnable Mesh Deformation. - Duotun Wang; Hengyu Meng; Zeyu Cai; Zhijing Shao; Qianxi Liu; Lin Wang 025; Mingming Fan 001; Ying Shan; Xiaohang Zhan; Zeyu Wang 003 (CoRR, 2024)

SphereDiffusion: Spherical Geometry-Aware Distortion Resilient Diffusion Model. - Tao Wu; Xuewei Li 002; Zhongang Qi; Di Hu; Xintao Wang 002; Ying Shan; Xi Li 001 (CoRR, 2024)

InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models. - Jiale Xu; Weihao Cheng 002; Yiming Gao 007; Xintao Wang 002; Shenghua Gao; Ying Shan (CoRR, 2024)

SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generation. - Yuying Ge; Sijie Zhao; Jinguo Zhu; Yixiao Ge; Kun Yi; Lin Song 002; Chen Li 046; Xiaohan Ding; Ying Shan (CoRR, 2024)

SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension. - Bohao Li 002; Yuying Ge; Yi Chen 019; Yixiao Ge; Ruimao Zhang; Ying Shan (CoRR, 2024)

Learning High-Quality Navigation and Zooming on Omnidirectional Images in Virtual Reality. - Zidong Cao; Zhan Wang 001; Yexin Liu; Yan-Pei Cao; Ying Shan; Wei Zeng 004; Lin Wang 025 (CoRR, 2024)

SEED-Data-Edit Technical Report: A Hybrid Dataset for Instructional Image Editing. - Yuying Ge; Sijie Zhao; Chen Li 046; Yixiao Ge; Ying Shan (CoRR, 2024)

ZeroSmooth: Training-free Diffuser Adaptation for High Frame Rate Video Generation. - Shaoshu Yang; Yong Zhang 034; Xiaodong Cun; Ying Shan; Ran He 001 (CoRR, 2024)

GrootVL: Tree Topology is All You Need in State Space Model. - Yicheng Xiao; Lin Song 002; Shaoli Huang; Jiangshan Wang; Siyu Song; Yixiao Ge; Xiu Li 001; Ying Shan (CoRR, 2024)

PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLM. - Tao Yang; Yingmin Luo; Zhongang Qi; Yang Wu 001; Ying Shan; Chang Wen Chen (CoRR, 2024)

VoCo-LLaMA: Towards Vision Compression with Large Language Models. - Xubing Ye; Yukang Gan; Xiaoke Huang; Yixiao Ge; Ying Shan; Yansong Tang (CoRR, 2024)

SEED-Story: Multimodal Long Story Generation with Large Language Model. - Shuai Yang; Yuying Ge; Yang Li; Yukang Chen; Yixiao Ge; Ying Shan; Yingcong Chen (CoRR, 2024)

Noise Calibration: Plug-and-play Content-Preserving Video Enhancement using Pre-trained Video Diffusion Models. - Qinyu Yang; Haoxin Chen; Yong Zhang 034; Menghan Xia; Xiaodong Cun; Zhixun Su; Ying Shan (CoRR, 2024)

Image Inpainting Models are Effective Tools for Instruction-guided Image Editing. - Xuan Ju; Junhao Zhuang; Zhaoyang Zhang 004; Yuxuan Bian; Qiang Xu 001; Ying Shan (CoRR, 2024)

Story3D-Agent: Exploring 3D Storytelling Visualization with Large Language Models. - Yuzhou Huang; Yiran Qin; Shunlin Lu; Xintao Wang 002; Rui Huang; Ying Shan; Ruimao Zhang (CoRR, 2024)

ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis. - Wangbo Yu; Jinbo Xing; Li Yuan 007; Wenbo Hu 002; Xiaoyu Li 002; Zhipeng Huang 001; Xiangjun Gao; Tien-Tsin Wong; Ying Shan; Yonghong Tian 001 (CoRR, 2024)

Open-MAGVIT2: An Open-Source Project Toward Democratizing Auto-regressive Visual Generation. - Zhuoyan Luo; Fengyuan Shi 001; Yixiao Ge; Yujiu Yang; Limin Wang 002; Ying Shan (CoRR, 2024)

StereoCrafter: Diffusion-based Generation of Long and High-fidelity Stereoscopic 3D from Monocular Videos. - Sijie Zhao; Wenbo Hu 002; Xiaodong Cun; Yong Zhang 034; Xiaoyu Li 002; Zhe Kong; Xiangjun Gao; Muyao Niu; Ying Shan (CoRR, 2024)

PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance. - Ruyang Liu; Haoran Tang; Haibo Liu; Yixiao Ge; Ying Shan; Chen Li 046; Jiankun Yang (CoRR, 2024)

Taming Rectified Flow for Inversion and Editing. - Jiangshan Wang; Junfu Pu; Zhongang Qi; Jiayi Guo; Yue Ma; Nisha Huang; Yuxin Chen; Xiu Li 001; Ying Shan (CoRR, 2024)

mR2AG: Multimodal Retrieval-Reflection-Augmented Generation for Knowledge-Based VQA. - Tao Zhang; Ziqi Zhang; Zongyang Ma; Yuxin Chen; Zhongang Qi; Chunfeng Yuan; Bing Li 001; Junfu Pu; Yuxuan Zhao; Zehua Xie; Jin Ma 003; Ying Shan; et al. (CoRR, 2024)

NovelGS: Consistent Novel-view Denoising via Large Gaussian Reconstruction Model. - Jinpeng Liu; Jiale Xu; Weihao Cheng 002; Yiming Gao 007; Xintao Wang 002; Ying Shan; Yansong Tang (CoRR, 2024)

DOGE: Towards Versatile Visual Document Grounding and Referring. - Yinan Zhou; Yuxin Chen; Haokun Lin; Shuyu Yang; Li Zhu 003; Zhongang Qi; Chen Ma 001; Ying Shan (CoRR, 2024)

Taming Scalable Visual Tokenizer for Autoregressive Image Generation. - Fengyuan Shi 001; Zhuoyan Luo; Yixiao Ge; Yujiu Yang; Ying Shan; Limin Wang 002 (CoRR, 2024)

Moto: Latent Motion Token as the Bridging Language for Robot Manipulation. - Yi Chen 019; Yuying Ge; Yizhuo Li 001; Yixiao Ge; Mingyu Ding; Ying Shan; Xihui Liu (CoRR, 2024)

DiCoDe: Diffusion-Compressed Deep Tokens for Autoregressive Video Generation with Language Models. - Yizhuo Li 001; Yuying Ge; Yixiao Ge; Ping Luo 002; Ying Shan (CoRR, 2024)

EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios. - Lu Qiu; Yuying Ge; Yi Chen 019; Yixiao Ge; Ying Shan; Xihui Liu (CoRR, 2024)

MuMu-LLaMA: Multi-modal Music Understanding and Generation via Large Language Models. - Shansong Liu; Atin Sakkeer Hussain; Qilong Wu; Chenshuo Sun; Ying Shan (CoRR, 2024)

FreeSplatter: Pose-free Gaussian Splatting for Sparse-view 3D Reconstruction. - Jiale Xu; Shenghua Gao; Ying Shan (CoRR, 2024)

BrushEdit: All-In-One Image Inpainting and Editing. - Yaowei Li; Yuxuan Bian; Xuan Ju; Zhaoyang Zhang 004; Ying Shan; Yuexian Zou; Qiang Xu 001 (CoRR, 2024)

ColorFlow: Retrieval-Augmented Image Sequence Colorization. - Junhao Zhuang; Xuan Ju; Zhaoyang Zhang 004; Yong Liu; Shiyi Zhang; Chun Yuan; Ying Shan (CoRR, 2024)

Consistent Human Image and Video Generation with Spatially Conditioned Diffusion. - Mingdeng Cao; Chong Mou; Ziyang Yuan; Xintao Wang 002; Zhaoyang Zhang 004; Ying Shan; Yinqiang Zheng (CoRR, 2024)

VideoMaker: Zero-shot Customized Video Generation with the Inherent Force of Video Diffusion Models. - Tao Wu; Yong Zhang 034; Xiaodong Cun; Zhongang Qi; Junfu Pu; Huanzhang Dou; Guangcong Zheng; Ying Shan; Xi Li 001 (CoRR, 2024)

Chinese Title Generation for Short Videos: Dataset, Metric and Algorithm. - Ziqi Zhang; Zongyang Ma; Chunfeng Yuan; Yuxin Chen; Peijin Wang; Zhongang Qi; Chenglei Hao; Bing Li 001; Ying Shan; Weiming Hu; Stephen J. Maybank (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

Analysis and Benchmarking of Extending Blind Face Image Restoration to Videos. - Zhouxia Wang; Jiawei Zhang 002; Xintao Wang 002; Tianshui Chen; Ying Shan; Wenping Wang 001; Ping Luo 002 (IEEE Trans. Image Process., 2024)

Vision-Language Instruction Tuning: A Review and Analysis. - Chen Li 046; Yixiao Ge; Dian Li; Ying Shan (Trans. Mach. Learn. Res., 2024)

Learning Music-Dance Representations Through Explicit-Implicit Rhythm Synchronization. - Jiashuo Yu; Junfu Pu; Ying Cheng 005; Rui Feng 001; Ying Shan (IEEE Trans. Multim., 2024)

DropConn: Dropout Connection Based Random GNNs for Molecular Property Prediction. - Dan Zhang; Wenzheng Feng; Yuandong Wang; Zhongang Qi; Ying Shan; Jie Tang 001 (IEEE Trans. Knowl. Data Eng., 2024)

DARTScore: DuAl-Reconstruction Transformer for Video Captioning Evaluation. - Yuxin Chen; Ziqi Zhang; Zhongang Qi; Chunfeng Yuan; Jie Wang; Ying Shan; Bing Li 001; Weiming Hu; Xiaohu Qie; Jianping Wu (IEEE Trans. Circuits Syst. Video Technol., 2024)

Learning layout generation for virtual worlds. - Weihao Cheng 002; Ying Shan (Comput. Vis. Media, 2024)

TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts. - Jingyu Zhuang; Di Kang; Yan-Pei Cao; Guanbin Li; Liang Lin; Ying Shan (ACM Trans. Graph., 2024)

NeRF-Texture: Synthesizing Neural Radiance Field Textures. - Yihua Huang 002; Yan-Pei Cao; Yu-Kun Lai; Ying Shan; Lin Gao 004 (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

Empowering Real-World Image Super-Resolution With Flexible Interactive Modulation. - Chong Mou; Xintao Wang 002; Yanze Wu; Ying Shan; Jian Zhang 018 (IEEE Trans. Pattern Anal. Mach. Intell., 2024)

StyleCrafter: Taming Artistic Video Diffusion with Reference-Augmented Adapter Learning. - Gongye Liu; Menghan Xia; Yong Zhang 034; Haoxin Chen; Jinbo Xing; Yibo Wang; Xintao Wang 002; Ying Shan; Yujiu Yang (ACM Trans. Graph., 2024)

ToonCrafter: Generative Cartoon Interpolation. - Jinbo Xing; Hanyuan Liu; Menghan Xia; Yong Zhang 034; Xintao Wang 002; Ying Shan; Tien-Tsin Wong (ACM Trans. Graph., 2024)

Image Conductor: Precision Control for Interactive Video Synthesis. - Yaowei Li; Xintao Wang 002; Zhaoyang Zhang 004; Zhouxia Wang; Ziyang Yuan; Liangbin Xie; Ying Shan; Yuexian Zou (AAAI, 2025)

CustomCrafter: Customized Video Generation with Preserving Motion and Concept Composition Abilities. - Tao Wu; Yong Zhang 034; Xintao Wang 002; Xianpan Zhou; Guangcong Zheng; Zhongang Qi; Ying Shan; Xi Li 001 (AAAI, 2025)

High-Accuracy Fractured Object Reassembly Under Arbitrary Poses. - Qun-Ce Xu; Yan-Pei Cao; Weihao Cheng 002; Tai-Jiang Mu; Ying Shan; Yong-Liang Yang 002; Shi-Min Hu 001 (CVM (2), 2025)

DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos. - Wenbo Hu 002; Xiangjun Gao; Xiaoyu Li 002; Sijie Zhao; Xiaodong Cun; Yong Zhang 034; Long Quan; Ying Shan (CVPR, 2025)

DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generation. - Minghong Cai; Xiaodong Cun; Xiaoyu Li 002; Wenze Liu; Zhaoyang Zhang 004; Yong Zhang 034; Ying Shan; Xiangyu Yue 001 (CVPR, 2025)

Mani-GS: Gaussian Splatting Manipulation with Triangular Mesh. - Xiangjun Gao; Xiaoyu Li 002; Yiyu Zhuang; Qi Zhang 029; Wenbo Hu 002; Chaopeng Zhang; Yao Yao 008; Ying Shan; Long Quan (CVPR, 2025)

Divot: Diffusion Powers Video Tokenizer for Comprehension and Generation. - Yuying Ge; Yizhuo Li 001; Yixiao Ge; Ying Shan (CVPR, 2025)

NVComposer: Boosting Generative Novel View Synthesis with Multiple Sparse and Unposed Images. - Lingen Li; Zhaoyang Zhang 004; Yaowei Li; Jiale Xu; Wenbo Hu 002; Xiaoyu Li 002; Weihao Cheng 002; Jinwei Gu; Tianfan Xue; Ying Shan (CVPR, 2025)

Mono2Stereo: A Benchmark and Empirical Study for Stereo Conversion. - Songsong Yu; Yuxin Chen; Zhongang Qi; Zeke Xie; Yifan Wang 004; Lijun Wang; Ying Shan; Huchuan Lu (CVPR, 2025)

DI-PCG: Diffusion-based Efficient Inverse Procedural Content Generation for High-quality 3D Asset Creation. - Wang Zhao; Yan-Pei Cao; Jiale Xu; Yuejiang Dong; Ying Shan (CVPR, 2025)

Editing Music with Melody and Text: Using ControlNet for Diffusion Transformer. - Siyuan Hou; Shansong Liu; Ruibin Yuan; Wei Xue; Ying Shan; Mangsuo Zhao; Chao Zhang (ICASSP, 2025)

Plot2Code: A Comprehensive Benchmark for Evaluating Multi-modal Large Language Models in Code Generation from Scientific Plots. - Chengyue Wu; Zhixuan Liang; Yixiao Ge; Qiushan Guo; Zeyu Lu; Jiahao Wang; Ying Shan; Ping Luo 002 (NAACL (Findings), 2025)

UV Gaussians: Joint learning of mesh deformation and Gaussian textures for human avatar modeling. - Yujiao Jiang; Qingmin Liao; Xiaoyu Li 002; Li Ma; Qi Zhang 029; Chaopeng Zhang; Zongqing Lu 001; Ying Shan (Knowl. Based Syst., 2025)

Weakly-Supervised Temporal Action Localization by Progressive Complementary Learning. - Jia-Run Du; Jia-Chang Feng; Kun-Yu Lin; Fa-Ting Hong; Zhongang Qi; Ying Shan; Jian-Fang Hu; Wei-Shi Zheng 001 (IEEE Trans. Circuits Syst. Video Technol., 2025)

Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance. - Jinbo Xing; Menghan Xia; Yuxin Liu; Yuechen Zhang; Yong Zhang 034; Yingqing He; Hanyuan Liu; Haoxin Chen; Xiaodong Cun; Xintao Wang 002; Ying Shan; Tien-Tsin Wong (IEEE Trans. Vis. Comput. Graph., 2025)

TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Models. - Mark YU; Wenbo Hu 002; Jinbo Xing; Ying Shan (CoRR, 2025)

VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control. - Yuxuan Bian; Zhaoyang Zhang 004; Xuan Ju; Mingdeng Cao; Liangbin Xie; Ying Shan; Qiang Xu 001 (CoRR, 2025)

BlobCtrl: A Unified and Flexible Framework for Element-level Image Generation and Editing. - Yaowei Li; Lingen Li; Zhaoyang Zhang 004; Xiaoyu Li 002; Guangzhi Wang; Hongxiang Li; Xiaodong Cun; Ying Shan; Yuexian Zou (CoRR, 2025)

HaploVL: A Single-Transformer Baseline for Multi-Modal Understanding. - Rui Yan 001; Lin Song 002; Yicheng Xiao; Runhui Huang; Yixiao Ge; Ying Shan; Hengshuang Zhao (CoRR, 2025)

GenHancer: Imperfect Generative Models are Secretly Strong Vision-Centric Enhancers. - Shijie Ma; Yuying Ge; Teng Wang; Yuxin Guo; Yixiao Ge; Ying Shan (CoRR, 2025)

Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1. - Yi Chen 019; Yuying Ge; Rui Wang 092; Yixiao Ge; Lu Qiu; Ying Shan; Xihui Liu (CoRR, 2025)

AnimeGamer: Infinite Anime Life Simulation with Next Game State Prediction. - Junhao Cheng; Yuying Ge; Yixiao Ge; Jing Liao 001; Ying Shan (CoRR, 2025)

GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priors. - Tian-Xing Xu; Xiangjun Gao; Wenbo Hu 002; Xiaoyu Li 002; Song-Hai Zhang; Ying Shan (CoRR, 2025)

Cobra: Efficient Line Art COlorization with BRoAder References. - Junhao Zhuang; Lingen Li; Xuan Ju; Zhaoyang Zhang 004; Chun Yuan; Ying Shan (CoRR, 2025)

StyleAdapter: A Unified Stylized Image Generation Model. - Zhouxia Wang; Xintao Wang 002; Liangbin Xie; Zhongang Qi; Ying Shan; Wenping Wang 001; Ping Luo 002 (Int. J. Comput. Vis., 2025)

FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarios. - Shiyi Zhang; Junhao Zhuang; Zhaoyang Zhang 004; Ying Shan; Yansong Tang (CoRR, 2025)

TokLIP: Marry Visual Tokens to CLIP for Multimodal Comprehension and Generation. - Haokun Lin; Teng Wang; Yixiao Ge; Yuying Ge; Zhichao Lu; Ying Wei 001; Qingfu Zhang 001; Zhenan Sun; Ying Shan (CoRR, 2025)

MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPO. - Yicheng Xiao; Lin Song 002; Yukang Chen; Yingmin Luo; Yuxin Chen; Yukang Gan; Wei Huang 042; Xiu Li 001; Xiaojuan Qi 001; Ying Shan (CoRR, 2025)

TensorAR: Refinement is All You Need in Autoregressive Image Generation. - Cheng Cheng; Lin Song 002; Yicheng Xiao; Yuxin Chen; Xuchong Zhang; Hongbin Sun 001; Ying Shan (CoRR, 2025)

Sci-Fi: Symmetric Constraint for Frame Inbetweening. - Liuhan Chen; Xiaodong Cun; Xiaoyu Li 002; Xianyi He; Shenghai Yuan; Jie Chen 001; Ying Shan; Li Yuan 007 (CoRR, 2025)

Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning? - Junhao Cheng; Yuying Ge; Teng Wang; Yixiao Ge; Jing Liao 001; Ying Shan (CoRR, 2025)

HaploOmni: Unified Single Transformer for Multimodal Video Understanding and Generation. - Yicheng Xiao; Lin Song 002; Rui Yang 010; Cheng Cheng; Zunnan Xu; Zhaoyang Zhang 004; Yixiao Ge; Xiu Li 001; Ying Shan (CoRR, 2025)

AnimeShooter: A Multi-Shot Animation Dataset for Reference-Guided Video Generation. - Lu Qiu; Yizhuo Li 001; Yuying Ge; Yixiao Ge; Ying Shan; Xihui Liu (CoRR, 2025)

Aligning Latent Spaces with Flow Priors. - Yizhuo Li 001; Yuying Ge; Yixiao Ge; Ying Shan; Ping Luo 002 (CoRR, 2025)

LoRA-Gen: Specializing Large Language Model via Online LoRA Generation. - Yicheng Xiao; Lin Song 002; Rui Yan 001; Cheng Cheng; Yixiao Ge; Xiu Li 001; Ying Shan (CoRR, 2025)

GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoning. - Yi Chen 019; Yuying Ge; Rui Wang 092; Yixiao Ge; Junhao Cheng; Ying Shan; Xihui Liu (CoRR, 2025)

Assembler: Scalable 3D Part Assembly via Anchor Point Diffusion. - Wang Zhao; Yan-Pei Cao; Jiale Xu; Yuejiang Dong; Ying Shan (CoRR, 2025)

DepthSync: Diffusion Guidance-Based Depth Synchronization for Scale- and Geometry-Consistent Video Depth Estimation. - Yuejiang Dong; Wang Zhao; Jiale Xu; Ying Shan; Song-Hai Zhang (CoRR, 2025)

IC-Custom: Diverse Image Customization via In-Context Learning. - Yaowei Li; Xiaoyu Li 002; Zhaoyang Zhang 004; Yuxuan Bian; Gan Liu; Xinyuan Li; Jiale Xu; Wenbo Hu 002; Yating Liu; Lingen Li; Jing Cai; Yuexian Zou; et al. (CoRR, 2025)

ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shorts. - Yuying Ge; Yixiao Ge; Chen Li 046; Teng Wang; Junfu Pu; Yizhuo Li 001; Lu Qiu; Jin Ma 003; Lisheng Duan; Xinyu Zuo; Jinwen Luo; Weibo Gu; et al. (CoRR, 2025)

Learning Multi-Task Target-Specific Correlation Filters for Robust Tracking. - Yanjie Liang; Luo Xiong; Ying Shan; Hanzi Wang (IEEE Trans. Circuits Syst. Video Technol., 2025)

HumanRef-GS: Image-to-3D Human Generation With Reference-Guided Diffusion and 3D Gaussian Splatting. - Jingbo Zhang 002; Xiaoyu Li 002; Hongliang Zhong; Qi Zhang 029; Yan-Pei Cao; Ying Shan; Jing Liao 001 (IEEE Trans. Circuits Syst. Video Technol., 2025)

ToonComposer: Streamlining Cartoon Production with Generative Post-Keyframing. - Lingen Li; Guangzhi Wang; Zhaoxiang Zhang 001; Yaowei Li; Xiaoyu Li 002; Qi Dou; Jinwei Gu; Tianfan Xue; Ying Shan (CoRR, 2025)

GP-Recon: Online Monocular Neural 3D Reconstruction With Geometric Prior. - Zi-Xin Zou; Shi-Sheng Huang; Yan-Pei Cao; Tai-Jiang Mu; Ying Shan; Hongbo Fu 001; Song-Hai Zhang (IEEE Trans. Vis. Comput. Graph., 2025)