Anyi Rao

According to our database, Anyi Rao authored at least 52 papers between 2017 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

Pseudo-Unification: Entropy Probing Reveals Divergent Information Patterns in Unified Multimodal Models.

Songlin Yang, Xianghao Kong, Anyi Rao

CoRR, April, 2026

InstanceAnimator: Multi-Instance Sketch Video Colorization.

Yinhan Zhang, Yue Ma, Bingyuan Wang, Kunyu Feng, Yeying Jin, Qifeng Chen, Anyi Rao, Zeyu Wang

CoRR, March, 2026

Controllable Text-to-Motion Generation via Modular Body-Part Phase Control.

Minyue Dai, Ke Fan, Anyi Rao, Jingbo Wang, Bo Dai

CoRR, March, 2026

Astrolabe: Steering Forward-Process Reinforcement Learning for Distilled Autoregressive Video Models.

Songchun Zhang, Zeyue Xue, Siming Fu, Jie Huang, Xianghao Kong, Y. Ma, Haoyang Huang, Nan Duan, Anyi Rao

CoRR, March, 2026

ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creation.

Songlin Yang, Zhe Wang, Xuyi Yang, Songchun Zhang, Xianghao Kong, Taiyi Wu, Xiaotong Zhao, Ran Zhang, Alan Zhao, Anyi Rao

CoRR, March, 2026

SesaHand: Enhancing 3D Hand Reconstruction via Controllable Generation with Semantic and Structural Alignment.

Zhuoran Zhao, Xianghao Kong, Linlin Yang, Zheng Wei, Pan Hui, Anyi Rao

CoRR, March, 2026

Collaposer: Transforming Photo Collections into Visual Assets for Storytelling with Collages.

Jiayi Zhou, Liwenhan Xie, Jiaju Ma, Zheng Wei, Huamin Qu, Anyi Rao

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

2025

Pretraining Frame Preservation in Autoregressive Video Memory Compression.

Lvmin Zhang, Shengqu Cai, Muyang Li, Chong Zeng, Beijia Lu, Anyi Rao, Song Han, Gordon Wetzstein, Maneesh Agrawala

CoRR, December, 2025

Composing Concepts from Images and Videos via Concept-prompt Binding.

Xianghao Kong, Zeyu Zhang, Yuwei Guo, Zhuoran Zhao, Songchun Zhang, Anyi Rao

CoRR, December, 2025

Hollywood Town: Long-Video Generation via Cross-Modal Multi-Agent Orchestration.

Zheng Wei, Mingchen Li, Zeqian Zhang, Ruibin Yuan, Pan Hui, Huamin Qu, James Evans, Maneesh Agrawala, Anyi Rao

CoRR, October, 2025

Taming Flow-based I2V Models for Creative Video Editing.

Xianghao Kong, Hansheng Chen, Yuwei Guo, Lvmin Zhang, Gordon Wetzstein, Maneesh Agrawala, Anyi Rao

CoRR, September, 2025

Dense Semantic Matching with VGGT Prior.

Songlin Yang, Tianyi Wei, Yushi Lan, Zeqi Xiao, Anyi Rao, Xingang Pan

CoRR, September, 2025

DataSway: Vivifying Metaphoric Visualization with Animation Clip Generation and Coordination.

Liwenhan Xie, Jiayi Zhou, Anyi Rao, Huamin Qu, Xinhuan Shu

CoRR, July, 2025

Light of Normals: Unified Feature Representation for Universal Photometric Stereo.

Hong Li, Houyuan Chen, Chongjie Ye, Zhaoxi Chen, Bohan Li, Shaocong Xu, Xianda Guo, Xuhui Liu, Yikai Wang, Baochang Zhang, Satoshi Ikehata, Boxin Shi, Anyi Rao, Hao Zhao

CoRR, June, 2025

ProFashion: Prototype-guided Fashion Video Generation with Multiple Reference Images.

Xianghao Kong, Qiaosong Qi, Yuanbin Wang, Anyi Rao, Biaolong Chen, Aixi Zhang, Si Liu, Hao Jiang

CoRR, May, 2025

Simulating the Real World: A Unified Survey of Multimodal Generative Models.

Yuqi Hu, Longguang Wang, Xian Liu, Ling-Hao Chen, Yuwei Guo, Yukai Shi, Ce Liu, Anyi Rao, Zeyu Wang, Hui Xiong

CoRR, March, 2025

CineVision: An Interactive Pre-visualization Storyboard System for Director-Cinematographer Collaboration.

Zheng Wei, Hongtao Wu, Lvmin Zhang, Xian Xu, Yefeng Zheng, Pan Hui, Maneesh Agrawala, Huamin Qu, Anyi Rao

Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology, 2025

Scaling In-the-Wild Training for Diffusion-based Illumination Harmonization and Editing by Imposing Consistent Light Transport.

Lvmin Zhang, Anyi Rao, Maneesh Agrawala

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Light-a-Video: Training-Free Video Relighting via Progressive Light Fusion.

Yujie Zhou, Jiazi Bu, Pengyang Ling, Pan Zhang, Tong Wu, Qidong Huang, Jinsong Li, Xiaoyi Dong, Yuhang Zang, Yuhang Cao, Anyi Rao, Jiaqi Wang, Li Niu

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025

Generative AI for Film Creation: A Survey of Recent Advances.

Ruihan Zhang, Borou Yu, Jiajian Min, Yetong Xin, Zheng Wei, Juncheng Nemo Shi, Mingzhen Huang, Xianghao Kong, Nix Liu Xin, Shanshan Jiang, Praagya Bahuguna, Mark Chan, Khushi Hora, Lijian Yang, Yongqi Liang, Runhe Bian, Yunlei Liu, Isabela Campillo Valencia, Patricia Morales Tredinick, Ilia Kozlov, Sijia Jiang, Peiwen Huang, Na Chen, Xuanxuan Liu, Anyi Rao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2025

Keyframe-Guided Creative Video Inpainting.

Yuwei Guo, Ceyuan Yang, Anyi Rao, Chenlin Meng, Omer Bar-Tal, Shuangrui Ding, Maneesh Agrawala, Dahua Lin, Bo Dai

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

2024

Mindalogue: LLM-Powered Nonlinear Interaction for Effective Learning and Task Exploration.

Rui Zhang, Ziyao Zhang, Fengliang Zhu, Jiajie Zhou, Anyi Rao

CoRR, 2024

CinePreGen: Camera Controllable Video Previsualization via Engine-powered Diffusion.

Yiran Chen, Anyi Rao, Xuekun Jiang, Shishi Xiao, Ruiqing Ma, Zeyu Wang, Hui Xiong, Bo Dai

CoRR, 2024

ScriptViz: A Visualization Tool to Aid Scriptwriting based on a Large Movie Database.

Anyi Rao, Jean-Peïc Chou, Maneesh Agrawala

Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology, 2024

Generative Models for Visual Content Editing and Creation.

Anyi Rao, Yuanbo Xiangli, Yuwei Guo, Mia Tang, Chenlin Meng, Maneesh Agrawala

Proceedings of the ACM SIGGRAPH 2024 Courses, 2024

CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.

Dachuan Shi, Chaofan Tao, Anyi Rao, Zhendong Yang, Chun Yuan, Jiaqi Wang

Proceedings of the Forty-first International Conference on Machine Learning, 2024

AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning.

Yuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang, Yaohui Wang, Yu Qiao, Maneesh Agrawala, Dahua Lin, Bo Dai

Proceedings of the Twelfth International Conference on Learning Representations, 2024

SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Models.

Yuwei Guo, Ceyuan Yang, Anyi Rao, Maneesh Agrawala, Dahua Lin, Bo Dai

Proceedings of the Computer Vision - ECCV 2024, 2024

Cinematic Behavior Transfer via NeRF-based Differentiable Filming.

Xuekun Jiang, Anyi Rao, Jingbo Wang, Dahua Lin, Bo Dai

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

2023

A Coarse-to-Fine Framework for Automatic Video Unscreen.

Anyi Rao, Linning Xu, Zhizhong Li, Qingqiu Huang, Zhanghui Kuang, Wayne Zhang, Dahua Lin

IEEE Trans. Multim., 2023

AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning.

Yuwei Guo, Ceyuan Yang, Anyi Rao, Yaohui Wang, Yu Qiao, Dahua Lin, Bo Dai

CoRR, 2023

Automated Conversion of Music Videos into Lyric Videos.

Jiaju Ma, Anyi Rao, Li-Yi Wei, Rubaiat Habib Kazi, Hijung Valentina Shin, Maneesh Agrawala

Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, 2023

Dynamic Storyboard Generation in an Engine-based Virtual Environment for Video Production.

Anyi Rao, Xuekun Jiang, Yuwei Guo, Linning Xu, Lei Yang, Libiao Jin, Dahua Lin, Bo Dai

Proceedings of the ACM SIGGRAPH 2023 Posters, 2023

Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximization.

Yujie Zhou, Wenwen Qiang, Anyi Rao, Ning Lin, Bing Su, Jiaqi Wang

Proceedings of the 31st ACM International Conference on Multimedia, 2023

HireVAE: An Online and Adaptive Factor Model Based on Hierarchical and Regime-Switch VAE.

Zikai Wei, Anyi Rao, Bo Dai, Dahua Lin

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, 2023

Adding Conditional Control to Text-to-Image Diffusion Models.

Lvmin Zhang, Anyi Rao, Maneesh Agrawala

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Self-Supervised Action Representation Learning from Partial Spatio-Temporal Skeleton Sequences.

Yujie Zhou, Haodong Duan, Anyi Rao, Bing Su, Jiaqi Wang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Jointly Learning the Attributes and Composition of Shots for Boundary Detection in Videos.

Xuekun Jiang, Libiao Jin, Anyi Rao, Linning Xu, Dahua Lin

IEEE Trans. Multim., 2022

Temporal and Contextual Transformer for Multi-Camera Editing of TV Shows.

Anyi Rao, Xuekun Jiang, Sichen Wang, Yuwei Guo, Zihao Liu, Bo Dai, Long Pang, Xiaoyu Wu, Dahua Lin, Libiao Jin

CoRR, 2022

A Molecular Multimodal Foundation Model Associating Molecule Graphs with Natural Language.

Bing Su, Dazhao Du, Zhao Yang, Yujie Zhou, Jiangmeng Li, Anyi Rao, Hao Sun, Zhiwu Lu, Ji-Rong Wen

CoRR, 2022

Shoot360: Normal View Video Creation from City Panorama Footage.

Anyi Rao, Linning Xu, Dahua Lin

Proceedings of the SIGGRAPH '22: Special Interest Group on Computer Graphics and Interactive Techniques Conference, Vancouver, BC, Canada, August 7, 2022

BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Rendering.

Yuanbo Xiangli, Linning Xu, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, Dahua Lin

Proceedings of the Computer Vision - ECCV 2022, 2022

AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation.

Xueyi Liu, Xiaomeng Xu, Anyi Rao, Chuang Gan, Li Yi

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

2021

CityNeRF: Building NeRF at City Scale.

Yuanbo Xiangli, Linning Xu, Xingang Pan, Nanxuan Zhao, Anyi Rao, Christian Theobalt, Bo Dai, Dahua Lin

CoRR, 2021

BlockPlanner: City Block Generation with Vectorized Graph Representation.

Linning Xu, Yuanbo Xiangli, Anyi Rao, Nanxuan Zhao, Bo Dai, Ziwei Liu, Dahua Lin

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

2020

Online Multi-modal Person Search in Videos.

Jiangyue Xia, Anyi Rao, Qingqiu Huang, Linning Xu, Jiangtao Wen, Dahua Lin

Proceedings of the Computer Vision - ECCV 2020, 2020

A Unified Framework for Shot Type Classification Based on Subject Centric Lens.

Anyi Rao, Jiaze Wang, Linning Xu, Xuekun Jiang, Qingqiu Huang, Bolei Zhou, Dahua Lin

Proceedings of the Computer Vision - ECCV 2020, 2020

MovieNet: A Holistic Dataset for Movie Understanding.

Qingqiu Huang, Yu Xiong, Anyi Rao, Jiaze Wang, Dahua Lin

Proceedings of the Computer Vision - ECCV 2020, 2020

A Local-to-Global Approach to Multi-Modal Movie Scene Segmentation.

Anyi Rao, Linning Xu, Yu Xiong, Guodong Xu, Qingqiu Huang, Bolei Zhou, Dahua Lin

Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

2018

Automatic Music Accompanist.

Anyi Rao, Francis C. M. Lau

CoRR, 2018

HotFlip: White-Box Adversarial Examples for Text Classification.

Javid Ebrahimi, Anyi Rao, Daniel Lowd, Dejing Dou

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

HotFlip: White-Box Adversarial Examples for NLP.

Javid Ebrahimi, Anyi Rao, Daniel Lowd, Dejing Dou

CoRR, 2017