Wanrong Zhu

According to our database, Wanrong Zhu authored at least 35 papers between 2018 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding.

Shijie Zhou, Viet Dac Lai, Hao Tan, Jihyung Kil, Wanrong Zhu, Changyou Chen, Ruiyi Zhang

CoRR, November, 2025

Online Statistical Inference of Constrained Stochastic Optimization via Random Scaling.

Xinchen Du, Wanrong Zhu, Wei Biao Wu, Sen Na

CoRR, May, 2025

Towards Visual Text Grounding of Multimodal Large Language Model.

Ming Li, Ruiyi Zhang, Jian Chen, Jiuxiang Gu, Yufan Zhou, Franck Dernoncourt, Wanrong Zhu, Tianyi Zhou, Tong Sun

CoRR, April, 2025

MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos.

Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

MMSci: A Multimodal Multi-Discipline Dataset for PhD-Level Scientific Comprehension.

Zekun Li, Xianjun Yang, Kyuri Choi, Wanrong Zhu, Ryan Hsieh, HyeonJung Kim, Jin Hyuk Lim, Sungyoung Ji, Byungju Lee, Xifeng Yan, Linda Ruth Petzold, Stephen D. Wilson, Woosang Lim, William Yang Wang

CoRR, 2024

List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs.

An Yan, Zhengyuan Yang, Junda Wu, Wanrong Zhu, Jianwei Yang, Linjie Li, Kevin Lin, Jianfeng Wang, Julian J. McAuley, Jianfeng Gao, Lijuan Wang

CoRR, 2024

Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models.

Wanrong Zhu, Jennifer Healey, Ruiyi Zhang, William Yang Wang, Tong Sun

CoRR, 2024

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization.

Wanrong Zhu, Zhipeng Lou, Ziyang Wei, Wei Biao Wu

CoRR, 2024

Multimodal Procedural Planning via Dual Text-Image Prompting.

Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Wang, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View.

Raphael Schumann, Wanrong Zhu, Weixi Feng, Tsu-Jui Fu, Stefan Riezler, William Yang Wang

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

GPT-4V in Wonderland: Large Multimodal Models for Zero-Shot Smartphone GUI Navigation.

An Yan, Zhengyuan Yang, Wanrong Zhu, Kevin Lin, Linjie Li, Jianfeng Wang, Jianwei Yang, Yiwu Zhong, Julian J. McAuley, Jianfeng Gao, Zicheng Liu, Lijuan Wang

CoRR, 2023

VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use.

Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt

CoRR, 2023

OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models.

Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Yitzhak Gadre, Shiori Sagawa, Jenia Jitsev, Simon Kornblith, Pang Wei Koh, Gabriel Ilharco, Mitchell Wortsman, Ludwig Schmidt

CoRR, 2023

Weighted Averaged Stochastic Gradient Descent: Asymptotic Normality and Optimality.

Ziyang Wei, Wanrong Zhu, Wei Biao Wu

CoRR, 2023

Large Language Models Are Implicitly Topic Models: Explaining and Finding Good Demonstrations for In-Context Learning.

Xinyi Wang, Wanrong Zhu, William Yang Wang

CoRR, 2023

Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text.

Wanrong Zhu, Jack Hessel, Anas Awadalla, Samir Yitzhak Gadre, Jesse Dodge, Alex Fang, Youngjae Yu, Ludwig Schmidt, William Yang Wang, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning.

Xinyi Wang, Wanrong Zhu, Michael Saxon, Mark Steyvers, William Yang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models.

Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models.

Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Neuro-Symbolic Procedural Planning with Commonsense Prompting.

Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Collaborative Generative AI: Integrating GPT-k for Efficient Editing in Text-to-Image Generation.

Wanrong Zhu, Xinyi Wang, Yujie Lu, Tsu-Jui Fu, Xin Wang, Miguel P. Eckstein, William Wang

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Visualize Before You Write: Imagination-Guided Open-Ended Text Generation.

Wanrong Zhu, An Yan, Yujie Lu, Wenda Xu, Xin Wang, Miguel P. Eckstein, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

ImaginE: An Imagination-Based Automatic Evaluation Metric for Natural Language Generation.

Wanrong Zhu, Xin Wang, An Yan, Miguel P. Eckstein, William Yang Wang

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

2022

Beyond Sub-Gaussian Noises: Sharp Concentration Analysis for Stochastic Gradient Descent.

Wanrong Zhu, Zhipeng Lou, Wei Biao Wu

J. Mach. Learn. Res., 2022

CLIP also Understands Text: Prompting CLIP for Phrase Understanding.

An Yan, Jiacheng Li, Wanrong Zhu, Yujie Lu, William Yang Wang, Julian J. McAuley

CoRR, 2022

Neuro-Symbolic Causal Language Planning with Commonsense Prompting.

Yujie Lu, Weixi Feng, Wanrong Zhu, Wenda Xu, Xin Eric Wang, Miguel P. Eckstein, William Yang Wang

CoRR, 2022

Diagnosing Vision-and-Language Navigation: What Really Matters.

Wanrong Zhu, Yuankai Qi, Pradyumna Narayana, Kazoo Sone, Sugato Basu, Xin Wang, Qi Wu, Miguel P. Eckstein, William Yang Wang

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Imagination-Augmented Natural Language Understanding.

Yujie Lu, Wanrong Zhu, Xin Wang, Miguel P. Eckstein, William Yang Wang

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

End-to-end Dense Video Captioning as Sequence Generation.

Wanrong Zhu, Bo Pang, Ashish V. Thapliyal, William Yang Wang, Radu Soricut

Proceedings of the 29th International Conference on Computational Linguistics, 2022

2021

Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation.

Wanrong Zhu, Xin Wang, Tsu-Jui Fu, An Yan, Pradyumna Narayana, Kazoo Sone, Sugato Basu, William Yang Wang

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, 2021

2020

A Fully Online Approach for Covariance Matrices Estimation of Stochastic Gradient Descent Solutions.

Wanrong Zhu, Xi Chen, Wei Biao Wu

CoRR, 2020

Towards Understanding Sample Variance in Visually Grounded Language Generation: Evaluations and Observations.

Wanrong Zhu, Xin Wang, Pradyumna Narayana, Kazoo Sone, Sugato Basu, William Yang Wang

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

2019

Text Infilling.

Wanrong Zhu, Zhiting Hu, Eric P. Xing

CoRR, 2019

Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation.

Zhiting Hu, Haoran Shi, Bowen Tan, Wentao Wang, Zichao Yang, Tiancheng Zhao, Junxian He, Lianhui Qin, Di Wang, Xuezhe Ma, Zhengzhong Liu, Xiaodan Liang, Wanrong Zhu, Devendra Singh Sachan, Eric P. Xing

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Texar: A Modularized, Versatile, and Extensible Toolkit for Text Generation.

Zhiting Hu, Haoran Shi, Zichao Yang, Bowen Tan, Tiancheng Zhao, Junxian He, Wentao Wang, Xingjiang Yu, Lianhui Qin, Di Wang, Xuezhe Ma, Zhengzhong Liu, Xiaodan Liang, Wanrong Zhu, Devendra Singh Sachan, Eric P. Xing

CoRR, 2018