Xuehai He

According to our database, Xuehai He authored at least 32 papers between 2019 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

VLM4D: Towards Spatiotemporal Awareness in Vision Language Models.

Shijie Zhou, Alexander Vilesov, Xuehai He, Ziyu Wan, Shuwang Zhang, Aditya Nagachandra, Di Chang, Dongdong Chen, Xin Eric Wang, Achuta Kadambi

CoRR, August, 2025

GRIT: Teaching MLLMs to Think with Images.

Yue Fan, Xuehai He, Diji Yang, Kaizhi Zheng, Ching-Chen Kuo, Yuting Zheng, Sravana Jyothi Narayanaraju, Xinze Guan, Xin Eric Wang

CoRR, May, 2025

Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Space.

Zhen Zhang, Xuehai He, Weixiang Yan, Ao Shen, Chenyang Zhao, Shuohang Wang, Yelong Shen, Xin Eric Wang

CoRR, May, 2025

Reinforcement Learning for Reasoning in Large Language Models with One Training Example.

Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Lucas Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, Weizhu Chen, Shuohang Wang, Simon Shaolei Du, Yelong Shen

CoRR, April, 2025

EditRoom: LLM-parameterized Graph Diffusion for Composable 3D Room Layout Editing.

Kaizhi Zheng, Xiaotong Chen, Xuehai He, Jing Gu, Linjie Li, Zhengyuan Yang, Kevin Lin, Jianfeng Wang, Lijuan Wang, Xin Eric Wang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos.

Xuehai He, Weixi Feng, Kaizhi Zheng, Yujie Lu, Wanrong Zhu, Jiachen Li, Yue Fan, Jianfeng Wang, Linjie Li, Zhengyuan Yang, Kevin Lin, William Yang Wang, Lijuan Wang, Xin Eric Wang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Is Your World Simulator a Good Story Presenter? A Consecutive Events-Based Benchmark for Future Long Video Generation.

Yiping Wang, Xuehai He, Kuan Wang, Luyao Ma, Jianwei Yang, Shuohang Wang, Simon Shaolei Du, Yelong Shen

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

Worse than Random? An Embarrassingly Simple Probing Evaluation of Large Multimodal Models in Medical VQA.

Qianqi Yan, Xuehai He, Xiang Yue, Xin Eric Wang

Proceedings of the Findings of the Association for Computational Linguistics, 2025

2024

FlexEControl: Flexible and Efficient Multimodal Control for Text-to-Image Generation.

Xuehai He, Jian Zheng, Jacob Zhiyuan Fang, Robinson Piramuthu, Mohit Bansal, Vicente Ordonez, Gunnar A. Sigurdsson, Nanyun Peng, Xin Eric Wang

Trans. Mach. Learn. Res., 2024

Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners.

Xuehai He, Weixi Feng, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang

Trans. Mach. Learn. Res., 2024

Simultaneous Selection and Adaptation of Source Data via Four-Level Optimization.

Pengtao Xie, Xingchen Zhao, Xuehai He

Trans. Assoc. Comput. Linguistics, 2024

Mojito: Motion Trajectory and Intensity Control for Video Generation.

Xuehai He, Shuohang Wang, Jianwei Yang, Xiaoxia Wu, Yiping Wang, Kuan Wang, Zheng Zhan, Olatunji Ruwase, Yelong Shen, Xin Eric Wang

CoRR, 2024

ComCLIP: Training-Free Compositional Image and Text Matching.

Kenan Jiang, Xuehai He, Ruize Xu, Xin Wang

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

Mastering Robot Manipulation with Multimodal Prompts through Pretraining and Multi-task Fine-tuning.

Jiachen Li, Qiaozi Gao, Michael Johnston, Xiaofeng Gao, Xuehai He, Hangjie Shi, Suhaila Shakiah, Reza Ghanadan, William Yang Wang

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens.

Kaizhi Zheng, Xuehai He, Xin Eric Wang

CoRR, 2023

Discriminative Diffusion Models as Few-shot Vision and Language Learners.

Xuehai He, Weixi Feng, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Eric Wang

CoRR, 2023

LayoutGPT: Compositional Visual Planning and Generation with Large Language Models.

Weixi Feng, Wanrong Zhu, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Xuehai He, Sugato Basu, Xin Eric Wang, William Yang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis.

Weixi Feng, Xuehai He, Tsu-Jui Fu, Varun Jampani, Arjun R. Akula, Pradyumna Narayana, Sugato Basu, Xin Eric Wang, William Yang Wang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Multimodal Graph Transformer for Multimodal Question Answering.

Xuehai He, Xin Eric Wang

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

Parameter-Efficient Model Adaptation for Vision Transformers.

Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents.

Kaizhi Zheng, Kaiwen Zhou, Jing Gu, Yue Fan, Jialu Wang, Zonglin Di, Xuehai He, Xin Eric Wang

CoRR, 2022

Parameter-efficient Fine-tuning for Vision Transformers.

Xuehai He, Chunyuan Li, Pengchuan Zhang, Jianwei Yang, Xin Eric Wang

CoRR, 2022

CPL: Counterfactual Prompt Learning for Vision and Language Models.

Xuehai He, Diji Yang, Weixi Feng, Tsu-Jui Fu, Arjun R. Akula, Varun Jampani, Pradyumna Narayana, Sugato Basu, William Yang Wang, Xin Wang

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

On the Generation of Medical Dialogs for COVID-19.

Meng Zhou, Zechen Li, Bowen Tan, Guangtao Zeng, Wenmian Yang, Xuehai He, Zeqian Ju, Subrato Chakravorty, Shu Chen, Xingyi Yang, Yichen Zhang, Qingyang Wu, Zhou Yu, Kun Xu, Eric P. Xing, Pengtao Xie

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Towards Visual Question Answering on Pathology Images.

Xuehai He, Zhuo Cai, Wenlan Wei, Yichen Zhang, Luntian Mou, Eric P. Xing, Pengtao Xie

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Pathological Visual Question Answering.

Xuehai He, Zhuo Cai, Wenlan Wei, Yichen Zhang, Luntian Mou, Eric P. Xing, Pengtao Xie

CoRR, 2020

Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms.

Xingyi Yang, Xuehai He, Yuxiao Liang, Yue Yang, Shanghang Zhang, Pengtao Xie

CoRR, 2020

On the Generation of Medical Dialogues for COVID-19.

Wenmian Yang, Guangtao Zeng, Bowen Tan, Zeqian Ju, Subrato Chakravorty, Xuehai He, Shu Chen, Xingyi Yang, Qingyang Wu, Zhou Yu, Eric P. Xing, Pengtao Xie

CoRR, 2020

COVID-CT-Dataset: A CT Scan Dataset about COVID-19.

Jinyu Zhao, Yichen Zhang, Xuehai He, Pengtao Xie

CoRR, 2020

PathVQA: 30000+ Questions for Medical Visual Question Answering.

Xuehai He, Yichen Zhang, Luntian Mou, Eric P. Xing, Pengtao Xie

CoRR, 2020

2019

Learned Turbo Message Passing for Affine Rank Minimization and Compressed Robust Principal Component Analysis.

Xuehai He, Zhipeng Xue, Xiaojun Yuan

IEEE Access, 2019

Learned Turbo-type Affine Rank Minimization.

Xuehai He, Xiaojun Yuan, Zhipeng Xue

Proceedings of the 11th International Conference on Wireless Communications and Signal Processing, 2019