Mu Cai

According to our database, Mu Cai authored at least 29 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

When Tokens Talk Too Much: A Survey of Multimodal Long-Context Token Compression across Images, Videos, and Audios.

Kele Shao, Keda Tao, Kejia Zhang, Sicheng Feng, Mu Cai, Yuzhang Shang, Haoxuan You, Can Qin, Yang Sui, Huan Wang

CoRR, July, 2025

Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities.

Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit S. Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, Luke Marris, Sam Petulla, Colin Gaffney, Asaf Aharoni, Nathan Lintz, Tiago Cardal Pais, Henrik Jacobsson, Idan Szpektor, Nan-Jiang Jiang, Krishna Haridasan, Ahmed Omran, Nikunj Saunshi, Dara Bahri, Gaurav Mishra, Eric Chu, Toby Boyd, Brad Hekman, Aaron Parisi, Chaoyi Zhang, Kornraphop Kawintiranon, Tania Bedrax-Weiss, Oliver Wang, Ya Xu, Ollie Purkiss, Uri Mendlovic, Ilaï Deutel, Nam Nguyen, Adam Langley, Flip Korn, Lucia Rossazza, Alexandre Ramé, Sagar Waghmare, Helen Miller, Nathan Byrd, Ashrith Sheshan, Raia Hadsell Sangnie Bhardwaj, Pawel Janus, Tero Rissa, Dan Horgan, Sharon Silver, Ayzaan Wahid, Sergey Brin, Yves Raimond, Klemen Kloboves, Cindy Wang, Nitesh Bharadwaj Gundavarapu, Ilia Shumailov, Bo Wang, Mantas Pajarskas, Joe Heyward, Martin Nikoltchev, Maciej Kula, Hao Zhou, Zachary Garrett, Sushant Kafle, Sercan Arik, Ankita Goel, Mingyao Yang, Jiho Park, Koji Kojima, Parsa Mahmoudieh, Koray Kavukcuoglu, Grace Chen, Doug Fritz, Anton Bulyenov, Sudeshna Roy, Dimitris Paparas, Hadar Shemtov, Bo-Juen Chen, Robin Strudel, David Reitter, Aurko Roy, Andrey Vlasov, Changwan Ryu, Chas Leichner, Haichuan Yang, Zelda Mariet, Denis Vnukov, Tim Sohn, Amy Stuart, Wei Liang, Minmin Chen, Praynaa Rawlani, Christy Koh, JD Co-Reyes, Guangda Lai, Praseem Banzal, Dimitrios Vytiniotis, Jieru Mei, Mu Cai

CoRR, July, 2025

Decomposing Complex Visual Comprehension into Atomic Visual Skills for Vision Language Models.

Hyunsik Chae, Seungwoo Yoon, Jaden Park, Chloe Yewon Chun, Yongin Cho, Mu Cai, Yong Jae Lee, Ernest K. Ryu

CoRR, May, 2025

Magma: A Foundation Model for Multimodal AI Agents.

Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Lars Liden, Jianfeng Gao

CoRR, February, 2025

An Investigation on LLMs' Visual Understanding Ability Using SVG for Image-Text Bridging.

Mu Cai, Zeyi Huang, Yuheng Li, Utkarsh Ojha, Haohan Wang, Yong Jae Lee

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2025

Matryoshka Multimodal Models.

Mu Cai, Jianwei Yang, Jianfeng Gao, Yong Jae Lee

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

LLaRA: Supercharging Robot Learning Data for Vision-Language Policy.

Xiang Li, Cristina Mata, Jongwoo Park, Kumara Kahatapitiya, Yoo Sung Jang, Jinghuan Shang, Kanchana Ranasinghe, Ryan D. Burgert, Mu Cai, Yong Jae Lee, Michael S. Ryoo

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Magma: A Foundation Model for Multimodal AI Agents.

Jianwei Yang, Reuben Tan, Qianhui Wu, Ruijie Zheng, Baolin Peng, Yongyuan Liang, Yu Gu, Mu Cai, Seonghyeon Ye, Joel Jang, Yuquan Deng, Jianfeng Gao

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025

2024

TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models.

Mu Cai, Reuben Tan, Jianrui Zhang, Bocheng Zou, Kai Zhang, Feng Yao, Fangrui Zhu, Jing Gu, Yiwu Zhong, Yuzhang Shang, Yao Dou, Jaden Park, Jianfeng Gao, Yong Jae Lee, Jianwei Yang

CoRR, 2024

Vinoground: Scrutinizing LMMs over Dense Temporal Reasoning with Short Videos.

Jianrui Zhang, Mu Cai, Yong Jae Lee

CoRR, 2024

Interpolating Video-LLMs: Toward Longer-sequence LMMs in a Training-free Manner.

Yuzhang Shang, Bingxin Xu, Weitai Kang, Mu Cai, Yuheng Li, Zehao Wen, Zhen Dong, Kurt Keutzer, Yong Jae Lee, Yan Yan

CoRR, 2024

LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models.

Yuzhang Shang, Mu Cai, Bingxin Xu, Yong Jae Lee, Yan Yan

CoRR, 2024

Yo'LLaVA: Your Personalized Language and Vision Assistant.

Thao Nguyen, Haotian Liu, Yuheng Li, Mu Cai, Utkarsh Ojha, Yong Jae Lee

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

Cross-Modal Self-Supervised Learning with Effective Contrastive Units for LiDAR Point Clouds.

Mu Cai, Chenxu Luo, Yong Jae Lee, Xiaodong Yang

Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2024

VGBench: Evaluating Large Language Models on Vector Graphics Understanding and Generation.

Bocheng Zou, Mu Cai, Jianrui Zhang, Yong Jae Lee

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Removing Distributional Discrepancies in Captions Improves Image-Text Alignment.

Yuheng Li, Haotian Liu, Mu Cai, Yijun Li, Eli Shechtman, Zhe Lin, Yong Jae Lee, Krishna Kumar Singh

Proceedings of the Computer Vision - ECCV 2024, 2024

ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts.

Mu Cai, Haotian Liu, Siva Karthik Mustikovela, Gregory P. Meyer, Yuning Chai, Dennis Park, Yong Jae Lee

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Investigating the Catastrophic Forgetting in Multimodal Large Language Model Fine-Tuning.

Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, Yi Ma

Proceedings of the Conference on Parsimony and Learning, 2024

CounterCurate: Enhancing Physical and Semantic Visio-Linguistic Compositional Reasoning via Counterfactual Examples.

Jianrui Zhang, Mu Cai, Tengyang Xie, Yong Jae Lee

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Making Large Multimodal Models Understand Arbitrary Visual Prompts.

Mu Cai, Haotian Liu, Siva Karthik Mustikovela, Gregory P. Meyer, Yuning Chai, Dennis Park, Yong Jae Lee

CoRR, 2023

Investigating the Catastrophic Forgetting in Multimodal Large Language Models.

Yuexiang Zhai, Shengbang Tong, Xiao Li, Mu Cai, Qing Qu, Yong Jae Lee, Yi Ma

CoRR, 2023

Leveraging Large Language Models for Scalable Vector Graphics-Driven Image Understanding.

Mu Cai, Zeyi Huang, Yuheng Li, Haohan Wang, Yong Jae Lee

CoRR, 2023

Out-of-distribution Detection via Frequency-regularized Generative Models.

Mu Cai, Yixuan Li

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

A Sentence Speaks a Thousand Images: Domain Generalization through Distilling CLIP with Language Guidance.

Zeyi Huang, Andy Zhou, Zijian Lin, Mu Cai, Haohan Wang, Yong Jae Lee

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

2022

VOS: Learning What You Don't Know by Virtual Outlier Synthesis.

Xuefeng Du, Zhaoning Wang, Mu Cai, Yixuan Li

Proceedings of the Tenth International Conference on Learning Representations, 2022

Masked Discrimination for Self-supervised Learning on Point Clouds.

Haotian Liu, Mu Cai, Yong Jae Lee

Proceedings of the Computer Vision - ECCV 2022, 2022

2021

Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving.

Mu Cai, Hong Zhang, Huijuan Huang, Qichuan Geng, Yixuan Li, Gao Huang

Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

2020

Frequency Domain Image Translation: More Photo-realistic, Better Identity-preserving.

Mu Cai, Hong Zhang, Huijuan Huang, Qichuan Geng, Gao Huang

CoRR, 2020

A Game-Theoretic Strategy-Aware Interaction Algorithm with Validation on Real Traffic Data.

Liting Sun, Mu Cai, Wei Zhan, Masayoshi Tomizuka

Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2020