Combining Skeletal Pose with Local Motion for Human Activity Recognition. - Ran Xu 001; Priyanshu Agarwal; Suren Kumar; Venkat N. Krovi; Jason J. Corso (AMDO, 2012)

Random forests for metric learning with implicit pairwise position dependence. - Caiming Xiong; David M. Johnson 001; Ran Xu 001; Jason J. Corso (KDD, 2012)

Actionness Ranking with Lattice Conditional Ordinal Random Fields. - Wei Chen 134; Caiming Xiong; Ran Xu 001; Jason J. Corso (CVPR, 2014)

Compositional Structure Learning for Action Understanding. - Ran Xu 001; Gang Chen 032; Caiming Xiong; Wei Chen 134; Jason J. Corso (CoRR, 2014)

Jointly Modeling Deep Video and Compositional Text to Bridge Vision and Language in a Unified Framework. - Ran Xu 001; Caiming Xiong; Wei Chen 134; Jason J. Corso (AAAI, 2015)

Human action segmentation with hierarchical supervoxel consistency. - Jiasen Lu; Ran Xu 001; Jason J. Corso (CVPR, 2015)

Sequential Labeling with Online Deep Learning: Exploring Model Initialization. - Gang Chen 032; Ran Xu 001; Sargur N. Srihari (ECML/PKDD (2), 2016)

Deep ranking structural support vector machine for image tagging. - Gang Chen 032; Ran Xu 001; Zhi Yang (Pattern Recognit. Lett., 2018)

Context-aware Active Multi-Step Reinforcement Learning. - Gang Chen 032; Dingcheng Li; Ran Xu 001 (CoRR, 2019)

Proposal Learning for Semi-Supervised Object Detection. - Peng Tang; Chetan Ramaiah; Ran Xu 001; Caiming Xiong (CoRR, 2020)

WOAD: Weakly Supervised Online Action Detection in Untrimmed Videos. - Mingfei Gao; Yingbo Zhou; Ran Xu 001; Richard Socher; Caiming Xiong (CVPR, 2021)

Proposal Learning for Semi-Supervised Object Detection. - Peng Tang; Chetan Ramaiah; Yan Wang 033; Ran Xu 001; Caiming Xiong (WACV, 2021)

Field Extraction from Forms with Unlabeled Data. - Mingfei Gao; Zeyuan Chen 001; Nikhil Naik; Kazuma Hashimoto; Caiming Xiong; Ran Xu 001 (CoRR, 2021)

Towards Open Vocabulary Object Detection without Human-provided Bounding Boxes. - Mingfei Gao; Chen Xing; Juan Carlos Niebles; Junnan Li 001; Ran Xu 001; Wenhao Liu 003; Caiming Xiong (CoRR, 2021)

Value Retrieval with Arbitrary Queries for Form-like Documents. - Mingfei Gao; Le Xue; Chetan Ramaiah; Chen Xing; Ran Xu 001; Caiming Xiong (CoRR, 2021)

TAG: Boosting Text-VQA via Text-aware Visual Question-answer Generation. - Jun Wang 090; Mingfei Gao; Yuqian Hu; Ramprasaath R. Selvaraju; Chetan Ramaiah; Ran Xu 001; Joseph F. JáJá; Larry Davis 001 (BMVC, 2022)

DocQueryNet: Value Retrieval with Arbitrary Queries for Form-like Documents. - Mingfei Gao; Le Xue; Chetan Ramaiah; Chen Xing; Ran Xu 001; Caiming Xiong (COLING, 2022)

Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework. - Shu Zhang 007; Ran Xu 001; Caiming Xiong; Chetan Ramaiah (CVPR, 2022)

Open Vocabulary Object Detection with Pseudo Bounding-Box Labels. - Mingfei Gao; Chen Xing; Juan Carlos Niebles; Junnan Li 001; Ran Xu 001; Wenhao Liu 003; Caiming Xiong (ECCV (10), 2022)

Burn After Reading: Online Adaptation for Cross-domain Streaming Data. - Luyu Yang; Mingfei Gao; Zeyuan Chen 001; Ran Xu 001; Abhinav Shrivastava; Chetan Ramaiah (ECCV (33), 2022)

ULIP: Learning Unified Representation of Language, Image and Point Cloud for 3D Understanding. - Le Xue; Mingfei Gao; Chen Xing; Roberto Martín-Martín; Jiajun Wu 001; Caiming Xiong; Ran Xu 001; Juan Carlos Niebles; Silvio Savarese (CoRR, 2022)

Tackling Data Heterogeneity in Federated Learning with Class Prototypes. - Yutong Dai 002; Zeyuan Chen 001; Junnan Li 001; Shelby Heinecke; Lichao Sun 001; Ran Xu 001 (AAAI, 2023)

Mask-Free OVIS: Open-Vocabulary Instance Segmentation without Manual Mask Annotations. - Vibashan VS; Ning Yu 006; Chen Xing; Can Qin; Mingfei Gao; Juan Carlos Niebles; Vishal M. Patel; Ran Xu 001 (CVPR, 2023)

ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understanding. - Le Xue; Mingfei Gao; Chen Xing; Roberto Martín-Martín; Jiajun Wu 001; Caiming Xiong; Ran Xu 001; Juan Carlos Niebles; Silvio Savarese (CVPR, 2023)

Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation. - Qichen Fu; Xingyu Liu 001; Ran Xu 001; Juan Carlos Niebles; Kris M. Kitani (ICCV, 2023)

GlueGen: Plug and Play Multi-modal Encoders for X-to-image Generation. - Can Qin; Ning Yu 006; Chen Xing; Shu Zhang 007; Zeyuan Chen 001; Stefano Ermon; Yun Fu 001; Caiming Xiong; Ran Xu 001 (ICCV, 2023)

Robustness Evaluation of Transformer-Based Form Field Extractors via Form Attacks. - Le Xue; Mingfei Gao; Zeyuan Chen 001; Caiming Xiong; Ran Xu 001 (ICDAR (2), 2023)

UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild. - Can Qin; Shu Zhang 007; Ning Yu 006; Yihao Feng; Xinyi Yang 002; Yingbo Zhou; Huan Wang 014; Juan Carlos Niebles; Caiming Xiong; Silvio Savarese; Stefano Ermon; Yun Fu 001; et al. (NeurIPS, 2023)

Model-Agnostic Hierarchical Attention for 3D Object Detection. - Manli Shu; Le Xue; Ning Yu 006; Roberto Martín-Martín; Juan Carlos Niebles; Caiming Xiong; Ran Xu 001 (CoRR, 2023)

ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understanding. - Le Xue; Ning Yu 006; Shu Zhang 007; Junnan Li 001; Roberto Martín-Martín; Jiajun Wu 001; Caiming Xiong; Ran Xu 001; Juan Carlos Niebles; Silvio Savarese (CoRR, 2023)

REX: Rapid Exploration and eXploitation for AI Agents. - Rithesh Murthy; Shelby Heinecke; Juan Carlos Niebles; Zhiwei Liu 001; Le Xue; Weiran Yao; Yihao Feng; Zeyuan Chen 001; Akash Gokul; Devansh Arpit; Ran Xu 001; Phil Mui; et al. (CoRR, 2023)

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization. - Weiran Yao; Shelby Heinecke; Juan Carlos Niebles; Zhiwei Liu 001; Yihao Feng; Le Xue; Rithesh Murthy; Zeyuan Chen 001; Jianguo Zhang 005; Devansh Arpit; Ran Xu 001; Phil Mui; et al. (CoRR, 2023)

BOLAA: Benchmarking and Orchestrating LLM-augmented Autonomous Agents. - Zhiwei Liu 001; Weiran Yao; Jianguo Zhang 005; Le Xue; Shelby Heinecke; Rithesh Murthy; Yihao Feng; Zeyuan Chen 001; Juan Carlos Niebles; Devansh Arpit; Ran Xu 001; Phil Mui; et al. (CoRR, 2023)

X-InstructBLIP: A Framework for aligning X-Modal instruction-aware representations to LLMs and Emergent Cross-modal Reasoning. - Artemis Panagopoulou; Le Xue; Ning Yu 006; Junnan Li 001; Dongxu Li; Shafiq Joty; Ran Xu 001; Silvio Savarese; Caiming Xiong; Juan Carlos Niebles (CoRR, 2023)

FOFO: A Benchmark to Evaluate LLMs' Format-Following Capability. - Congying Xia; Chen Xing; Jiangshu Du; Xinyi Yang 002; Yihao Feng; Ran Xu 001; Wenpeng Yin 001; Caiming Xiong (ACL (1), 2024)

HIVE: Harnessing Human Feedback for Instructional Visual Editing. - Shu Zhang 007; Xinyi Yang 002; Yihao Feng; Can Qin; Chia-Chih Chen; Ning Yu 006; Zeyuan Chen 001; Huan Wang 014; Silvio Savarese; Stefano Ermon; Caiming Xiong; Ran Xu 001 (CVPR, 2024)

ULIP-2: Towards Scalable Multimodal Pre-Training for 3D Understanding. - Le Xue; Ning Yu 006; Shu Zhang 007; Artemis Panagopoulou; Junnan Li 001; Roberto Martín-Martín; Jiajun Wu 001; Caiming Xiong; Ran Xu 001; Juan Carlos Niebles; Silvio Savarese (CVPR, 2024)

X-InstructBLIP: A Framework for Aligning Image, 3D, Audio, Video to LLMs and its Emergent Cross-Modal Reasoning. - Artemis Panagopoulou; Le Xue; Ning Yu 006; Junnan Li 001; Dongxu Li; Shafiq Joty; Ran Xu 001; Silvio Savarese; Caiming Xiong; Juan Carlos Niebles (ECCV (45), 2024)

xGen-VideoSyn-1: High-Fidelity Text-to-Video Synthesis with Compressed Representations. - Can Qin; Congying Xia; Krithika Ramakrishnan; Michael S. Ryoo; Lifu Tu; Yihao Feng; Manli Shu; Honglu Zhou; Anas Awadalla; Jun Wang 090; Senthil Purushwalkam; Le Xue; et al. (ECCV Workshops (5), 2024)

SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant. - Guohao Sun; Can Qin; Jiamian Wang; Zeyuan Chen 001; Ran Xu 001; Zhiqiang Tao (ECCV (9), 2024)

LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer. - Ning Yu 006; Chia-Chih Chen; Zeyuan Chen 001; Rui Meng; Gang Wu; Paul Josel; Juan Carlos Niebles; Caiming Xiong; Ran Xu 001 (ECCV (20), 2024)

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization. - Weiran Yao; Shelby Heinecke; Juan Carlos Niebles; Zhiwei Liu 001; Yihao Feng; Le Xue; Rithesh R. N.; Zeyuan Chen 001; Jianguo Zhang 005; Devansh Arpit; Ran Xu 001; Phil Mui; et al. (ICLR, 2024)

Position: TrustLLM: Trustworthiness in Large Language Models. - Yue Huang; Lichao Sun 001; Haoran Wang 005; Siyuan Wu 001; Qihui Zhang; Yuan Li; Chujie Gao; Yixin Huang; Wenhan Lyu; Yixuan Zhang; Xiner Li; Hanchi Sun; et al. (ICML, 2024)

Hierarchical Point Attention for Indoor 3D Object Detection. - Manli Shu; Le Xue; Ning Yu 006; Roberto Martín-Martín; Caiming Xiong; Tom Goldstein; Juan Carlos Niebles; Ran Xu 001 (ICRA, 2024)

MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens. - Anas Awadalla; Le Xue; Oscar Lo; Manli Shu; Hannah Lee; Etash Kumar Guha; Sheng Shen 001; Mohamed Awadalla; Silvio Savarese; Caiming Xiong; Ran Xu 001; Yejin Choi 001; et al. (NeurIPS, 2024)

TrustLLM: Trustworthiness in Large Language Models. - Lichao Sun 001; Yue Huang 001; Haoran Wang 005; Siyuan Wu 001; Qihui Zhang; Chujie Gao; Yixin Huang; Wenhan Lyu; Yixuan Zhang 001; Xiner Li; Zhengliang Liu; Yixin Liu 002; et al. (CoRR, 2024)

Text2Data: Low-Resource Data Generation with Textual Control. - Shiyu Wang; Yihao Feng; Tian Lan 006; Ning Yu 006; Yu Bai 017; Ran Xu 001; Huan Wang 014; Caiming Xiong; Silvio Savarese (CoRR, 2024)

MobileAIBench: Benchmarking LLMs and LMMs for On-Device Use Cases. - Rithesh Murthy; Liangwei Yang; Juntao Tan; Tulika Manoj Awalgaonkar; Yilun Zhou; Shelby Heinecke; Sachin Desai; Jason Wu; Ran Xu 001; Sarah Tan; Jianguo Zhang 005; Zhiwei Liu 001; et al. (CoRR, 2024)

MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens. - Anas Awadalla; Le Xue; Oscar Lo; Manli Shu; Hannah Lee; Etash Kumar Guha; Matt Jordan; Sheng Shen 001; Mohamed Awadalla; Silvio Savarese; Caiming Xiong; Ran Xu 001; et al. (CoRR, 2024)

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models. - Le Xue; Manli Shu; Anas Awadalla; Jun Wang 090; An Yan; Senthil Purushwalkam; Honglu Zhou; Viraj Prabhu; Yutong Dai 002; Michael S. Ryoo; Shrikant Kendre; Jieyu Zhang 001; et al. (CoRR, 2024)

xLAM: A Family of Large Action Models to Empower AI Agent Systems. - Jianguo Zhang 005; Tian Lan 006; Ming Zhu; Zuxin Liu; Thai Hoang; Shirley Kokane; Weiran Yao; Juntao Tan; Akshara Prabhakar; Haolin Chen; Zhiwei Liu 001; Yihao Feng; et al. (CoRR, 2024)

Trust but Verify: Programmatic VLM Evaluation in the Wild. - Viraj Prabhu; Senthil Purushwalkam; An Yan; Caiming Xiong; Ran Xu 001 (CoRR, 2024)

xGen-MM-Vid (BLIP-3-Video): You Only Need 32 Tokens to Represent a Video Even in VLMs. - Michael S. Ryoo; Honglu Zhou; Shrikant Kendre; Can Qin; Le Xue; Manli Shu; Silvio Savarese; Ran Xu 001; Caiming Xiong; Juan Carlos Niebles (CoRR, 2024)

BLIP3-KALE: Knowledge Augmented Large-Scale Dense Captions. - Anas Awadalla; Le Xue; Manli Shu; An Yan; Jun Wang 090; Senthil Purushwalkam; Sheng Shen 001; Hannah Lee; Oscar Lo; Jae Sung Park; Etash Kumar Guha; Silvio Savarese; et al. (CoRR, 2024)

ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models. - Jieyu Zhang 001; Le Xue; Linxin Song; Jun Wang 090; Weikai Huang; Manli Shu; An Yan; Zixian Ma; Juan Carlos Niebles; Silvio Savarese; Caiming Xiong; Zeyuan Chen 001; et al. (CoRR, 2024)

Text2Data: Low-Resource Data Generation with Textual Control. - Shiyu Wang; Yihao Feng; Tian Lan 006; Ning Yu 006; Yu Bai 017; Ran Xu 001; Huan Wang 016; Caiming Xiong; Silvio Savarese (AAAI, 2025)

xLAM: A Family of Large Action Models to Empower AI Agent Systems. - Jianguo Zhang; Tian Lan 006; Ming Zhu; Zuxin Liu; Thai Hoang; Shirley Kokane; Weiran Yao; Juntao Tan; Akshara Prabhakar; Haolin Chen; Zhiwei Liu 001; Yihao Feng; et al. (NAACL (Long Papers), 2025)

Could AI Trace and Explain the Origins of AI-Generated Images and Text? - Hongchao Fang; Yixin Liu 002; Jiangshu Du; Can Qin; Ran Xu 001; Feng Liu; Lichao Sun 001; Dongwon Lee; Lifu Huang; Wenpeng Yin 001 (CoRR, 2025)

DyMU: Dynamic Merging and Virtual Unmerging for Efficient VLMs. - Zhenhailong Wang; Senthil Purushwalkam; Caiming Xiong; Silvio Savarese; Heng Ji 001; Ran Xu 001 (CoRR, 2025)

BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset. - Jiuhai Chen; Zhiyang Xu; Xichen Pan; Yushi Hu; Can Qin; Tom Goldstein; Lifu Huang; Tianyi Zhou 001; Saining Xie; Silvio Savarese; Le Xue; Caiming Xiong; et al. (CoRR, 2025)

Contra4: Evaluating Contrastive Cross-Modal Reasoning in Audio, Video, Image, and 3D. - Artemis Panagopoulou; Le Xue; Honglu Zhou; Silvio Savarese; Ran Xu 001; Caiming Xiong; Chris Callison-Burch; Mark Yatskar; Juan Carlos Niebles (CoRR, 2025)

VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documents. - Rui Meng; Ziyan Jiang; Ye Liu 006; Mingyi Su; Xinyi Yang 002; Yuepeng Fu; Can Qin; Zeyuan Chen 001; Ran Xu 001; Caiming Xiong; Yingbo Zhou; Wenhu Chen; et al. (CoRR, 2025)

GTA1: GUI Test-time Scaling Agent. - Yan Yang; Dongxu Li; Yutong Dai 002; Yuhao Yang; Ziyang Luo; Zirui Zhao; Zhiyuan Hu; Junzhe Huang; Amrita Saha; Zeyuan Chen 001; Ran Xu 001; Liyuan Pan; et al. (CoRR, 2025)

CoAct-1: Computer-using Agents with Coding as Actions. - Linxin Song; Yutong Dai 002; Viraj Prabhu; Jieyu Zhang 001; Taiwei Shi; Li Li; Junnan Li 001; Silvio Savarese; Zeyuan Chen 001; Jieyu Zhao 001; Ran Xu 001; Caiming Xiong (CoRR, 2025)