Adversarial Task Transfer from Preference. - Xiaojian Ma 001; Mingxuan Jing; Fuchun Sun 001; Huaping Liu 001 (CoRR, 2018)

Learning and Inference Movement with Deep Generative Model. - Mingxuan Jing; Xiaojian Ma 001; Fuchun Sun 001; Huaping Liu 001 (CoRR, 2018)

Task Transfer by Preference-Based Cost Learning. - Mingxuan Jing; Xiaojian Ma 001; Wen-bing Huang 001; Fuchun Sun 001; Huaping Liu 001 (AAAI, 2019)

Vision-based Teleoperation of Shadow Dexterous Hand using End-to-End Deep Neural Network. - Shuang Li 014; Xiaojian Ma 001; Hongzhuo Liang; Michael Görner; Philipp Ruppel; Bin Fang 003; Fuchun Sun 001; Jianwei Zhang 001 (ICRA, 2019)

PointNetGPD: Detecting Grasp Configurations from Point Sets. - Hongzhuo Liang; Xiaojian Ma 001; Shuang Li 014; Michael Görner; Song Tang 001; Bin Fang 003; Fuchun Sun 001; Jianwei Zhang 001 (ICRA, 2019)

Making Sense of Audio Vibration for Liquid Height Estimation in Robotic Pouring. - Hongzhuo Liang; Shuang Li 014; Xiaojian Ma 001; Norman Hendrich; Timo Gerkmann; Fuchun Sun 001; Jianwei Zhang 001 (IROS, 2019)

Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement. - Chao Yang 026; Xiaojian Ma 001; Wenbing Huang 001; Fuchun Sun 001; Huaping Liu 001; Junzhou Huang; Chuang Gan 001 (NeurIPS, 2019)

Making Sense of Audio Vibration for Liquid Height Estimation in Robotic Pouring. - Hongzhuo Liang; Shuang Li 014; Xiaojian Ma 001; Norman Hendrich; Timo Gerkmann; Jianwei Zhang 001 (CoRR, 2019)

Theory-Based Causal Transfer: Integrating Instance-Level Induction and Abstract-Level Structure Learning. - Mark Edmonds; Xiaojian Ma 001; Siyuan Qi; Yixin Zhu 001; Hongjing Lu; Song-Chun Zhu (AAAI, 2020)

Reinforcement Learning from Imperfect Demonstrations under Soft Expert Guidance. - Mingxuan Jing; Xiaojian Ma 001; Wenbing Huang 001; Fuchun Sun 001; Chao Yang 026; Bin Fang 003; Huaping Liu 001 (AAAI, 2020)

A Mobile Robot Hand-Arm Teleoperation System by Vision and IMU. - Shuang Li 014; Jiaxi Jiang; Philipp Ruppel; Hongzhuo Liang; Xiaojian Ma 001; Norman Hendrich; Fuchun Sun 001; Jianwei Zhang 001 (IROS, 2020)

Robust Robotic Pouring using Audition and Haptics. - Hongzhuo Liang; Chuangchuang Zhou; Shuang Li 014; Xiaojian Ma 001; Norman Hendrich; Timo Gerkmann; Fuchun Sun 001; Marcus Stoffel; Jianwei Zhang 001 (IROS, 2020)

Robust Robotic Pouring using Audition and Haptics. - Hongzhuo Liang; Chuangchuang Zhou; Shuang Li 014; Xiaojian Ma 001; Norman Hendrich; Timo Gerkmann; Fuchun Sun 001; Jianwei Zhang 001 (CoRR, 2020)

Adversarial Option-Aware Hierarchical Imitation Learning. - Mingxuan Jing; Wenbing Huang 001; Fuchun Sun 001; Xiaojian Ma 001; Tao Kong; Chuang Gan 001; Lei Li 005 (ICML, 2021)

Unsupervised Foreground Extraction via Deep Region Competition. - Peiyu Yu; Sirui Xie; Xiaojian Ma 001; Yixin Zhu 001; Ying Nian Wu; Song-Chun Zhu (NeurIPS, 2021)

HALMA: Humanlike Abstraction Learning Meets Affordance in Rapid Problem Solving. - Sirui Xie; Xiaojian Ma 001; Peiyu Yu; Yixin Zhu 001; Ying Nian Wu; Song-Chun Zhu (CoRR, 2021)

Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactions. - Huaizu Jiang; Xiaojian Ma 001; Weili Nie; Zhiding Yu; Yuke Zhu; Anima Anandkumar (CVPR, 2022)

RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning. - Xiaojian Ma 001; Weili Nie; Zhiding Yu; Huaizu Jiang; Chaowei Xiao; Yuke Zhu; Song-Chun Zhu; Anima Anandkumar (ICLR, 2022)

Latent Diffusion Energy-Based Model for Interpretable Text Modelling. - Peiyu Yu; Sirui Xie; Xiaojian Ma 001; Baoxiong Jia; Bo Pang 004; Ruiqi Gao; Yixin Zhu 001; Song-Chun Zhu; Ying Nian Wu (ICML, 2022)

Latent Diffusion Energy-Based Model for Interpretable Text Modeling. - Peiyu Yu; Sirui Xie; Xiaojian Ma 001; Baoxiong Jia; Bo Pang 004; Ruiqi Gao; Yixin Zhu 001; Song-Chun Zhu; Ying Nian Wu (CoRR, 2022)

Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation. - Jiangyong Huang; William Yicheng Zhu; Baoxiong Jia; Zan Wang; Xiaojian Ma 001; Qing Li 003; Siyuan Huang 001 (CoRR, 2022)

Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction. - Shaofei Cai; Zihao Wang; Xiaojian Ma 001; Anji Liu; Yitao Liang (CVPR, 2023)

3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment. - Ziyu Zhu; Xiaojian Ma 001; Yixin Chen 003; Zhidong Deng; Siyuan Huang 001; Qing Li 003 (ICCV, 2023)

SQA3D: Situated Question Answering in 3D Scenes. - Xiaojian Ma 001; Silong Yong; Zilong Zheng; Qing Li 003; Yitao Liang; Song-Chun Zhu; Siyuan Huang 001 (ICLR, 2023)

Describe, Explain, Plan and Select: Interactive Planning with LLMs Enables Open-World Multi-Task Agents. - Zihao Wang; Shaofei Cai; Guanzhou Chen 003; Anji Liu; Xiaojian Ma 001; Yitao Liang (NeurIPS, 2023)

Learning Energy-Based Prior Model with Diffusion-Amortized MCMC. - Peiyu Yu; Yaxuan Zhu; Sirui Xie; Xiaojian Ma 001; Ruiqi Gao; Song-Chun Zhu; Ying Nian Wu (NeurIPS, 2023)

Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents. - Zihao Wang; Shaofei Cai; Anji Liu; Xiaojian Ma 001; Yitao Liang (CoRR, 2023)

MindAgent: Emergent Gaming Interaction. - Ran Gong; Qiuyuan Huang; Xiaojian Ma 001; Hoi Vo; Zane Durante; Yusuke Noda; Zilong Zheng; Song-Chun Zhu; Demetri Terzopoulos; Li Fei-Fei 001; Jianfeng Gao 001 (CoRR, 2023)

CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update. - Zhi Gao; Yuntao Du 001; Xintong Zhang; Xiaojian Ma 001; Wenjuan Han; Song-Chun Zhu; Qing Li 003 (CVPR, 2024)

[inline-graphic not available: see fulltext]VideoAgent: A Memory-Augmented Multimodal Agent for Video Understanding. - Yue Fan; Xiaojian Ma 001; Rujie Wu; Yuntao Du 001; Jiaqi Li; Zhi Gao; Qing Li 003 (ECCV (22), 2024)

Unifying 3D Vision-Language Understanding via Promptable Queries. - Ziyu Zhu; Zhuofan Zhang; Xiaojian Ma 001; Xuesong Niu; Yixin Chen 003; Baoxiong Jia; Zhidong Deng; Siyuan Huang 001; Qing Li 003 (ECCV (44), 2024)

GROOT: Learning to Follow Instructions by Watching Gameplay Videos. - Shaofei Cai; Bowei Zhang 007; Zihao Wang; Xiaojian Ma 001; Anji Liu; Yitao Liang (ICLR, 2024)

Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World. - Rujie Wu; Xiaojian Ma 001; Zhenliang Zhang 002; Wei Wang 115; Qing Li 003; Song-Chun Zhu; Yizhou Wang 001 (ICLR, 2024)

MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning. - Haozhe Zhao; Zefan Cai; Shuzheng Si; Xiaojian Ma 001; Kaikai An; Liang Chen 024; Zixuan Liu 001; Sheng Wang 012; Wenjuan Han; Baobao Chang (ICLR, 2024)

An Embodied Generalist Agent in 3D World. - Jiangyong Huang; Silong Yong; Xiaojian Ma 001; Xiongkun Linghu; Puhao Li; Yan Wang 116; Qing Li 003; Song-Chun Zhu; Baoxiong Jia; Siyuan Huang 001 (ICML, 2024)

MindAgent: Emergent Gaming Interaction. - Ran Gong; Qiuyuan Huang; Xiaojian Ma 001; Yusuke Noda; Zane Durante; Zilong Zheng; Demetri Terzopoulos; Li Fei-Fei 001; Jianfeng Gao 001; Hoi Vo (NAACL-HLT (Findings), 2024)

Multi-modal Situated Reasoning in 3D Scenes. - Xiongkun Linghu; Jiangyong Huang; Xuesong Niu; Xiaojian (Shawn) Ma; Baoxiong Jia; Siyuan Huang 001 (NeurIPS, 2024)

OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents. - Zihao Wang; Shaofei Cai; Zhancun Mu; Haowei Lin; Ceyao Zhang; Xuejie Liu; Qing Li 003; Anji Liu; Xiaojian (Shawn) Ma; Yitao Liang (NeurIPS, 2024)

UltraEdit: Instruction-based Fine-Grained Image Editing at Scale. - Haozhe Zhao; Xiaojian (Shawn) Ma; Liang Chen 024; Shuzheng Si; Rujie Wu; Kaikai An; Peiyu Yu; Minjia Zhang; Qing Li 003; Baobao Chang (NeurIPS, 2024)

RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation. - Zihao Wang; Anji Liu; Haowei Lin; Jiaqi Li; Xiaojian Ma 001; Yitao Liang (CoRR, 2024)

VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding. - Yue Fan; Xiaojian Ma 001; Rujie Wu; Yuntao Du 001; Jiaqi Li; Zhi Gao; Qing Li 003 (CoRR, 2024)

Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting. - Jun Guo 009; Xiaojian Ma 001; Yue Fan; Huaping Liu 001; Qing Li 003 (CoRR, 2024)

Latent Energy-Based Odyssey: Black-Box Optimization via Expanded Exploration in the Energy-Based Latent Space. - Peiyu Yu; Dinghuai Zhang; Hengzhi He; Xiaojian Ma 001; Ruiyao Miao; Yifan Lu; Yasi Zhang; Deqian Kong; Ruiqi Gao; Jianwen Xie; Guang Cheng 003; Ying Nian Wu (CoRR, 2024)

Task-oriented Sequential Grounding in 3D Scenes. - Zhuofan Zhang; Ziyu Zhu; Pengxiang Li 002; Tengyu Liu; Xiaojian Ma 001; Yixin Chen 003; Baoxiong Jia; Siyuan Huang 001; Qing Li 003 (CoRR, 2024)

ROCKET-1: Master Open-World Interaction with Visual-Temporal Context Prompting. - Shaofei Cai; Zihao Wang; Kewei Lian; Zhancun Mu; Xiaojian Ma 001; Anji Liu; Yitao Liang (CoRR, 2024)

GROOT-2: Weakly Supervised Multi-Modal Instruction Following Agents. - Shaofei Cai; Bowei Zhang 007; Zihao Wang; Haowei Lin; Xiaojian Ma 001; Anji Liu; Yitao Liang (CoRR, 2024)

JARVIS-VLA: Post-Training Large-Scale Vision Language Models to Play Visual Games with Keyboards and Mouse. - Muyao Li; Zihao Wang; Kaichen He; Xiaojian Ma 001; Yitao Liang (ACL (Findings), 2025)

ROCKET-1: Mastering Open-World Interaction with Visual-Temporal Context Prompting. - Shaofei Cai; Zihao Wang; Kewei Lian; Zhancun Mu; Xiaojian Ma 001; Anji Liu; Yitao Liang (CVPR, 2025)

GROOT-2: Weakly Supervised Multimodal Instruction Following Agents. - Shaofei Cai; Bowei Zhang 007; Zihao Wang; Haowei Lin; Xiaojian Ma 001; Anji Liu; Yitao Liang (ICLR, 2025)

Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage. - Zhi Gao; Bofei Zhang; Pengxiang Li 002; Xiaojian Ma 001; Tao Yuan; Yue Fan; Yuwei Wu 001; Yunde Jia; Song-Chun Zhu; Qing Li 003 (ICLR, 2025)

Embodied VideoAgent: Persistent Memory from Egocentric Videos and Embodied Sensors Enables Dynamic Scene Understanding. - Yue Fan; Xiaojian Ma 001; Rongpeng Su; Jun Guo 009; Rujie Wu; Xi Chen; Qing Li 003 (CoRR, 2025)

LongViTU: Instruction Tuning for Long-Form Video Understanding. - Rujie Wu; Xiaojian Ma 001; Hai Ci; Yue Fan; Yuxuan Wang 004; Haozhe Zhao; Qing Li 003; Yizhou Wang 001 (CoRR, 2025)

Fast Visuomotor Policies via Partial Denoising. - Haojun Chen; Minghao Liu; Xiaojian Ma 001; Zailin Ma; Huimin Wu; Chengdong Ma; Yuanpei Chen; Yifan Zhong; Mingzhi Wang; Qing Li 003; Yaodong Yang 001 (CoRR, 2025)

JARVIS-1: Open-World Multi-Task Agents With Memory-Augmented Multimodal Language Models. - Zihao Wang; Shaofei Cai; Anji Liu; Yonggang Jin; Jinbing Hou; Bowei Zhang 007; Haowei Lin; Zhaofeng He; Zilong Zheng; Yaodong Yang 001; Xiaojian Ma 001; Yitao Liang (IEEE Trans. Pattern Anal. Mach. Intell., 2025)

Building LLM Agents by Incorporating Insights from Computer Systems. - Yapeng Mi; Zhi Gao; Xiaojian Ma 001; Qing Li 003 (CoRR, 2025)

TongUI: Building Generalized GUI Agents by Learning from Multimodal Web Tutorials. - Bofei Zhang; Zirui Shang; Zhi Gao; Wang Zhang; Rui Xie; Xiaojian Ma 001; Tao Yuan; Xinxiao Wu; Song-Chun Zhu; Qing Li 003 (CoRR, 2025)

Iterative Trajectory Exploration for Multimodal Agents. - Pengxiang Li 002; Zhi Gao; Bofei Zhang; Yapeng Mi; Xiaojian Ma 001; Chenrui Shi; Tao Yuan; Yuwei Wu 001; Yunde Jia; Song-Chun Zhu; Qing Li 003 (CoRR, 2025)

FlowDreamer: A RGB-D World Model with Flow-based Motion Representations for Robot Manipulation. - Jun Guo 009; Xiaojian Ma 001; Yikai Wang 001; Min Yang; Huaping Liu 001; Qing Li 003 (CoRR, 2025)

From Objects to Anywhere: A Holistic Benchmark for Multi-level Visual Grounding in 3D Scenes. - Tianxu Wang; Zhuofan Zhang; Ziyu Zhu; Yue Fan; Jing Xiong; Pengxiang Li 002; Xiaojian Ma 001; Qing Li 003 (CoRR, 2025)

LEO-VL: Towards 3D Vision-Language Generalists via Data Scaling with Efficient Representation. - Jiangyong Huang; Xiaojian Ma 001; Xiongkun Linghu; Yue Fan; Junchao He; Wenxin Tan; Qing Li 003; Song-Chun Zhu; Yixin Chen 003; Baoxiong Jia; Siyuan Huang 001 (CoRR, 2025)

Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation. - Ziyu Zhu; Xilin Wang; Yixuan Li; Zhuofan Zhang; Xiaojian Ma 001; Yixin Chen 003; Baoxiong Jia; Wei Liang 008; Qian Yu; Zhidong Deng; Siyuan Huang 001; Qing Li 003 (CoRR, 2025)