Predicting Human Activities Using Stochastic Grammar. - Siyuan Qi; Siyuan Huang 001; Ping Wei 001; Song-Chun Zhu (ICCV, 2017)

Configurable, Photorealistic Image Rendering and Ground Truth Synthesis by Sampling Stochastic Grammars Representing Indoor Scenes. - Chenfanfu Jiang; Yixin Zhu 001; Siyuan Qi; Siyuan Huang 001; Jenny Lin; Xingwen Guo; Lap-Fai Yu; Demetri Terzopoulos; Song-Chun Zhu (CoRR, 2017)

Human-Centric Indoor Scene Synthesis Using Stochastic Grammar. - Siyuan Qi; Yixin Zhu 001; Siyuan Huang 001; Chenfanfu Jiang; Song-Chun Zhu (CVPR, 2018)

Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image. - Siyuan Huang 001; Siyuan Qi; Yixin Zhu 001; Yinxue Xiao; Yuanlu Xu; Song-Chun Zhu (ECCV (7), 2018)

Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation. - Siyuan Huang 001; Siyuan Qi; Yinxue Xiao; Yixin Zhu 001; Ying Nian Wu; Song-Chun Zhu (NeurIPS, 2018)

Configurable 3D Scene Synthesis and 2D Image Rendering with Per-pixel Ground Truth Using Stochastic Grammars. - Chenfanfu Jiang; Siyuan Qi; Yixin Zhu 001; Siyuan Huang 001; Jenny Lin; Lap-Fai Yu; Demetri Terzopoulos; Song-Chun Zhu (Int. J. Comput. Vis., 2018)

Holistic++ Scene Understanding: Single-View 3D Holistic Scene Parsing and Human Pose Estimation With Human-Object Interaction and Physical Commonsense. - Yixin Chen 003; Siyuan Huang 001; Tao Yuan; Yixin Zhu 001; Siyuan Qi; Song-Chun Zhu (ICCV, 2019)

Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning. - Lifeng Fan; Wenguan Wang; Song-Chun Zhu; Xinyu Tang 003; Siyuan Huang 001 (ICCV, 2019)

PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points. - Siyuan Huang 001; Yixin Chen 003; Tao Yuan; Siyuan Qi; Yixin Zhu 001; Song-Chun Zhu (NeurIPS, 2019)

LEMMA: A Multi-view Dataset for LEarning Multi-agent Multi-task Activities. - Baoxiong Jia; Yixin Chen 003; Siyuan Huang 001; Yixin Zhu 001; Song-Chun Zhu (ECCV (26), 2020)

A Competence-Aware Curriculum for Visual Concepts Learning via Question Answering. - Qing Li 003; Siyuan Huang 001; Yining Hong; Song-Chun Zhu (ECCV (2), 2020)

Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning. - Qing Li 003; Siyuan Huang 001; Yining Hong; Yixin Chen 003; Ying Nian Wu; Song-Chun Zhu (ICML, 2020)

Dark, Beyond Deep: A Paradigm Shift to Cognitive AI with Humanlike Common Sense. - Yixin Zhu 001; Tao Gao 004; Lifeng Fan; Siyuan Huang 001; Mark Edmonds; Hangxin Liu; Feng Gao 013; Chi Zhang 017; Siyuan Qi; Ying Nian Wu; Joshua B. Tenenbaum; Song-Chun Zhu (CoRR, 2020)

Learning by Fixing: Solving Math Word Problems with Weak Supervision. - Yining Hong; Qing Li 003; Daniel Ciao; Siyuan Huang 001; Song-Chun Zhu (AAAI, 2021)

SMART: A Situation Model for Algebra Story Problems via Attributed Grammar. - Yining Hong; Qing Li 003; Ran Gong; Daniel Ciao; Siyuan Huang 001; Song-Chun Zhu (AAAI, 2021)

Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning. - Pan Lu; Ran Gong; Shibiao Jiang; Liang Qiu 001; Siyuan Huang 001; Xiaodan Liang; Song-Chun Zhu (ACL/IJCNLP (1), 2021)

Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis. - Yaxuan Zhu; Ruiqi Gao; Siyuan Huang 001; Song-Chun Zhu; Ying Nian Wu (CVPR, 2021)

YouRefIt: Embodied Reference Understanding with Language and Gesture. - Yixin Chen 003; Qing Li 003; Deqian Kong; Yik Lun Kei; Song-Chun Zhu; Tao Gao 004; Yixin Zhu 001; Siyuan Huang 001 (ICCV, 2021)

VLGrammar: Grounded Grammar Induction of Vision and Language. - Yining Hong; Qing Li 003; Song-Chun Zhu; Siyuan Huang 001 (ICCV, 2021)

Spatio-temporal Self-Supervised Representation Learning for 3D Point Clouds. - Siyuan Huang 001; Yichen Xie 002; Song-Chun Zhu; Yixin Zhu 001 (ICCV, 2021)

A HINT from Arithmetic: On Systematic Generalization of Perception, Syntax, and Semantics. - Qing Li 003; Siyuan Huang 001; Yining Hong; Yixin Zhu 001; Ying Nian Wu; Song-Chun Zhu (CoRR, 2021)

A Generalized Earley Parser for Human Activity Parsing and Prediction. - Siyuan Qi; Baoxiong Jia; Siyuan Huang 001; Ping Wei 001; Song-Chun Zhu (IEEE Trans. Pattern Anal. Mach. Intell., 2021)

Human-like Holistic 3D Scene Understanding. - Siyuan Huang 001 (2021)

Learning V1 Simple Cells with Vector Representation of Local Content and Matrix Representation of Local Motion. - Ruiqi Gao; Jianwen Xie; Siyuan Huang 001; Yufan Ren; Song-Chun Zhu; Ying Nian Wu (AAAI, 2022)

EgoTaskQA: Understanding Human Tasks in Egocentric Videos. - Baoxiong Jia; Ting Lei; Song-Chun Zhu; Siyuan Huang 001 (NeurIPS, 2022)

HUMANISE: Language-conditioned Human Motion Generation in 3D Scenes. - Zan Wang; Yixin Chen 003; Tengyu Liu; Yixin Zhu 001; Wei Liang 008; Siyuan Huang 001 (NeurIPS, 2022)

PartAfford: Part-level Affordance Discovery from 3D Objects. - Chao Xu 016; Yixin Chen 003; He Wang 010; Song-Chun Zhu; Yixin Zhu 001; Siyuan Huang 001 (CoRR, 2022)

Unsupervised Object-Centric Learning with Bi-Level Optimized Query Slot Attention. - Baoxiong Jia; Yu Liu; Siyuan Huang 001 (CoRR, 2022)

Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation. - Jiangyong Huang; William Yicheng Zhu; Baoxiong Jia; Zan Wang; Xiaojian Ma 001; Qing Li 003; Siyuan Huang 001 (CoRR, 2022)

CHAIRS: Towards Full-Body Articulated Human-Object Interaction. - Nan Jiang; Tengyu Liu; Zhexuan Cao; Jieming Cui; Yixin Chen 003; He Wang 010; Yixin Zhu 001; Siyuan Huang 001 (CoRR, 2022)

GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Parts. - Haoran Geng; Helin Xu; Chengyang Zhao; Chao Xu 016; Li Yi 001; Siyuan Huang 001; He Wang 010 (CVPR, 2023)

Diffusion-based Generation, Optimization, and Planning in 3D Scenes. - Siyuan Huang 001; Zan Wang; Puhao Li; Baoxiong Jia; Tengyu Liu; Yixin Zhu 001; Wei Liang 008; Song-Chun Zhu (CVPR, 2023)

ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes. - Ran Gong; Jiangyong Huang; Yizhou Zhao; Haoran Geng; Xiaofeng Gao 002; Qingyang Wu; Wensi Ai; Ziheng Zhou; Demetri Terzopoulos; Song-Chun Zhu; Baoxiong Jia; Siyuan Huang 001 (ICCV, 2023)

Full-Body Articulated Human-Object Interaction. - Nan Jiang; Tengyu Liu; Zhexuan Cao; Jieming Cui; Zhiyuan Zhang; Yixin Chen 003; He Wang 010; Yixin Zhu 001; Siyuan Huang 001 (ICCV, 2023)

3D-VisTA: Pre-trained Transformer for 3D Vision and Text Alignment. - Ziyu Zhu; Xiaojian Ma 001; Yixin Chen 003; Zhidong Deng; Siyuan Huang 001; Qing Li 003 (ICCV, 2023)

A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics. - Qing Li 003; Siyuan Huang 001; Yining Hong; Yixin Zhu 001; Ying Nian Wu; Song-Chun Zhu (ICLR, 2023)

Improving Object-centric Learning with Query Optimization. - Baoxiong Jia; Yu Liu; Siyuan Huang 001 (ICLR, 2023)

SQA3D: Situated Question Answering in 3D Scenes. - Xiaojian Ma 001; Silong Yong; Zilong Zheng; Qing Li 003; Yitao Liang; Song-Chun Zhu; Siyuan Huang 001 (ICLR, 2023)

GenDexGrasp: Generalizable Dexterous Grasping. - Puhao Li; Tengyu Liu; Yuyang Li; Yiran Geng; Yixin Zhu 001; Yaodong Yang 001; Siyuan Huang 001 (ICRA, 2023)

ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab. - Jieming Cui; Ziren Gong; Baoxiong Jia; Siyuan Huang 001; Zilong Zheng; Jianzhu Ma; Yixin Zhu 001 (NeurIPS, 2023)

Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture. - Yixin Chen 003; Junfeng Ni; Nan Jiang; Yaowei Zhang; Yixin Zhu 001; Siyuan Huang 001 (3DV, 2024)

AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents. - Jieming Cui; Tengyu Liu; Nian Liu; Yaodong Yang 001; Yixin Zhu 001; Siyuan Huang 001 (CVPR, 2024)

Scaling Up Dynamic Human-Scene Interaction Modeling. - Nan Jiang; Zhiyuan Zhang; Hongjie Li; Xiaoxuan Ma 001; Zan Wang; Yixin Chen 003; Tengyu Liu; Yixin Zhu 001; Siyuan Huang 001 (CVPR, 2024)

Move as you Say, Interact as you can: Language-Guided Human Motion Generation with Scene Affordance. - Zan Wang; Yixin Chen 003; Baoxiong Jia; Puhao Li; Jinlu Zhang; Jingze Zhang; Tengyu Liu; Yixin Zhu 001; Wei Liang 008; Siyuan Huang 001 (CVPR, 2024)

PhyScene: Physically Interactable 3D Scene Synthesis for Embodied AI. - Yandan Yang; Baoxiong Jia; Peiyuan Zhi; Siyuan Huang 001 (CVPR, 2024)

SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understanding. - Baoxiong Jia; Yixin Chen 003; Huangyue Yu; Yan Wang 116; Xuesong Niu; Tengyu Liu; Qing Li 003; Siyuan Huang 001 (ECCV (9), 2024)

SlotLifter: Slot-Guided Feature Lifting for Learning Object-Centric Radiance Fields. - Yu Liu; Baoxiong Jia; Yixin Chen 003; Siyuan Huang 001 (ECCV (9), 2024)

F-HOI: Toward Fine-Grained Semantic-Aligned 3D Human-Object Interactions. - Jie Yang; Xuesong Niu; Nan Jiang; Ruimao Zhang; Siyuan Huang 001 (ECCV (37), 2024)

Unifying 3D Vision-Language Understanding via Promptable Queries. - Ziyu Zhu; Zhuofan Zhang; Xiaojian Ma 001; Xuesong Niu; Yixin Chen 003; Baoxiong Jia; Zhidong Deng; Siyuan Huang 001; Qing Li 003 (ECCV (44), 2024)

Neural-Symbolic Recursive Machine for Systematic Generalization. - Qing Li 003; Yixin Zhu 001; Yitao Liang; Ying Nian Wu; Song-Chun Zhu; Siyuan Huang 001 (ICLR, 2024)

An Embodied Generalist Agent in 3D World. - Jiangyong Huang; Silong Yong; Xiaojian Ma 001; Xiongkun Linghu; Puhao Li; Yan Wang 116; Qing Li 003; Song-Chun Zhu; Baoxiong Jia; Siyuan Huang 001 (ICML, 2024)

Ag2Manip: Learning Novel Manipulation Skills with Agent-Agnostic Visual and Action Representations. - Puhao Li; Tengyu Liu; Yuyang Li; Muzhi Han; Haoran Geng; Shu Wang 002; Yixin Zhu 001; Song-Chun Zhu; Siyuan Huang 001 (IROS, 2024)

Multi-modal Situated Reasoning in 3D Scenes. - Xiongkun Linghu; Jiangyong Huang; Xuesong Niu; Xiaojian (Shawn) Ma; Baoxiong Jia; Siyuan Huang 001 (NeurIPS, 2024)

PhyRecon: Physically Plausible Neural Scene Reconstruction. - Junfeng Ni; Yixin Chen 003; Bohan Jing; Nan Jiang; Bin Wang; Bo Dai 025; Puhao Li; Yixin Zhu 001; Song-Chun Zhu; Siyuan Huang 001 (NeurIPS, 2024)

Autonomous Character-Scene Interaction Synthesis from Text Instruction. - Nan Jiang; Zimo He; Zi Wang; Hongjie Li; Yixin Chen 003; Siyuan Huang 001; Yixin Zhu 001 (SIGGRAPH Asia, 2024)

Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4V. - Peiyuan Zhi; Zhiyuan Zhang; Muzhi Han; Zeyu Zhang 001; Zhitian Li; Ziyuan Jiao; Baoxiong Jia; Siyuan Huang 001 (CoRR, 2024)

PhyRecon: Physically Plausible Neural Scene Reconstruction. - Junfeng Ni; Yixin Chen 003; Bohan Jing; Nan Jiang; Bin Wang; Bo Dai 025; Yixin Zhu 001; Song-Chun Zhu; Siyuan Huang 001 (CoRR, 2024)

Task-oriented Sequential Grounding in 3D Scenes. - Zhuofan Zhang; Ziyu Zhu; Pengxiang Li 002; Tengyu Liu; Xiaojian Ma 001; Yixin Chen 003; Baoxiong Jia; Siyuan Huang 001; Qing Li 003 (CoRR, 2024)

PhysPart: Physically Plausible Part Completion for Interactable Objects. - Rundong Luo; Haoran Geng; Congyue Deng; Puhao Li; Zan Wang; Baoxiong Jia; Leonidas J. Guibas; Siyuan Huang 001 (CoRR, 2024)

SYNERGAI: Perception Alignment for Human-Robot Collaboration. - Yixin Chen 003; Guoxi Zhang; Yaowei Zhang; Hongming Xu 003; Peiyuan Zhi; Qing Li 003; Siyuan Huang 001 (CoRR, 2024)

Grasp Multiple Objects With One Hand. - Yuyang Li; Bo Liu 039; Yiran Geng; Puhao Li; Yaodong Yang 001; Yixin Zhu 001; Tengyu Liu; Siyuan Huang 001 (IEEE Robotics Autom. Lett., 2024)

ManipTrans: Efficient Dexterous Bimanual Manipulation Transfer via Residual Learning. - Kailin Li 006; Puhao Li; Tengyu Liu; Yuyang Li; Siyuan Huang 001 (CVPR, 2025)

GROVE: A Generalized Reward for Learning Open-Vocabulary Physical Skill. - Jieming Cui; Tengyu Liu; Ziyu Meng; Jiale Yu; Ran Song 001; Wei Zhang 021; Yixin Zhu 001; Siyuan Huang 001 (CVPR, 2025)

Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysis. - Jiangyong Huang; Baoxiong Jia; Yan Wang 116; Ziyu Zhu; Xiongkun Linghu; Qing Li 003; Song-Chun Zhu; Siyuan Huang 001 (CVPR, 2025)

Dynamic Motion Blending for Versatile Motion Editing. - Nan Jiang; Hongjie Li; Ziye Yuan; Zimo He; Yixin Chen 003; Tengyu Liu; Yixin Zhu 001; Siyuan Huang 001 (CVPR, 2025)

MOVIS: Enhancing Multi-Object Novel View Synthesis for Indoor Scenes. - Ruijie Lu; Yixin Chen 003; Junfeng Ni; Baoxiong Jia; Yu Liu; Diwen Wan; Gang Zeng; Siyuan Huang 001 (CVPR, 2025)

Decompositional Neural Scene Reconstruction with Generative Diffusion Prior. - Junfeng Ni; Yu Liu; Ruijie Lu; Zirui Zhou; Song-Chun Zhu; Yixin Chen 003; Siyuan Huang 001 (CVPR, 2025)

Masked Point-Entity Contrast for Open-Vocabulary 3D Scene Understanding. - Yan Wang 116; Baoxiong Jia; Ziyu Zhu; Siyuan Huang 001 (CVPR, 2025)

METASCENES: Towards Automated Replica Creation for Real-world 3D Scans. - Huangyue Yu; Baoxiong Jia; Yixin Chen 003; Yandan Yang; Puhao Li; Rongpeng Su; Jiaxin Li; Qing Li 003; Wei Liang 008; Song-Chun Zhu; Tengyu Liu; Siyuan Huang 001 (CVPR, 2025)

Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting. - Yu Liu; Baoxiong Jia; Ruijie Lu; Junfeng Ni; Song-Chun Zhu; Siyuan Huang 001 (ICLR, 2025)

TACO: Taming Diffusion for in-the-wild Video Amodal Completion. - Ruijie Lu; Yixin Chen 003; Yu Liu; Jiaxiang Tang; Junfeng Ni; Diwen Wan; Gang Zeng; Siyuan Huang 001 (CoRR, 2025)

StyleLoco: Generative Adversarial Distillation for Natural Humanoid Robot Locomotion. - Le Ma; Ziyu Meng; Tengyu Liu; Yuhan Li 009; Ran Song 001; Wei Zhang 021; Siyuan Huang 001 (CoRR, 2025)

ARFlow: Human Action-Reaction Flow Matching with Physical Guidance. - Wentao Jiang; Jingya Wang; Haotao Lu; Kaiyang Ji; Baoxiong Jia; Siyuan Huang 001; Ye Shi 001 (CoRR, 2025)

Taccel: Scaling Up Vision-based Tactile Robotics via High-performance GPU Simulation. - Yuyang Li; Wenxin Du; Chang Yu 005; Puhao Li; Zihang Zhao; Tengyu Liu; Chenfanfu Jiang; Yixin Zhu 001; Siyuan Huang 001 (CoRR, 2025)

RoboVerse: Towards a Unified Platform, Dataset and Benchmark for Scalable and Generalizable Robot Learning. - Haoran Geng; Feishi Wang; Songlin Wei; Yuyang Li; Bangjun Wang; Boshi An; Charlie Tianyue Cheng; Haozhe Lou; Peihao Li; Yen-Jen Wang; Yutong Liang; Dylan Goetting; et al. (CoRR, 2025)

Learning Unified Force and Position Control for Legged Loco-Manipulation. - Peiyuan Zhi; Peiyang Li; Jianqin Yin; Baoxiong Jia; Siyuan Huang 001 (CoRR, 2025)

CLONE: Closed-Loop Whole-Body Humanoid Teleoperation for Long-Horizon Tasks. - Yixuan Li; Yutang Lin 001; Jieming Cui; Tengyu Liu; Wei Liang 008; Yixin Zhu 001; Siyuan Huang 001 (CoRR, 2025)

LEO-VL: Towards 3D Vision-Language Generalists via Data Scaling with Efficient Representation. - Jiangyong Huang; Xiaojian Ma 001; Xiongkun Linghu; Yue Fan; Junchao He; Wenxin Tan; Qing Li 003; Song-Chun Zhu; Yixin Chen 003; Baoxiong Jia; Siyuan Huang 001 (CoRR, 2025)

ControlVLA: Few-shot Object-centric Adaptation for Pre-trained Vision-Language-Action Models. - Puhao Li; Yingying Wu; Ziheng Xi; Wanlin Li; Yuzhe Huang; Zhiyuan Zhang; Yinghan Chen; Jianan Wang; Song-Chun Zhu; Tengyu Liu; Siyuan Huang 001 (CoRR, 2025)

Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation. - Ziyu Zhu; Xilin Wang; Yixuan Li; Zhuofan Zhang; Xiaojian Ma 001; Yixin Chen 003; Baoxiong Jia; Wei Liang 008; Qian Yu; Zhidong Deng; Siyuan Huang 001; Qing Li 003 (CoRR, 2025)

DreamArt: Generating Interactable Articulated Objects from a Single Image. - Ruijie Lu; Yu Liu; Jiaxiang Tang; Junfeng Ni; Yuxiang Wang; Diwen Wan; Gang Zeng; Yixin Chen 003; Siyuan Huang 001 (CoRR, 2025)

Ag2x2: Robust Agent-Agnostic Visual Representations for Zero-Shot Bimanual Manipulation. - Ziyin Xiong; Yinghan Chen; Puhao Li; Yixin Zhu 001; Tengyu Liu; Siyuan Huang 001 (CoRR, 2025)

Spatial-Temporal Multi-Scale Quantization for Flexible Motion Generation. - Zan Wang; Jingze Zhang; Yixin Chen 003; Baoxiong Jia; Wei Liang 008; Siyuan Huang 001 (CoRR, 2025)