Joint inference of groups, events and human roles in aerial videos. - Tianmin Shu; Dan Xie; Brandon Rothrock; Sinisa Todorovic; Song-Chun Zhu (CVPR, 2015)

Critical Features of Joint Actions that Signal Human Interaction. - Tianmin Shu; Steven M. Thurman; Dawn Chen; Song-Chun Zhu; Hongjing Lu (CogSci, 2016)

Learning Social Affordance for Human-Robot Interaction. - Tianmin Shu; Michael S. Ryoo; Song-Chun Zhu (IJCAI, 2016)

Modeling and Inferring Human Intents and Latent Functional Objects for Trajectory Prediction. - Dan Xie; Tianmin Shu; Sinisa Todorovic; Song-Chun Zhu (CoRR, 2016)

Inferring Human Interaction from Motion Trajectories in Aerial Videos. - Tianmin Shu; Yujia Peng; Lifeng Fan; Hongjing Lu; Song-Chun Zhu (CogSci, 2017)

CERN: Confidence-Energy Recurrent Network for Group Activity Recognition. - Tianmin Shu; Sinisa Todorovic; Song-Chun Zhu (CVPR, 2017)

Learning social affordance grammar from videos: Transferring human interactions to human-robot interactions. - Tianmin Shu; Xiaofeng Gao 002; Michael S. Ryoo; Song-Chun Zhu (ICRA, 2017)

Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks. - Ping Wei 001; Yang Liu 266; Tianmin Shu; Nanning Zheng 001; Song-Chun Zhu (CVPR, 2018)

Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learning. - Tianmin Shu; Caiming Xiong; Richard Socher (ICLR (Poster), 2018)

Interactive Agent Modeling by Learning to Probe. - Tianmin Shu; Caiming Xiong; Ying Nian Wu; Song-Chun Zhu (CoRR, 2018)

Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos. - Dan Xie; Tianmin Shu; Sinisa Todorovic; Song-Chun Zhu (IEEE Trans. Pattern Anal. Mach. Intell., 2018)

Perception of Human Interaction Based on Motion Trajectories: From Aerial Videos to Decontextualized Animations. - Tianmin Shu; Yujia Peng; Lifeng Fan; Hongjing Lu; Song-Chun Zhu (Top. Cogn. Sci., 2018)

Partitioning the Perception of Physical and Social Events Within a Unified Psychological Space. - Tianmin Shu; Yujia Peng; Hongjing Lu; Song-Chun Zhu (CogSci, 2019)

M^3RL: Mind-aware Multi-agent Management Reinforcement Learning. - Tianmin Shu; Yuandong Tian (ICLR (Poster), 2019)

VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learning. - Xiaofeng Gao 002; Ran Gong; Tianmin Shu; Xu Xie 001; Shu Wang 002; Song-Chun Zhu (CoRR, 2019)

Social Scene Understanding: Group Activity Parsing, Human-Robot Interactions, and Perception of Animacy. - Tianmin Shu (2019)

Jointly learning motion verbs and frame semantics from natural language and grounded scenes. - Jon Gauthier; Jiayuan Mao; Tianmin Shu; Roger Levy; Josh Tenenbaum 001 (CogSci, 2020)

Adventures in Flatland: Perceiving Social Interactions Under Physical Dynamics. - Tianmin Shu; Marta Kryven; Tomer D. Ullman; Josh Tenenbaum 001 (CogSci, 2020)

Active Visual Information Gathering for Vision-Language Navigation. - Hanqing Wang 001; Wenguan Wang; Tianmin Shu; Wei Liang 008; Jianbing Shen (ECCV (22), 2020)

Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks. - Xiaofeng Gao 002; Ran Gong; Yizhou Zhao; Shu Wang 002; Tianmin Shu; Song-Chun Zhu (RO-MAN, 2020)

Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration. - Xavier Puig; Tianmin Shu; Shuang Li 013; Zilin Wang; Joshua B. Tenenbaum; Sanja Fidler; Antonio Torralba 001 (CoRR, 2020)

Learning to infer human attention in daily activities. - Zhixiong Nan; Tianmin Shu; Ran Gong; Shu Wang 002; Ping Wei 001; Song-Chun Zhu; Nanning Zheng 001 (Pattern Recognit., 2020)

PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception. - Aviv Netanyahu; Tianmin Shu; Boris Katz; Andrei Barbu; Joshua B. Tenenbaum (AAAI, 2021)

Social Interactions as Recursive MDPs. - Ravi Tejwani; Yen-Ling Kuo; Tianmin Shu; Boris Katz; Andrei Barbu (CoRL, 2021)

Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration. - Xavier Puig; Tianmin Shu; Shuang Li 013; Zilin Wang; Yuan-Hong Liao; Joshua B. Tenenbaum; Sanja Fidler; Antonio Torralba 001 (ICLR, 2021)

AGENT: A Benchmark for Core Psychological Reasoning. - Tianmin Shu; Abhishek Bhandwaldar; Chuang Gan 001; Kevin A. Smith 001; Shari Liu; Dan Gutfreund; Elizabeth S. Spelke; Joshua B. Tenenbaum; Tomer D. Ullman (ICML, 2021)

RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning. - Mingkai Deng; Jianyu Wang; Cheng-Ping Hsieh; Yihan Wang; Han Guo; Tianmin Shu; Meng Song; Eric P. Xing; Zhiting Hu (EMNLP, 2022)

Discovering Generalizable Spatial Goal Representations via Graph-based Active Reward Learning. - Aviv Netanyahu; Tianmin Shu; Joshua B. Tenenbaum; Pulkit Agrawal 001 (ICML, 2022)

Incorporating Rich Social Interactions Into MDPs. - Ravi Tejwani; Yen-Ling Kuo; Tianmin Shu; Bennett Stankovits; Dan Gutfreund; Joshua B. Tenenbaum; Boris Katz; Andrei Barbu (ICRA, 2022)

Coordinating Policies Among Multiple Agents via an Intelligent Communication Channel. - Dianbo Liu; Vedant Shah; Oussama Boussif; Cristian Meo; Anirudh Goyal; Tianmin Shu; Michael Mozer; Nicolas Heess; Yoshua Bengio (CoRR, 2022)

Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration. - Xiaofeng Gao 002; Luyao Yuan; Tianmin Shu; Hongjing Lu; Song-Chun Zhu (IEEE Robotics Autom. Lett., 2022)

Zero-Shot Linear Combinations of Grounded Social Interactions with Linear Social MDPs. - Ravi Tejwani; Yen-Ling Kuo; Tianmin Shu; Bennett Stankovits; Dan Gutfreund; Joshua B. Tenenbaum; Boris Katz; Andrei Barbu (AAAI, 2023)

Stateful Active Facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning. - Dianbo Liu; Vedant Shah; Oussama Boussif; Cristian Meo; Anirudh Goyal; Tianmin Shu; Michael Curtis Mozer; Nicolas Heess; Yoshua Bengio (ICLR, 2023)

Diagnosis, Feedback, Adaptation: A Human-in-the-Loop Framework for Test-Time Policy Adaptation. - Andi Peng; Aviv Netanyahu; Mark K. Ho; Tianmin Shu; Andreea Bobu; Julie Shah; Pulkit Agrawal 001 (ICML, 2023)

NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistants. - Xavier Puig; Tianmin Shu; Joshua B. Tenenbaum; Antonio Torralba 001 (ICRA, 2023)

Language Models Meet World Models: Embodied Experiences Enhance Language Models. - Jiannan Xiang; Tianhua Tao; Yi Gu; Tianmin Shu; Zirui Wang; Zichao Yang; Zhiting Hu (NeurIPS, 2023)

The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker? - Chuanyang Jin; Songyang Zhang; Tianmin Shu; Zhihan Cui (CoRR, 2023)

Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning. - Zhiting Hu; Tianmin Shu (CoRR, 2023)

Neural Amortized Inference for Nested Multi-Agent Reasoning. - Kunal Jha; Tuan Anh Le 001; Chuanyang Jin; Yen-Ling Kuo; Joshua B. Tenenbaum; Tianmin Shu (AAAI, 2024)

MMToM-QA: Multimodal Theory of Mind Question Answering. - Chuanyang Jin; Yutong Wu; Jing Cao; Jiannan Xiang; Yen-Ling Kuo; Zhiting Hu; Tomer D. Ullman; Antonio Torralba 001; Joshua B. Tenenbaum; Tianmin Shu (ACL (1), 2024)

Building Cooperative Embodied Agents Modularly with Large Language Models. - Hongxin Zhang; Weihua Du; Jiaming Shan; Qinhong Zhou; Yilun Du; Joshua B. Tenenbaum; Tianmin Shu; Chuang Gan 001 (ICLR, 2024)

Pragmatic Feature Preferences: Learning Reward-Relevant Preferences from Human Input. - Andi Peng; Yuying Sun; Tianmin Shu; David Abel (ICML, 2024)

Risk-Bounded Online Team Interventions via Theory of Mind. - Yuening Zhang; Paul Robertson 001; Tianmin Shu; Sungkweon Hong; Brian C. Williams (ICRA, 2024)

GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment. - Lance Ying; Kunal Jha; Shivam Aarya; Joshua B. Tenenbaum; Antonio Torralba 001; Tianmin Shu (IROS, 2024)

Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge. - Weihua Du; Qiushi Lyu; Jiaming Shan; Zhenting Qi; Hongxin Zhang; Sunli Chen; Andi Peng; Tianmin Shu; Kwonjoon Lee; Behzad Dariush; Chuang Gan 001 (NeurIPS, 2024)

Few-Shot Task Learning through Inverse Generative Modeling. - Aviv Netanyahu; Yilun Du; Antonia Bronars; Jyothish Pari; Josh Tenenbaum 001; Tianmin Shu; Pulkit Agrawal 001 (NeurIPS, 2024)

COMBO: Compositional World Models for Embodied Multi-Agent Cooperation. - Hongxin Zhang; Zeyuan Wang; Qiushi Lyu; Zheyuan Zhang; Sunli Chen; Tianmin Shu; Yilun Du; Chuang Gan 001 (CoRR, 2024)

SIFToM: Robust Spoken Instruction Following through Theory of Mind. - Lance Ying; Jason Xinyu Liu; Shivam Aarya; Yizirui Fang; Stefanie Tellex; Joshua B. Tenenbaum; Tianmin Shu (CoRR, 2024)

Generative World Explorer. - Taiming Lu; Tianmin Shu; Alan L. Yuille; Daniel Khashabi; Jieneng Chen (CoRR, 2024)

GenEx: Generating an Explorable World. - Taiming Lu; Tianmin Shu; Junfei Xiao; Luoxin Ye; Jiahao Wang 001; Cheng Peng 008; Chen Wei; Daniel Khashabi; Rama Chellappa; Alan L. Yuille; Jieneng Chen (CoRR, 2024)

MuMA-ToM: Multi-modal Multi-Agent Theory of Mind. - Haojun Shi; Suyu Ye; Xinyu Fang; Chuanyang Jin; Leyla Isik; Yen-Ling Kuo; Tianmin Shu (AAAI, 2025)

Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation. - Qiyue Gao; Xinyu Pi; Kevin Liu; Junrong Chen; Ruolan Yang; Xinqi Huang; Xinyu Fang; Lu Sun; Gautham Kishore; Bo Ai 008; Stone Tao; Mengyang Liu; et al. (ACL (Findings), 2025)

GenEx: Generating an Explorable World. - Taiming Lu; Tianmin Shu; Alan L. Yuille; Daniel Khashabi; Jieneng Chen (ICLR, 2025)

COMBO: Compositional World Models for Embodied Multi-Agent Cooperation. - Hongxin Zhang; Zeyuan Wang; Qiushi Lyu; Zheyuan Zhang; Sunli Chen; Tianmin Shu; Behzad Dariush; Kwonjoon Lee; Yilun Du; Chuang Gan 001 (ICLR, 2025)

AutoToM: Automated Bayesian Inverse Planning and Model Discovery for Open-ended Theory of Mind. - Zhining Zhang; Chuanyang Jin; Mung Yao Jia; Tianmin Shu (CoRR, 2025)

On Benchmarking Human-Like Intelligence in Machines. - Lance Ying; Katherine M. Collins; Lionel Wong; Ilia Sucholutsky; Ryan Liu 001; Adrian Weller; Tianmin Shu; Thomas L. Griffiths 001; Joshua B. Tenenbaum (CoRR, 2025)

RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Users. - Suyu Ye; Haojun Shi; Darren Shih; Hyokun Yun; Tanya Roosta; Tianmin Shu (CoRR, 2025)

Position: Foundation Models Need Digital Twin Representations. - Yiqing Shen 003; Hao Ding; Lalithkumar Seenivasan; Tianmin Shu; Mathias Unberath (CoRR, 2025)

Aligning Explanations with Human Communication. - Jacopo Teneggi; Zhenzhen Wang; Paul H. Yi; Tianmin Shu; Jeremias Sulam (CoRR, 2025)

PartInstruct: Part-level Instruction Following for Fine-grained Robot Manipulation. - Yifan Yin; Zhengtao Han; Shivam Aarya; Jianxin Wang; Shuhang Xu; Jiawei Peng; Angtian Wang; Alan L. Yuille; Tianmin Shu (CoRR, 2025)

Augmented Vision-Language Models: A Systematic Review. - Anthony C. Davis; Burhan Sadiq; Tianmin Shu; Chien-Ming Huang (CoRR, 2025)