Tianmin Shu

According to our database, Tianmin Shu authored at least 42 papers between 2015 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

GOMA: Proactive Embodied Cooperative Communication via Goal-Oriented Mental Alignment.

Lance Ying, Kunal Jha, Shivam Aarya, Joshua B. Tenenbaum, Antonio Torralba, Tianmin Shu

CoRR, 2024

MMToM-QA: Multimodal Theory of Mind Question Answering.

Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer D. Ullman, Antonio Torralba, Joshua B. Tenenbaum, Tianmin Shu

CoRR, 2024

Neural Amortized Inference for Nested Multi-Agent Reasoning.

Kunal Jha, Tuan Anh Le, Chuanyang Jin, Yen-Ling Kuo, Joshua B. Tenenbaum, Tianmin Shu

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning.

Zhiting Hu, Tianmin Shu

CoRR, 2023

The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?

Chuanyang Jin, Songyang Zhang, Tianmin Shu, Zhihan Cui

CoRR, 2023

Building Cooperative Embodied Agents Modularly with Large Language Models.

Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua B. Tenenbaum, Tianmin Shu, Chuang Gan

CoRR, 2023

Language Models Meet World Models: Embodied Experiences Enhance Language Models.

Jiannan Xiang, Tianhua Tao, Yi Gu, Tianmin Shu, Zirui Wang, Zichao Yang, Zhiting Hu

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

NOPA: Neurally-guided Online Probabilistic Assistance for Building Socially Intelligent Home Assistants.

Xavier Puig, Tianmin Shu, Joshua B. Tenenbaum, Antonio Torralba

Proceedings of the IEEE International Conference on Robotics and Automation, 2023

Diagnosis, Feedback, Adaptation: A Human-in-the-Loop Framework for Test-Time Policy Adaptation.

Andi Peng, Aviv Netanyahu, Mark K. Ho, Tianmin Shu, Andreea Bobu, Julie Shah, Pulkit Agrawal

Proceedings of the International Conference on Machine Learning, 2023

Stateful Active Facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning.

Dianbo Liu, Vedant Shah, Oussama Boussif, Cristian Meo, Anirudh Goyal, Tianmin Shu, Michael Curtis Mozer, Nicolas Heess, Yoshua Bengio

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Zero-Shot Linear Combinations of Grounded Social Interactions with Linear Social MDPs.

Ravi Tejwani, Yen-Ling Kuo, Tianmin Shu, Bennett Stankovits, Dan Gutfreund, Joshua B. Tenenbaum, Boris Katz, Andrei Barbu

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Show Me What You Can Do: Capability Calibration on Reachable Workspace for Human-Robot Collaboration.

Xiaofeng Gao, Luyao Yuan, Tianmin Shu, Hongjing Lu, Song-Chun Zhu

IEEE Robotics Autom. Lett., 2022

Coordinating Policies Among Multiple Agents via an Intelligent Communication Channel.

Dianbo Liu, Vedant Shah, Oussama Boussif, Cristian Meo, Anirudh Goyal, Tianmin Shu, Michael Mozer, Nicolas Heess, Yoshua Bengio

CoRR, 2022

Incorporating Rich Social Interactions Into MDPs.

Ravi Tejwani, Yen-Ling Kuo, Tianmin Shu, Bennett Stankovits, Dan Gutfreund, Joshua B. Tenenbaum, Boris Katz, Andrei Barbu

Proceedings of the 2022 International Conference on Robotics and Automation, 2022

Discovering Generalizable Spatial Goal Representations via Graph-based Active Reward Learning.

Aviv Netanyahu, Tianmin Shu, Joshua B. Tenenbaum, Pulkit Agrawal

Proceedings of the International Conference on Machine Learning, 2022

RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learning.

Mingkai Deng, Jianyu Wang, Cheng-Ping Hsieh, Yihan Wang, Han Guo, Tianmin Shu, Meng Song, Eric P. Xing, Zhiting Hu

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

AGENT: A Benchmark for Core Psychological Reasoning.

Tianmin Shu, Abhishek Bhandwaldar, Chuang Gan, Kevin A. Smith, Shari Liu, Dan Gutfreund, Elizabeth S. Spelke, Joshua B. Tenenbaum, Tomer D. Ullman

Proceedings of the 38th International Conference on Machine Learning, 2021

Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration.

Xavier Puig, Tianmin Shu, Shuang Li, Zilin Wang, Yuan-Hong Liao, Joshua B. Tenenbaum, Sanja Fidler, Antonio Torralba

Proceedings of the 9th International Conference on Learning Representations, 2021

Social Interactions as Recursive MDPs.

Ravi Tejwani, Yen-Ling Kuo, Tianmin Shu, Boris Katz, Andrei Barbu

Proceedings of the Conference on Robot Learning, 8-11 November 2021, London, UK., 2021

PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception.

Aviv Netanyahu, Tianmin Shu, Boris Katz, Andrei Barbu, Joshua B. Tenenbaum

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021

2020

Learning to infer human attention in daily activities.

Zhixiong Nan, Tianmin Shu, Ran Gong, Shu Wang, Ping Wei, Song-Chun Zhu, Nanning Zheng

Pattern Recognit., 2020

Watch-And-Help: A Challenge for Social Perception and Human-AI Collaboration.

Xavier Puig, Tianmin Shu, Shuang Li, Zilin Wang, Joshua B. Tenenbaum, Sanja Fidler, Antonio Torralba

CoRR, 2020

Joint Mind Modeling for Explanation Generation in Complex Human-Robot Collaborative Tasks.

Xiaofeng Gao, Ran Gong, Yizhou Zhao, Shu Wang, Tianmin Shu, Song-Chun Zhu

Proceedings of the 29th IEEE International Conference on Robot and Human Interactive Communication, 2020

Active Visual Information Gathering for Vision-Language Navigation.

Hanqing Wang, Wenguan Wang, Tianmin Shu, Wei Liang, Jianbing Shen

Proceedings of the Computer Vision - ECCV 2020, 2020

Adventures in Flatland: Perceiving Social Interactions Under Physical Dynamics.

Tianmin Shu, Marta Kryven, Tomer D. Ullman, Josh Tenenbaum

Proceedings of the 42th Annual Meeting of the Cognitive Science Society, 2020

Jointly learning motion verbs and frame semantics from natural language and grounded scenes.

Jon Gauthier, Jiayuan Mao, Tianmin Shu, Roger Levy, Josh Tenenbaum

Proceedings of the 42th Annual Meeting of the Cognitive Science Society, 2020

2019

Social Scene Understanding: Group Activity Parsing, Human-Robot Interactions, and Perception of Animacy.

Tianmin Shu

PhD thesis, 2019

VRKitchen: an Interactive 3D Virtual Environment for Task-oriented Learning.

Xiaofeng Gao, Ran Gong, Tianmin Shu, Xu Xie, Shu Wang, Song-Chun Zhu

CoRR, 2019

M^3RL: Mind-aware Multi-agent Management Reinforcement Learning.

Tianmin Shu, Yuandong Tian

Proceedings of the 7th International Conference on Learning Representations, 2019

Partitioning the Perception of Physical and Social Events Within a Unified Psychological Space.

Tianmin Shu, Yujia Peng, Hongjing Lu, Song-Chun Zhu

Proceedings of the 41th Annual Meeting of the Cognitive Science Society, 2019

2018

Perception of Human Interaction Based on Motion Trajectories: From Aerial Videos to Decontextualized Animations.

Tianmin Shu, Yujia Peng, Lifeng Fan, Hongjing Lu, Song-Chun Zhu

Top. Cogn. Sci., 2018

Learning and Inferring "Dark Matter" and Predicting Human Intents and Trajectories in Videos.

Dan Xie, Tianmin Shu, Sinisa Todorovic, Song-Chun Zhu

IEEE Trans. Pattern Anal. Mach. Intell., 2018

Interactive Agent Modeling by Learning to Probe.

Tianmin Shu, Caiming Xiong, Ying Nian Wu, Song-Chun Zhu

CoRR, 2018

Hierarchical and Interpretable Skill Acquisition in Multi-task Reinforcement Learning.

Tianmin Shu, Caiming Xiong, Richard Socher

Proceedings of the 6th International Conference on Learning Representations, 2018

Where and Why Are They Looking? Jointly Inferring Human Attention and Intentions in Complex Tasks.

Ping Wei, Yang Liu, Tianmin Shu, Nanning Zheng, Song-Chun Zhu

Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition, 2018

2017

Learning social affordance grammar from videos: Transferring human interactions to human-robot interactions.

Tianmin Shu, Xiaofeng Gao, Michael S. Ryoo, Song-Chun Zhu

Proceedings of the 2017 IEEE International Conference on Robotics and Automation, 2017

CERN: Confidence-Energy Recurrent Network for Group Activity Recognition.

Tianmin Shu, Sinisa Todorovic, Song-Chun Zhu

Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2017

Inferring Human Interaction from Motion Trajectories in Aerial Videos.

Tianmin Shu, Yujia Peng, Lifeng Fan, Hongjing Lu, Song-Chun Zhu

Proceedings of the 39th Annual Meeting of the Cognitive Science Society, 2017

2016

Modeling and Inferring Human Intents and Latent Functional Objects for Trajectory Prediction.

Dan Xie, Tianmin Shu, Sinisa Todorovic, Song-Chun Zhu

CoRR, 2016

Learning Social Affordance for Human-Robot Interaction.

Tianmin Shu, Michael S. Ryoo, Song-Chun Zhu

Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Critical Features of Joint Actions that Signal Human Interaction.

Tianmin Shu, Steven M. Thurman, Dawn Chen, Song-Chun Zhu, Hongjing Lu

Proceedings of the 38th Annual Meeting of the Cognitive Science Society, 2016

2015

Joint inference of groups, events and human roles in aerial videos.

Tianmin Shu, Dan Xie, Brandon Rothrock, Sinisa Todorovic, Song-Chun Zhu

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015