Salient object detection in image sequences via spatial-temporal cue. - Chuang Gan 001; Zengchang Qin; Jia Xu 004; Tao Wan 001 (VCIP, 2013)

Informedia @ TRECVID 2014. - Shoou-I Yu; Lu Jiang 004; Zhongwen Xu; Zhenzhong Lan; Shicheng Xu; Xiaojun Chang; Xuanchong Li; Zexi Mao; Chuang Gan 001; Yajie Miao; Xingzhong Du; Yang Cai 002; et al. (TRECVID, 2014)

Exploring Semantic Inter-Class Relationships (SIR) for Zero-Shot Action Recognition. - Chuang Gan 001; Ming Lin 002; Yi Yang 001; Yueting Zhuang; Alexander G. Hauptmann (AAAI, 2015)

DevNet: A Deep Event Network for multimedia event detection and evidence recounting. - Chuang Gan 001; Naiyan Wang; Yi Yang 001; Dit-Yan Yeung; Alexander G. Hauptmann (CVPR, 2015)

Automatic Concept Discovery from Parallel Text and Visual Corpora. - Chen Sun 002; Chuang Gan 001; Ram Nevatia (ICCV, 2015)

CMU Informedia@TRECVID 2015: MED/SIN/LNK/SED. - Shoou-I Yu; Lu Jiang 004; Zhongwen Xu; Zhenzhong Lan; Shicheng Xu; Xiaojun Chang; Xuanchong Li; Zexi Mao; Chuang Gan 001; Yajie Miao; Xingzhong Du; Yang Cai 002; et al. (TRECVID, 2015)

Concepts Not Alone: Exploring Pairwise Relationships for Zero-Shot Video Activity Recognition. - Chuang Gan 001; Ming C. Lin; Yi Yang 001; Gerard de Melo; Alexander G. Hauptmann (AAAI, 2016)

Learning Attributes Equals Multi-Source Domain Generalization. - Chuang Gan 001; Tianbao Yang; Boqing Gong (CVPR, 2016)

You Lead, We Exceed: Labor-Free Video Concept Learning by Jointly Exploiting Web Videos and Images. - Chuang Gan 001; Ting Yao; Kuiyuan Yang; Yi Yang 001; Tao Mei 001 (CVPR, 2016)

Webly-Supervised Video Recognition by Mutually Voting for Relevant Web Images and Web Video Frames. - Chuang Gan 001; Chen Sun 002; Lixin Duan; Boqing Gong (ECCV (3), 2016)

Strategies for Searching Video Content with Text Queries or Video Examples. - Shoou-I Yu; Yi Yang 001; Zhongwen Xu; Shicheng Xu; Deyu Meng; Zexi Mao; Zhigang Ma; Ming Lin 002; Xuanchong Li; Huan Li; Zhen-Zhong Lan; Lu Jiang 004; et al. (CoRR, 2016)

Recognizing an Action Using Its Name: A Knowledge-Based Approach. - Chuang Gan 001; Yi Yang 001; Linchao Zhu; Deli Zhao; Yueting Zhuang (Int. J. Comput. Vis., 2016)

DECK: Discovering Event Composition Knowledge from Web Images for Zero-Shot Event Detection and Recounting in Videos. - Chuang Gan 001; Chen Sun 002; Ram Nevatia (AAAI, 2017)

StyleNet: Generating Attractive Visual Captions with Styles. - Chuang Gan 001; Zhe Gan; Xiaodong He 001; Jianfeng Gao 001; Li Deng 001 (CVPR, 2017)

Semantic Compositional Networks for Visual Captioning. - Zhe Gan; Chuang Gan 001; Xiaodong He 001; Yunchen Pu; Kenneth Tran; Jianfeng Gao 001; Lawrence Carin; Li Deng 001 (CVPR, 2017)

VQS: Linking Segmentations to Questions and Answers for Supervised Attention in VQA and Question-Focused Semantic Segmentation. - Chuang Gan 001; Yandong Li; Haoxiang Li; Chen Sun 002; Boqing Gong (ICCV, 2017)

Recurrent Topic-Transition GAN for Visual Paragraph Generation. - Xiaodan Liang; Zhiting Hu; Hao Zhang 025; Chuang Gan 001; Eric P. Xing (ICCV, 2017)

Temporal Modeling Approaches for Large-scale Youtube-8M Video Understanding. - Fu Li 003; Chuang Gan 001; Xiao Liu 022; Yunlong Bian; Xiang Long; Yandong Li; Zhichao Li; Jie Zhou; Shilei Wen (CoRR, 2017)

Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches for Large-scale Video Classification. - Yunlong Bian; Chuang Gan 001; Xiao Liu 022; Fu Li 003; Xiang Long; Yandong Li; Heng Qi; Jie Zhou; Shilei Wen; Yuanqing Lin (CoRR, 2017)

Unsupervised Domain Adaptation for 3D Keypoint Prediction from a Single Depth Scan. - Xingyi Zhou; Arjun Karpur; Chuang Gan 001; Linjie Luo; Qixing Huang (CoRR, 2017)

Smart, Sparse Contours to Represent and Edit Images. - Tali Dekel; Chuang Gan 001; Dilip Krishnan; Ce Liu 001; William T. Freeman (CoRR, 2017)

A Multisource Domain Generalization Approach to Visual Attribute Detection. - Chuang Gan 001; Tianbao Yang; Boqing Gong (Domain Adaptation in Computer Vision Applications, 2017)

T-C3D: Temporal Convolutional 3D Network for Real-Time Action Recognition. - Kun Liu 016; Wu Liu; Chuang Gan 001; Mingkui Tan; Huadong Ma (AAAI, 2018)

Multimodal Keyless Attention Fusion for Video Classification. - Xiang Long; Chuang Gan 001; Gerard de Melo; Xiao Liu 022; Yandong Li; Fu Li 003; Shilei Wen (AAAI, 2018)

Sparse, Smart Contours to Represent and Edit Images. - Tali Dekel; Chuang Gan 001; Dilip Krishnan; Ce Liu 001; William T. Freeman (CVPR, 2018)

End-to-End Learning of Motion Representation for Video Understanding. - Lijie Fan; Wen-bing Huang 001; Chuang Gan 001; Stefano Ermon; Boqing Gong; Junzhou Huang (CVPR, 2018)

Geometry Guided Convolutional Neural Networks for Self-Supervised Video Representation Learning. - Chuang Gan 001; Boqing Gong; Kun Liu 021; Hao Su 001; Leonidas J. Guibas (CVPR, 2018)

Attention Clusters: Purely Attention Based Local Feature Integration for Video Classification. - Xiang Long; Chuang Gan 001; Gerard de Melo; Jiajun Wu 001; Xiao Liu 022; Shilei Wen (CVPR, 2018)

The Sound of Pixels. - Hang Zhao; Chuang Gan 001; Andrew Rouditchenko; Carl Vondrick; Josh H. McDermott; Antonio Torralba 001 (ECCV (1), 2018)

Unsupervised Domain Adaptation for 3D Keypoint Estimation via View Consistency. - Xingyi Zhou; Arjun Karpur; Chuang Gan 001; Linjie Luo; Qixing Huang (ECCV (12), 2018)

Weakly Supervised Dense Event Captioning in Videos. - Xuguang Duan; Wen-bing Huang 001; Chuang Gan 001; Jingdong Wang 001; Wenwu Zhu 001; Junzhou Huang (NeurIPS, 2018)

Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understanding. - Kexin Yi; Jiajun Wu 001; Chuang Gan 001; Antonio Torralba 001; Pushmeet Kohli; Josh Tenenbaum 001 (NeurIPS, 2018)

Temporal Shift Module for Efficient Video Understanding. - Ji Lin 002; Chuang Gan 001; Song Han 003 (CoRR, 2018)

Video Captioning with Multi-Faceted Attention. - Xiang Long; Chuang Gan 001; Gerard de Melo (Trans. Assoc. Comput. Linguistics, 2018)

Controllable Image-to-Video Translation: A Case Study on Facial Expression Generation. - Lijie Fan; Wenbing Huang 001; Chuang Gan 001; Junzhou Huang; Boqing Gong (AAAI, 2019)

StNet: Local and Global Spatial-Temporal Modeling for Action Recognition. - Dongliang He; Zhichao Zhou; Chuang Gan 001; Fu Li 003; Xiao Liu 022; Yandong Li; Limin Wang 002; Shilei Wen (AAAI, 2019)

Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering. - Xiangpeng Li; Jingkuan Song; Lianli Gao; Xianglong Liu 001; Wenbing Huang 001; Xiangnan He 001; Chuang Gan 001 (AAAI, 2019)

Self-Supervised Segmentation and Source Separation on Videos. - Andrew Rouditchenko; Hang Zhao; Chuang Gan 001; Josh H. McDermott; Antonio Torralba 001 (CVPR Workshops, 2019)

Self-supervised Audio-visual Co-segmentation. - Andrew Rouditchenko; Hang Zhao; Chuang Gan 001; Josh H. McDermott; Antonio Torralba 001 (ICASSP, 2019)

Self-Supervised Moving Vehicle Tracking With Stereo Sound. - Chuang Gan 001; Hang Zhao; Peihao Chen; David D. Cox; Antonio Torralba 001 (ICCV, 2019)

TSM: Temporal Shift Module for Efficient Video Understanding. - Ji Lin 002; Chuang Gan 001; Song Han 003 (ICCV, 2019)

Graph Convolutional Networks for Temporal Action Localization. - Runhao Zeng; Wenbing Huang 001; Chuang Gan 001; Mingkui Tan; Yu Rong 001; Peilin Zhao; Junzhou Huang (ICCV, 2019)

The Sound of Motions. - Hang Zhao; Chuang Gan 001; Wei-Chiu Ma; Antonio Torralba 001 (ICCV, 2019)

Defensive Quantization: When Efficiency Meets Robustness. - Ji Lin 002; Chuang Gan 001; Song Han 003 (ICLR (Poster), 2019)

The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervision. - Jiayuan Mao; Chuang Gan 001; Pushmeet Kohli; Joshua B. Tenenbaum; Jiajun Wu 001 (ICLR, 2019)

Watch, Reason and Code: Learning to Represent Videos Using Program. - Xuguang Duan; Qi Wu 001; Chuang Gan 001; Yiwei Zhang; Wenbing Huang 001; Anton van den Hengel; Wenwu Zhu 001 (ACM Multimedia, 2019)

Facial Image-to-Video Translation by a Hidden Affine Transformation. - Guangyao Shen; Wenbing Huang 001; Chuang Gan 001; Mingkui Tan; Junzhou Huang; Wenwu Zhu 001; Boqing Gong (ACM Multimedia, 2019)

Visual Concept-Metaconcept Learning. - Chi Han; Jiayuan Mao; Chuang Gan 001; Josh Tenenbaum 001; Jiajun Wu 001 (NeurIPS, 2019)

Imitation Learning from Observations by Minimizing Inverse Dynamics Disagreement. - Chao Yang 026; Xiaojian Ma 001; Wenbing Huang 001; Fuchun Sun 001; Huaping Liu 001; Junzhou Huang; Chuang Gan 001 (NeurIPS, 2019)

Cross-channel Communication Networks. - Jianwei Yang; Zhile Ren; Chuang Gan 001; Hongyuan Zhu; Devi Parikh (NeurIPS, 2019)

Interpreting Adversarial Examples by Activation Promotion and Suppression. - Kaidi Xu; Sijia Liu 001; Gaoyuan Zhang; Mengshu Sun; Pu Zhao 001; Quanfu Fan; Chuang Gan 001; Xue Lin 001 (CoRR, 2019)

Once for All: Train One Network and Specialize it for Efficient Deployment. - Han Cai; Chuang Gan 001; Song Han 003 (CoRR, 2019)

Training Kinetics in 15 Minutes: Large-scale Distributed Training on Videos. - Ji Lin 002; Chuang Gan 001; Song Han 003 (CoRR, 2019)

TruNet: Short Videos Generation from Long Videos via Story-Preserving Truncation. - Fan Yang; Xiao Liu 022; Dongliang He; Chuang Gan 001; Jian Wang; Chao Li 034; Fu Li 003; Shilei Wen (CoRR, 2019)

Toward Efficient Action Recognition: Principal Backpropagation for Training Two-Stream Networks. - Wen-bing Huang 001; Lijie Fan; Mehrtash Harandi; Lin Ma 002; Huaping Liu 001; Wei Liu 005; Chuang Gan 001 (IEEE Trans. Image Process., 2019)

Breaking Winner-Takes-All: Iterative-Winners-Out Networks for Weakly Supervised Temporal Action Localization. - Runhao Zeng; Chuang Gan 001; Peihao Chen; Wenbing Huang 001; Qingyao Wu; Mingkui Tan (IEEE Trans. Image Process., 2019)

Location-Aware Graph Convolutional Networks for Video Question Answering. - Deng Huang; Peihao Chen; Runhao Zeng; Qing Du; Mingkui Tan; Chuang Gan 001 (AAAI, 2020)

HAT: Hardware-Aware Transformers for Efficient Natural Language Processing. - Hanrui Wang 002; Zhanghao Wu; Zhijian Liu; Han Cai; Ligeng Zhu; Chuang Gan 001; Song Han 003 (ACL, 2020)

Music Gesture for Visual Sound Separation. - Chuang Gan 001; Deng Huang; Hang Zhao; Joshua B. Tenenbaum; Antonio Torralba 001 (CVPR, 2020)

Dense Regression Network for Video Grounding. - Runhao Zeng; Haoming Xu; Wenbing Huang 001; Peihao Chen; Mingkui Tan; Chuang Gan 001 (CVPR, 2020)

Foley Music: Learning to Generate Music from Videos. - Chuang Gan 001; Deng Huang; Peihao Chen; Joshua B. Tenenbaum; Antonio Torralba 001 (ECCV (11), 2020)

DataMix: Efficient Privacy-Preserving Edge-Cloud Inference. - Zhijian Liu; Zhanghao Wu; Chuang Gan 001; Ligeng Zhu; Song Han 003 (ECCV (11), 2020)

Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning. - Xiaoxiao Guo; Mo Yu; Yupeng Gao; Chuang Gan 001; Murray Campbell; Shiyu Chang (EMNLP (1), 2020)

Once-for-All: Train One Network and Specialize it for Efficient Deployment. - Han Cai; Chuang Gan 001; Tianzhe Wang; Zhekai Zhang; Song Han 003 (ICLR, 2020)

CLEVRER: Collision Events for Video Representation and Reasoning. - Kexin Yi; Chuang Gan 001; Yunzhu Li; Pushmeet Kohli; Jiajun Wu 001; Antonio Torralba 001; Joshua B. Tenenbaum (ICLR, 2020)

Deep Audio Priors Emerge From Harmonic Convolutional Networks. - Zhoutong Zhang; Yunyun Wang; Chuang Gan 001; Jiajun Wu 001; Joshua B. Tenenbaum; Antonio Torralba 001; William T. Freeman (ICLR, 2020)

Look, Listen, and Act: Towards Audio-Visual Embodied Navigation. - Chuang Gan 001; Yiwei Zhang; Jiajun Wu 001; Boqing Gong; Joshua B. Tenenbaum (ICRA, 2020)

Deep Concept-wise Temporal Convolutional Networks for Action Localization. - Xin Li 106; Tianwei Lin; Xiao Liu 022; Wangmeng Zuo; Chao Li 034; Xiang Long; Dongliang He; Fu Li 003; Shilei Wen; Chuang Gan 001 (ACM Multimedia, 2020)

HUMA'20: 1st International Workshop on Human-Centric Multimedia Analysis. - Wu Liu; Chuang Gan 001; Jingkuan Song; Dingwen Zhang; Wenbing Huang 001; John Smith 001 (ACM Multimedia, 2020)

Cross-Modal Relation-Aware Networks for Audio-Visual Event Localization. - Haoming Xu; Runhao Zeng; Qingyao Wu; Mingkui Tan; Chuang Gan 001 (ACM Multimedia, 2020)

TinyTL: Reduce Memory, Not Parameters for Efficient On-Device Learning. - Han Cai; Chuang Gan 001; Ligeng Zhu; Song Han 003 (NeurIPS, 2020)

MCUNet: Tiny Deep Learning on IoT Devices. - Ji Lin 002; Wei-Ming Chen; Yujun Lin 001; John Cohn; Chuang Gan 001; Song Han 003 (NeurIPS, 2020)

Language Guided Networks for Cross-modal Moment Retrieval. - Kun Liu 016; Xun Yang; Tat-Seng Chua; Huadong Ma; Chuang Gan 001 (CoRR, 2020)

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation. - Chuang Gan 001; Jeremy Schwartz; Seth Alter; Martin Schrimpf; James Traer; Julian De Freitas; Jonas Kubilius; Abhishek Bhandwaldar; Nick Haber; Megumi Sano; Kuno Kim; Elias Wang; et al. (CoRR, 2020)

Tiny Transfer Learning: Towards Memory-Efficient On-Device Learning. - Han Cai; Chuang Gan 001; Ligeng Zhu; Song Han 003 (CoRR, 2020)

Synthetic Training for Monocular Human Mesh Recovery. - Yu Sun 030; Qian Bao; Wu Liu; Wenpeng Gao; Yili Fu; Chuang Gan 001; Tao Mei 001 (CoRR, 2020)

Object-Centric Diagnosis of Visual Reasoning. - Jianwei Yang; Jiayuan Mao; Jiajun Wu 001; Devi Parikh; David D. Cox; Joshua B. Tenenbaum; Chuang Gan 001 (CoRR, 2020)

Augmenting Policy Learning with Routines Discovered from a Demonstration. - Zelin Zhao; Chuang Gan 001; Jiajun Wu 001; Xiaoxiao Guo; Joshua B. Tenenbaum (CoRR, 2020)

Generating Visually Aligned Sound From Videos. - Peihao Chen; Yang Zhang 001; Mingkui Tan; Hongdong Xiao; Deng Huang; Chuang Gan 001 (IEEE Trans. Image Process., 2020)

Relation Attention for Temporal Action Localization. - Peihao Chen; Chuang Gan 001; Guangyao Shen; Wenbing Huang 001; Runhao Zeng; Mingkui Tan (IEEE Trans. Multim., 2020)

RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning. - Peihao Chen; Deng Huang; Dongliang He; Xiang Long; Runhao Zeng; Shilei Wen; Mingkui Tan; Chuang Gan 001 (AAAI, 2021)

MVFNet: Multi-View Fusion Network for Efficient Video Recognition. - Wenhao Wu; Dongliang He; Tianwei Lin; Fu Li 003; Chuang Gan 001; Errui Ding (AAAI, 2021)

Augmenting Policy Learning with Routines Discovered from a Single Demonstration. - Zelin Zhao; Chuang Gan 001; Jiajun Wu 001; Xiaoxiao Guo; Joshua B. Tenenbaum (AAAI, 2021)

Found a Reason for me? Weakly-supervised Grounded Visual Question Answering using Capsules. - Aisha Urooj Khan; Hilde Kuehne; Kevin Duarte; Chuang Gan 001; Niels da Vitoria Lobo; Mubarak Shah (CVPR, 2021)

Curious Representation Learning for Embodied Intelligence. - Yilun Du; Chuang Gan 001; Phillip Isola (ICCV, 2021)

On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-Learning. - Ren Wang 008; Kaidi Xu; Sijia Liu 001; Pin-Yu Chen; Tsui-Wei Weng; Chuang Gan 001; Meng Wang 003 (ICLR, 2021)

Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning. - Zhenfang Chen; Jiayuan Mao; Jiajun Wu 001; Kwan-Yee Kenneth Wong; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2021)

PlasticineLab: A Soft-Body Manipulation Benchmark with Differentiable Physics. - Zhiao Huang; Yuanming Hu; Tao Du 001; Siyuan Zhou; Hao Su 001; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2021)

Learning Task Decomposition with Ordered Memory Policy Network. - Yuchen Lu; Yikang Shen; Siyuan Zhou; Aaron C. Courville; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2021)

Adversarial Option-Aware Hierarchical Imitation Learning. - Mingxuan Jing; Wenbing Huang 001; Fuchun Sun 001; Xiaojian Ma 001; Tao Kong; Chuang Gan 001; Lei Li 005 (ICML, 2021)

Global Prosody Style Transfer Without Text Transcriptions. - Kaizhi Qian; Yang Zhang 001; Shiyu Chang; Jinjun Xiong; Chuang Gan 001; David D. Cox; Mark Hasegawa-Johnson (ICML, 2021)

AGENT: A Benchmark for Core Psychological Reasoning. - Tianmin Shu; Abhishek Bhandwaldar; Chuang Gan 001; Kevin A. Smith 001; Shari Liu; Dan Gutfreund; Elizabeth S. Spelke; Joshua B. Tenenbaum; Tomer D. Ullman (ICML, 2021)

Temporal and Object Quantification Networks. - Jiayuan Mao; Zhezheng Luo; Chuang Gan 001; Joshua B. Tenenbaum; Jiajun Wu 001; Leslie Pack Kaelbling; Tomer D. Ullman (IJCAI, 2021)

OPEn: An Open-ended Physics Environment for Learning Without a Task. - Chuang Gan 001; Abhishek Bhandwaldar; Antonio Torralba 001; Joshua B. Tenenbaum; Phillip Isola (IROS, 2021)

Counterfactual Debiasing Inference for Compositional Action Recognition. - Pengzhan Sun 001; Bo Wu 018; Xunsong Li; Wen Li 001; Lixin Duan; Chuang Gan 001 (ACM Multimedia, 2021)

STST: Spatial-Temporal Specialized Transformer for Skeleton-based Action Recognition. - Yuhan Zhang; Bo Wu 018; Wen Li 001; Lixin Duan; Chuang Gan 001 (ACM Multimedia, 2021)

Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language. - Mingyu Ding; Zhenfang Chen; Tao Du 001; Ping Luo 002; Josh Tenenbaum 001; Chuang Gan 001 (NeurIPS, 2021)

When does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning? - Lijie Fan; Sijia Liu 001; Pin-Yu Chen; Gaoyuan Zhang; Chuang Gan 001 (NeurIPS, 2021)

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation. - Chuang Gan 001; Jeremy Schwartz; Seth Alter; Damian Mrowca; Martin Schrimpf; James Traer; Julian De Freitas; Jonas Kubilius; Abhishek Bhandwaldar; Nick Haber; Megumi Sano; Kuno Kim; et al. (NeurIPS Datasets and Benchmarks, 2021)

PTR: A Benchmark for Part-based Conceptual, Relational, and Physical Reasoning. - Yining Hong; Li Yi 001; Josh Tenenbaum 001; Antonio Torralba 001; Chuang Gan 001 (NeurIPS, 2021)

Memory-efficient Patch-based Inference for Tiny Deep Learning. - Ji Lin 002; Wei-Ming Chen; Han Cai; Chuang Gan 001; Song Han 003 (NeurIPS, 2021)

STAR: A Benchmark for Situated Reasoning in Real-World Videos. - Bo Wu 018; Shoubin Yu; Zhenfang Chen; Josh Tenenbaum 001; Chuang Gan 001 (NeurIPS Datasets and Benchmarks, 2021)

The 1st International Workshop on Machine Reasoning: International Machine Reasoning Conference (MRC 2021). - Yongfeng Zhang; Min Zhang 006; Hanxiong Chen; Xu Chen 017; Xianjie Chen; Chuang Gan 001; Tong Sun; Xin Luna Dong (WSDM, 2021)

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI. - Chuang Gan 001; Siyuan Zhou; Jeremy Schwartz; Seth Alter; Abhishek Bhandwaldar; Dan Gutfreund; Daniel L. K. Yamins; James J. DiCarlo; Josh H. McDermott; Antonio Torralba 001; Joshua B. Tenenbaum (CoRR, 2021)

TransCenter: Transformers with Dense Queries for Multiple-Object Tracking. - Yihong Xu; Yutong Ban; Guillaume Delorme 002; Chuang Gan 001; Daniela Rus; Xavier Alameda-Pineda (CoRR, 2021)

Cross-Modal Attention Consistency for Video-Audio Unsupervised Learning. - Shaobo Min; Qi Dai 001; Hongtao Xie; Chuang Gan 001; Yongdong Zhang 001; Jingdong Wang 001 (CoRR, 2021)

Global Rhythm Style Transfer Without Text Transcriptions. - Kaizhi Qian; Yang Zhang 001; Shiyu Chang; Jinjun Xiong; Chuang Gan 001; David D. Cox; Mark Hasegawa-Johnson (CoRR, 2021)

TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Device. - Ji Lin 002; Chuang Gan 001; Kuan Wang; Song Han 003 (CoRR, 2021)

MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep Learning. - Ji Lin 002; Wei-Ming Chen; Han Cai; Chuang Gan 001; Song Han 003 (CoRR, 2021)

A Real-Time Action Representation With Temporal Encoding and Deep Compression. - Kun Liu 016; Wu Liu; Huadong Ma; Mingkui Tan; Chuang Gan 001 (IEEE Trans. Circuits Syst. Video Technol., 2021)

Embodied Concept Learner: Self-supervised Learning of Concepts and Mapping through Instruction Following. - Mingyu Ding; Yan Xu; Zhenfang Chen; David Daniel Cox; Ping Luo 002; Joshua B. Tenenbaum; Chuang Gan 001 (CoRL, 2022)

Planning with Spatial-Temporal Abstraction from Point Clouds for Deformable Object Manipulation. - Xingyu Lin; Carl Qi; Yunchu Zhang; Zhiao Huang; Katerina Fragkiadaki; Yunzhu Li; Chuang Gan 001; David Held (CoRL, 2022)

Finding Fallen Objects Via Asynchronous Audio-Visual Integration. - Chuang Gan 001; Yi Gu 002; Siyuan Zhou; Jeremy Schwartz; Seth Alter; James Traer; Dan Gutfreund; Joshua B. Tenenbaum; Josh H. McDermott; Antonio Torralba 001 (CVPR, 2022)

Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction. - Yining Hong; Kaichun Mo; Li Yi 001; Leonidas J. Guibas; Antonio Torralba 001; Joshua B. Tenenbaum; Chuang Gan 001 (CVPR, 2022)

AutoGPart: Intermediate Supervision Search for Generalizable 3D Part Segmentation. - Xueyi Liu; Xiaomeng Xu; Anyi Rao; Chuang Gan 001; Li Yi 001 (CVPR, 2022)

Weakly Supervised Grounding for VQA in Vision-Language Transformers. - Aisha Urooj Khan; Hilde Kuehne; Chuang Gan 001; Niels da Vitoria Lobo; Mubarak Shah (ECCV (35), 2022)

Prototype-Guided Continual Adaptation for Class-Incremental Unsupervised Domain Adaptation. - Hongbin Lin; Yifan Zhang 004; Zhen Qiu; Shuaicheng Niu; Chuang Gan 001; Yanxia Liu; Mingkui Tan (ECCV (33), 2022)

Revisiting the Roles of "Text" in Text Games. - Yi Gu 002; Shunyu Yao; Chuang Gan 001; Josh Tenenbaum 001; Mo Yu (EMNLP (Findings), 2022)

RISP: Rendering-Invariant State Predictor with Differentiable Simulation and Rendering for Cross-Domain Parameter Estimation. - Pingchuan Ma 002; Tao Du 001; Joshua B. Tenenbaum; Wojciech Matusik; Chuang Gan 001 (ICLR, 2022)

Network Augmentation for Tiny Deep Learning. - Han Cai; Chuang Gan 001; Ji Lin 002; Song Han 003 (ICLR, 2022)

ComPhy: Compositional Physical Reasoning of Objects and Events from Videos. - Zhenfang Chen; Kexin Yi; Yunzhu Li; Mingyu Ding; Antonio Torralba 001; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2022)

Contact Points Discovery for Soft-Body Manipulations with Differentiable Physics. - Sizhe Li; Zhiao Huang; Tao Du 001; Hao Su 001; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2022)

DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools. - Xingyu Lin; Zhiao Huang; Yunzhu Li; Joshua B. Tenenbaum; David Held; Chuang Gan 001 (ICLR, 2022)

FALCON: Fast Visual Concept Learning by Integrating Images, Linguistic descriptions, and Conceptual Relations. - Lingjie Mei; Jiayuan Mao; Ziqi Wang; Chuang Gan 001; Joshua B. Tenenbaum (ICLR, 2022)

Linking Emergent and Natural Languages via Corpus Transfer. - Shunyu Yao; Mo Yu; Yang Zhang 001; Karthik R. Narasimhan; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2022)

Prompting Decision Transformer for Few-Shot Policy Generalization. - Mengdi Xu; Yikang Shen; Shun Zhang; Yuchen Lu; Ding Zhao; Joshua B. Tenenbaum; Chuang Gan 001 (ICML, 2022)

The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark Towards Physically Realistic Embodied AI. - Chuang Gan 001; Siyuan Zhou; Jeremy Schwartz; Seth Alter; Abhishek Bhandwaldar; Dan Gutfreund; Daniel L. K. Yamins; James J. DiCarlo; Josh H. McDermott; Antonio Torralba 001; Joshua B. Tenenbaum (ICRA, 2022)

Noisy Agents: Self-supervised Exploration by Predicting Auditory Events. - Chuang Gan 001; Xiaoyu Chen; Phillip Isola; Antonio Torralba 001; Joshua B. Tenenbaum (IROS, 2022)

Gait Recognition in the Wild with Multi-hop Temporal Switch. - Jinkai Zheng; Xinchen Liu; Xiaoyan Gu 001; Yaoqi Sun; Chuang Gan 001; Jiyong Zhang; Wu Liu; Chenggang Yan 001 (ACM Multimedia, 2022)

On-Device Training Under 256KB Memory. - Ji Lin 002; Ligeng Zhu; Wei-Ming Chen; Wei-Chen Wang 002; Chuang Gan 001; Song Han 003 (NeurIPS, 2022)

Learning Active Camera for Multi-Object Navigation. - Peihao Chen; Dongyu Ji; Kunyang Lin; Weiwen Hu; Wenbing Huang 001; Thomas H. Li; Mingkui Tan; Chuang Gan 001 (NeurIPS, 2022)

Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigation. - Peihao Chen; Dongyu Ji; Kunyang Lin; Runhao Zeng; Thomas H. Li; Mingkui Tan; Chuang Gan 001 (NeurIPS, 2022)

Learning Physical Dynamics with Subequivariant Graph Neural Networks. - Jiaqi Han; Wenbing Huang 001; Hengbo Ma; Jiachen Li 001; Josh Tenenbaum 001; Chuang Gan 001 (NeurIPS, 2022)

3D Concept Grounding on Neural Fields. - Yining Hong; Yilun Du; Chunru Lin; Josh Tenenbaum 001; Chuang Gan 001 (NeurIPS, 2022)

Learning Neural Acoustic Fields. - Andrew F. Luo; Yilun Du; Michael J. Tarr; Josh Tenenbaum 001; Antonio Torralba 001; Chuang Gan 001 (NeurIPS, 2022)

SNAKE: Shape-aware Neural 3D Keypoint Field. - Chengliang Zhong; Peixing You; Xiaoxue Chen; Hao Zhao 002; Fuchun Sun 001; Guyue Zhou; Xiaodong Mu; Chuang Gan 001; Wenbing Huang 001 (NeurIPS, 2022)

Certifiably robust interpretation via Rényi differential privacy. - Ao Liu 001; Xiaoyu Chen; Sijia Liu 001; Lirong Xia; Chuang Gan 001 (Artif. Intell., 2022)

EfficientViT: Enhanced Linear Attention for High-Resolution Low-Computation Visual Recognition. - Han Cai; Chuang Gan 001; Song Han 003 (CoRR, 2022)

MA2QL: A Minimalist Approach to Fully Decentralized Multi-Agent Reinforcement Learning. - Kefan Su; Siyuan Zhou; Chuang Gan 001; Xiangjun Wang; Zongqing Lu 002 (CoRR, 2022)

M3Video: Masked Motion Modeling for Self-Supervised Video Representation Learning. - Xinyu Sun; Peihao Chen; Liangwei Chen; Thomas H. Li; Mingkui Tan; Chuang Gan 001 (CoRR, 2022)

Retrospectives on the Embodied AI Workshop. - Matt Deitke; Dhruv Batra; Yonatan Bisk; Tommaso Campari; Angel X. Chang; Devendra Singh Chaplot; Changan Chen; Claudia Pérez-D'Arpino; Kiana Ehsani; Ali Farhadi; Li Fei-Fei 001; Anthony G. Francis; et al. (CoRR, 2022)

Mod-Squad: Designing Mixture of Experts As Modular Multi-Task Learners. - Zitian Chen; Yikang Shen; Mingyu Ding; Zhenfang Chen; Hengshuang Zhao; Erik G. Learned-Miller; Chuang Gan 001 (CoRR, 2022)

TSM: Temporal Shift Module for Efficient and Scalable Video Understanding on Edge Devices. - Ji Lin 002; Chuang Gan 001; Kuan Wang; Song Han 003 (IEEE Trans. Pattern Anal. Mach. Intell., 2022)

Purely Attention Based Local Feature Integration for Video Classification. - Xiang Long; Gerard de Melo; Dongliang He; Fu Li 003; Zhizhen Chi; Shilei Wen; Chuang Gan 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2022)

Graph Convolutional Module for Temporal Action Localization in Videos. - Runhao Zeng; Wenbing Huang 001; Mingkui Tan; Yu Rong 001; Peilin Zhao; Junzhou Huang; Chuang Gan 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2022)

Text-instance graph: Exploring the relational semantics for text-based visual question answering. - Xiangpeng Li; Bo Wu 018; Jingkuan Song; Lianli Gao; Pengpeng Zeng; Chuang Gan 001 (Pattern Recognit., 2022)

JECC: Commonsense Reasoning Tasks Derived from Interactive Fictions. - Mo Yu; Yi Gu 002; Xiaoxiao Guo; Yufei Feng; Xiaodan Zhu 001; Michael A. Greenspan; Murray Campbell; Chuang Gan 001 (ACL (Findings), 2023)

Mod-Squad: Designing Mixtures of Experts As Modular Multi-Task Learners. - Zitian Chen; Yikang Shen; Mingyu Ding; Zhenfang Chen; Hengshuang Zhao; Erik G. Learned-Miller; Chuang Gan 001 (CVPR, 2023)

Visual Dependency Transformers: Dependency Tree Emerges from Reversed Attention. - Mingyu Ding; Yikang Shen; Lijie Fan; Zhenfang Chen; Zitian Chen; Ping Luo 002; Joshua B. Tenenbaum; Chuang Gan 001 (CVPR, 2023)

3D Concept Learning and Reasoning from Multi-View Images. - Yining Hong; Chunru Lin; Yilun Du; Zhenfang Chen; Joshua B. Tenenbaum; Chuang Gan 001 (CVPR, 2023)

Learning Situation Hyper-Graphs for Video Question Answering. - Aisha Urooj Khan; Hilde Kuehne; Bo Wu 018; Kim Chheu; Walid Bousselham; Chuang Gan 001; Niels da Vitoria Lobo; Mubarak Shah (CVPR, 2023)

EC2: Emergent Communication for Embodied Control. - Yao Mu 001; Shunyu Yao; Mingyu Ding; Ping Luo 002; Chuang Gan 001 (CVPR, 2023)

Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos. - Kun Su; Kaizhi Qian; Eli Shlizerman; Antonio Torralba 001; Chuang Gan 001 (CVPR, 2023)

Masked Motion Encoding for Self-Supervised Video Representation Learning. - Xinyu Sun; Peihao Chen; Liangwei Chen; Changhao Li; Thomas H. Li; Mingkui Tan; Chuang Gan 001 (CVPR, 2023)

Sparse Universal Transformer. - Shawn Tan; Yikang Shen; Zhenfang Chen; Aaron C. Courville; Chuang Gan 001 (EMNLP, 2023)

EfficientViT: Lightweight Multi-Scale Attention for High-Resolution Dense Prediction. - Han Cai; Junyan Li; Muyan Hu; Chuang Gan 001; Song Han 003 (ICCV, 2023)

Learning Vision-and-Language Navigation from YouTube Videos. - Kunyang Lin; Peihao Chen; Diwei Huang; Thomas H. Li; Mingkui Tan; Chuang Gan 001 (ICCV, 2023)

TextPSG: Panoptic Scene Graph Generation from Textual Descriptions. - Chengyang Zhao; Yikang Shen; Zhenfang Chen; Mingyu Ding; Chuang Gan 001 (ICCV, 2023)

DexDeform: Dexterous Deformable Object Manipulation with Human Demonstrations and Differentiable Physics. - Sizhe Li; Zhiao Huang; Tao Chen 046; Tao Du 001; Hao Su 001; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2023)

PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification. - Xuan Li; Yi-Ling Qiao; Peter Yichen Chen; Krishna Murthy Jatavallabhula; Ming C. Lin; Chenfanfu Jiang; Chuang Gan 001 (ICLR, 2023)

SoftZoo: A Soft Robot Co-design Benchmark For Locomotion In Diverse Environments. - Tsun-Hsuan Wang; Pingchuan Ma 002; Andrew Everett Spielberg; Zhou Xian; Hao Zhang; Joshua B. Tenenbaum; Daniela Rus; Chuang Gan 001 (ICLR, 2023)

FluidLab: A Differentiable Environment for Benchmarking Complex Fluid Manipulation. - Zhou Xian; Bo Zhu; Zhenjia Xu; Hsiao-Yu Tung; Antonio Torralba 001; Katerina Fragkiadaki; Chuang Gan 001 (ICLR, 2023)

Hyper-Decision Transformer for Efficient Online Policy Adaptation. - Mengdi Xu; Yuchen Lu; Yikang Shen; Shun Zhang; Ding Zhao; Chuang Gan 001 (ICLR, 2023)

Planning with Large Language Models for Code Generation. - Shun Zhang; Zhenfang Chen; Yikang Shen; Mingyu Ding; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2023)

Learning Neural Constitutive Laws from Motion Observations for Generalizable PDE Dynamics. - Pingchuan Ma 002; Peter Yichen Chen; Bolei Deng; Joshua B. Tenenbaum; Tao Du 001; Chuang Gan 001; Wojciech Matusik (ICML, 2023)

On the Forward Invariance of Neural ODEs. - Wei Xiao 003; Tsun-Hsuan Wang; Ramin M. Hasani; Mathias Lechner; Yutong Ban; Chuang Gan 001; Daniela Rus (ICML, 2023)

Reparameterized Policy Learning for Multimodal Trajectory Optimization. - Zhiao Huang; Litian Liang; Zhan Ling; Xuanlin Li; Chuang Gan 001; Hao Su 001 (ICML, 2023)

Deep Masked Graph Matching for Correspondence Identification in Collaborative Perception. - Peng Gao 009; Qingzhao Zhu; Hongsheng Lu; Chuang Gan 001; Hao Zhang 011 (ICRA, 2023)

PockEngine: Sparse and Efficient Fine-tuning in a Pocket. - Ligeng Zhu; Lanxiang Hu; Ji Lin 002; Wei-Ming Chen; Wei-Chen Wang 002; Chuang Gan 001; Song Han 003 (MICRO, 2023)

3D-LLM: Injecting the 3D World into Large Language Models. - Yining Hong; Haoyu Zhen; Peihao Chen; Shuhong Zheng; Yilun Du; Zhenfang Chen; Chuang Gan 001 (NeurIPS, 2023)

DiffVL: Scaling Up Soft Body Manipulation using Vision-Language Driven Differentiable Physics. - Zhiao Huang; Feng Chen; Yewen Pu; Chunru Lin; Hao Su 001; Chuang Gan 001 (NeurIPS, 2023)

Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision. - Zhiqing Sun; Yikang Shen; Qinhong Zhou; Hongxin Zhang; Zhenfang Chen; David D. Cox; Yiming Yang; Chuang Gan 001 (NeurIPS, 2023)

Physion++: Evaluating Physical Scene Understanding that Requires Online Inference of Different Physical Properties. - Hsiao-Yu Tung; Mingyu Ding; Zhenfang Chen; Daniel Bear; Chuang Gan 001; Josh Tenenbaum 001; Dan Yamins; Judith E. Fan; Kevin A. Smith 001 (NeurIPS, 2023)

DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models. - Tsun-Hsuan Johnson Wang; Juntian Zheng; Pingchuan Ma 002; Yilun Du; Byungchul Kim; Andrew Spielberg; Joshua B. Tenenbaum; Chuang Gan 001; Daniela Rus (NeurIPS, 2023)

Adaptive Online Replanning with Diffusion Models. - Siyuan Zhou; Yilun Du; Shun Zhang; Mengdi Xu; Yikang Shen; Wei Xiao 003; Dit-Yan Yeung; Chuang Gan 001 (NeurIPS, 2023)

RoboNinja: Learning an Adaptive Cutting Policy for Multi-Material Objects. - Zhenjia Xu; Zhou Xian; Xingyu Lin; Cheng Chi; Zhiao Huang; Chuang Gan 001; Shuran Song (Robotics: Science and Systems, 2023)

ClawSAT: Towards Both Robust and Accurate Code Models. - Jinghan Jia; Shashank Srikant; Tamara Mitrovska; Chuang Gan 001; Shiyu Chang; Sijia Liu 001; Una-May O'Reilly (SANER, 2023)

See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoning. - Zhenfang Chen; Qinhong Zhou; Yikang Shen; Yining Hong; Hao Zhang; Chuang Gan 001 (CoRR, 2023)

EC^2: Emergent Communication for Embodied Control. - Yao Mu 001; Shunyu Yao; Mingyu Ding; Ping Luo 002; Chuang Gan 001 (CoRR, 2023)

SafeDiffuser: Safe Planning with Diffusion Probabilistic Models. - Wei Xiao 003; Tsun-Hsuan Wang; Chuang Gan 001; Daniela Rus (CoRR, 2023)

ModuleFormer: Learning Modular Large Language Models From Uncurated Data. - Yikang Shen; Zheyu Zhang; Tianyou Cao; Shawn Tan; Zhenfang Chen; Chuang Gan 001 (CoRR, 2023)

An Efficient General-Purpose Modular Vision Model via Multi-Task Heterogeneous Training. - Zitian Chen; Mingyu Ding; Yikang Shen; Wei Zhan; Masayoshi Tomizuka; Erik G. Learned-Miller; Chuang Gan 001 (CoRR, 2023)

A2Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models. - Peihao Chen; Xinyu Sun; Hongyan Zhi; Runhao Zeng; Thomas H. Li; Gaowen Liu; Mingkui Tan; Chuang Gan 001 (CoRR, 2023)

Generalizable Long-Horizon Manipulations with Large Language Models. - Haoyu Zhou; Mingyu Ding; Weikun Peng; Masayoshi Tomizuka; Lin Shao 002; Chuang Gan 001 (CoRR, 2023)

SALMON: Self-Alignment with Principle-Following Reward Models. - Zhiqing Sun; Yikang Shen; Hongxin Zhang; Qinhong Zhou; Zhenfang Chen; David D. Cox; Yiming Yang; Chuang Gan 001 (CoRR, 2023)

Autonomous Tree-search Ability of Large Language Models. - Zheyu Zhang; Zhuorui Ye; Yikang Shen; Chuang Gan 001 (CoRR, 2023)

RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation. - Yufei Wang 007; Zhou Xian; Feng Chen; Tsun-Hsuan Wang; Yian Wang 001; Zackory Erickson; David Held; Chuang Gan 001 (CoRR, 2023)

DCIR: Dynamic Consistency Intrinsic Reward for Multi-Agent Reinforcement Learning. - Kunyang Lin; Yufeng Wang 004; Peihao Chen; Runhao Zeng; Siyuan Zhou; Mingkui Tan; Chuang Gan 001 (CoRR, 2023)

Self-supervised audiovisual representation learning for remote sensing data. - Konrad Heidler; Lichao Mou; Di Hu 001; Pu Jin; Guangyao Li; Chuang Gan 001; Ji-Rong Wen; Xiao Xiang Zhu 001 (Int. J. Appl. Earth Obs. Geoinformation, 2023)

TransCenter: Transformers With Dense Representations for Multiple-Object Tracking. - Yihong Xu; Yutong Ban; Guillaume Delorme 002; Chuang Gan 001; Daniela Rus; Xavier Alameda-Pineda (IEEE Trans. Pattern Anal. Mach. Intell., 2023)

Bird-Count: a multi-modality benchmark and system for bird population counting in the wild. - Hongchang Wang; Huaxiang Lu; Huimin Guo; Haifang Jian; Chuang Gan 001; Wu Liu (Multim. Tools Appl., 2023)

Visual Chain-of-Thought Prompting for Knowledge-Based Visual Reasoning. - Zhenfang Chen; Qinhong Zhou; Yikang Shen; Yining Hong; Zhiqing Sun; Dan Gutfreund; Chuang Gan 001 (AAAI, 2024)

Aligning Large Multimodal Models with Factually Augmented RLHF. - Zhiqing Sun; Sheng Shen 001; Shengcao Cao; Haotian Liu; Chunyuan Li; Yikang Shen; Chuang Gan 001; Liangyan Gui; Yu-Xiong Wang; Yiming Yang; Kurt Keutzer; Trevor Darrell (ACL (Findings), 2024)

Multi-Agent Alternate Q-Learning. - Kefan Su; Siyuan Zhou; Jiechuan Jiang; Chuang Gan 001; Xiangjun Wang; Zongqing Lu 002 (AAMAS, 2024)

UBSoft: A Simulation Platform for Robotic Skill Learning in Unbounded Soft Environments. - Chunru Lin; Jugang Fan; Yian Wang 001; Zeyuan Yang 002; Zhehuan Chen; Lixing Fang; Tsun-Hsuan Wang; Zhou Xian; Chuang Gan 001 (CoRL, 2024)

MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World. - Yining Hong; Zishuo Zheng; Peihao Chen; Yian Wang 001; Junyan Li; Chuang Gan 001 (CVPR, 2024)

Open3DIS: Open-Vocabulary 3D Instance Segmentation with 2D Mask Guidance. - Phuc D. A. Nguyen; Tuan Duc Ngo; Evangelos Kalogerakis; Chuang Gan 001; Anh Tuan Tran 001; Cuong Pham 001; Khoi Nguyen 001 (CVPR, 2024)

SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge. - Andong Wang; Bo Wu 018; Sunli Chen; Zhenfang Chen; Haotian Guan; Wei-Ning Lee; Li Erran Li; Chuang Gan 001 (CVPR, 2024)

RILA: Reflective and Imaginative Language Agent for Zero-Shot Semantic Audio-Visual Navigation. - Zeyuan Yang 002; Jiageng Lin; Peihao Chen; Anoop Cherian; Tim K. Marks; Jonathan Le Roux; Chuang Gan 001 (CVPR, 2024)

FlexAttention for Efficient High-Resolution Vision-Language Models. - Junyan Li; Delin Chen; Tianle Cai; Peihao Chen; Yining Hong; Zhenfang Chen; Yikang Shen; Chuang Gan 001 (ECCV (25), 2024)

GENOME: Generative Neuro-Symbolic Visual Reasoning by Growing and Reusing Modules. - Zhenfang Chen; Rui Sun; Wenjun Liu; Yining Hong; Chuang Gan 001 (ICLR, 2024)

CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding. - Junyan Li; Delin Chen; Yining Hong; Zhenfang Chen; Peihao Chen; Yikang Shen; Chuang Gan 001 (ICLR, 2024)

DIFFTACTILE: A Physics-based Differentiable Tactile Simulator for Contact-rich Robotic Manipulation. - Zilin Si; Gu Zhang; Qingwei Ben; Branden Romero; Zhou Xian; Chao Liu; Chuang Gan 001 (ICLR, 2024)

SALMON: Self-Alignment with Instructable Reward Models. - Zhiqing Sun; Yikang Shen; Hongxin Zhang; Qinhong Zhou; Zhenfang Chen; David Daniel Cox; Yiming Yang; Chuang Gan 001 (ICLR, 2024)

Thin-Shell Object Manipulations With Differentiable Physics Simulations. - Yian Wang 001; Juntian Zheng; Zhehuan Chen; Zhou Xian; Gu Zhang; Chao Liu; Chuang Gan 001 (ICLR, 2024)

Building Cooperative Embodied Agents Modularly with Large Language Models. - Hongxin Zhang; Weihua Du; Jiaming Shan; Qinhong Zhou; Yilun Du; Joshua B. Tenenbaum; Tianmin Shu; Chuang Gan 001 (ICLR, 2024)

HAZARD Challenge: Embodied Decision Making in Dynamically Changing Environments. - Qinhong Zhou; Sunli Chen; Yisong Wang; Haozhe Xu; Weihua Du; Hongxin Zhang; Yilun Du; Joshua B. Tenenbaum; Chuang Gan 001 (ICLR, 2024)

Speech Self-Supervised Learning Using Diffusion Model Synthetic Data. - Heting Gao; Kaizhi Qian; Junrui Ni; Chuang Gan 001; Mark A. Hasegawa-Johnson; Shiyu Chang; Yang Zhang 001 (ICML, 2024)

LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery. - Pingchuan Ma 002; Tsun-Hsuan Wang; Minghao Guo; Zhiqing Sun; Joshua B. Tenenbaum; Daniela Rus; Chuang Gan 001; Wojciech Matusik (ICML, 2024)

RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation. - Yufei Wang 007; Zhou Xian; Feng Chen; Tsun-Hsuan Wang; Yian Wang 001; Katerina Fragkiadaki; Zackory Erickson; David Held; Chuang Gan 001 (ICML, 2024)

3D-VLA: A 3D Vision-Language-Action Generative World Model. - Haoyu Zhen; Xiaowen Qiu; Peihao Chen; Jincheng Yang; Xin Yan 008; Yilun Du; Yining Hong; Chuang Gan 001 (ICML, 2024)

ContPhy: Continuum Physical Concept Learning and Reasoning from Videos. - Zhicheng Zheng; Xin Yan 008; Zhenfang Chen; Jingzhou Wang; Qin Zhi Eddie Lim; Joshua B. Tenenbaum; Chuang Gan 001 (ICML, 2024)

RoboDreamer: Learning Compositional World Models for Robot Imagination. - Siyuan Zhou; Yilun Du; Jiaben Chen; Yandong Li; Dit-Yan Yeung; Chuang Gan 001 (ICML, 2024)

ConceptGraphs: Open-Vocabulary 3D Scene Graphs for Perception and Planning. - Qiao Gu; Ali Kuwajerwala; Sacha Morin; Krishna Murthy Jatavallabhula; Bipasha Sen; Aditya Agarwal; Corban Rivera; William Paul; Kirsty Ellis; Rama Chellappa; Chuang Gan 001; Celso Miguel de Melo; et al. (ICRA, 2024)

Disentangled Acoustic Fields For Multimodal Physical Scene Understanding. - Jie Yin; Andrew Luo; Yilun Du; Anoop Cherian; Tim K. Marks; Jonathan Le Roux; Chuang Gan 001 (IROS, 2024)

AWQ: Activation-aware Weight Quantization for On-Device LLM Compression and Acceleration. - Ji Lin 002; Jiaming Tang; Haotian Tang; Shang Yang; Wei-Ming Chen; Wei-Chen Wang 002; Guangxuan Xiao; Xingyu Dang; Chuang Gan 001; Song Han 003 (MLSys, 2024)

SocialGPT: Prompting LLMs for Social Relation Reasoning via Greedy Segment Optimization. - Wanhua Li 001; Zibin Meng; Jiawei Zhou; Donglai Wei 001; Chuang Gan 001; Hanspeter Pfister (NeurIPS, 2024)

Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge. - Weihua Du; Qiushi Lyu; Jiaming Shan; Zhenting Qi; Hongxin Zhang; Sunli Chen; Andi Peng; Tianmin Shu; Kwonjoon Lee; Behzad Dariush; Chuang Gan 001 (NeurIPS, 2024)

Physically Compatible 3D Object Modeling from a Single Image. - Minghao Guo; Bohan Wang; Pingchuan Ma 002; Tianyuan Zhang; Crystal Elaine Owens; Chuang Gan 001; Josh Tenenbaum 001; Kaiming He; Wojciech Matusik (NeurIPS, 2024)

ConMe: Rethinking Evaluation of Compositional Reasoning for Modern VLMs. - Irene Huang; Wei Lin 019; Muhammad Jehanzeb Mirza; Jacob A. Hansen; Sivan Doveh; Victor Butoi; Roei Herzig; Assaf Arbelle; Hilde Kuehne; Trevor Darrell; Chuang Gan 001; Aude Oliva; et al. (NeurIPS, 2024)

Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision. - Zhiqing Sun; Longhui Yu; Yikang Shen; Weiyang Liu; Yiming Yang; Sean Welleck; Chuang Gan 001 (NeurIPS, 2024)

Architect: Generating Vivid and Interactive 3D Scenes with Hierarchical 2D Inpainting. - Yian Wang 001; Xiaowen Qiu; Jiageng Liu; Zhehuan Chen; Jiting Cai; Yufei Wang 007; Tsun-Hsuan Johnson Wang; Zhou Xian; Chuang Gan 001 (NeurIPS, 2024)

Improving Reinforcement Learning from Human Feedback with Efficient Reward Model Ensemble. - Shun Zhang; Zhenfang Chen; Sunli Chen; Yikang Shen; Zhiqing Sun; Chuang Gan 001 (CoRR, 2024)

COMBO: Compositional World Models for Embodied Multi-Agent Cooperation. - Hongxin Zhang; Zeyuan Wang; Qiushi Lyu; Zheyuan Zhang; Sunli Chen; Tianmin Shu; Yilun Du; Chuang Gan 001 (CoRR, 2024)

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving. - Yujun Lin 001; Haotian Tang; Shang Yang; Zhekai Zhang; Guangxuan Xiao; Chuang Gan 001; Song Han 003 (CoRR, 2024)

RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text. - Jiaben Chen; Xin Yan 008; Yihang Chen; Siyuan Cen; Qinwei Ma; Haoyu Zhen; Kaizhi Qian; Lie Lu; Chuang Gan 001 (CoRR, 2024)

CoNav: A Benchmark for Human-Centered Collaborative Navigation. - Changhao Li; Xinyu Sun; Peihao Chen; Jugang Fan; Zixu Wang; Yanxia Liu; Jin-Hui Zhu; Chuang Gan 001; Mingkui Tan (CoRR, 2024)

SnapMem: Snapshot-based 3D Scene Memory for Embodied Exploration and Reasoning. - Yuncong Yang; Han Yang; Jiachen Zhou 003; Peihao Chen; Hongxin Zhang; Yilun Du; Chuang Gan 001 (CoRR, 2024)

VCA: Video Curious Agent for Long Video Understanding. - Zeyuan Yang 002; Delin Chen; Xueyang Yu; Maohao Shen; Chuang Gan 001 (CoRR, 2024)

UniMuMo: Unified Text, Music, and Motion Generation. - Han Yang; Kun Su; Yutong Zhang; Jiaben Chen; Kaizhi Qian; Gaowen Liu; Chuang Gan 001 (AAAI, 2025)

Your Language Model May Think Too Rigidly: Achieving Reasoning Consistency with Symmetry-Enhanced Training. - Yihang Yao; Zhepeng Cen; Miao Li; William Han; Yuyou Zhang; Emerson Liu; Zuxin Liu; Chuang Gan 001; Ding Zhao (ACL (Findings), 2025)

3D-Mem: 3D Scene Memory for Embodied Exploration and Reasoning. - Yuncong Yang; Han Yang; Jiachen Zhou 003; Peihao Chen; Hongxin Zhang; Yilun Du; Chuang Gan 001 (CVPR, 2025)

LSceneLLM: Enhancing Large 3D Scene Understanding Using Adaptive Visual Preferences. - Hongyan Zhi; Peihao Chen; Junyan Li; Shuailei Ma; Xinyu Sun; Tianhang Xiang; Yinjie Lei; Mingkui Tan; Chuang Gan 001 (CVPR, 2025)

SafeDiffuser: Safe Planning with Diffusion Probabilistic Models. - Wei Xiao 003; Tsun-Hsuan Wang; Chuang Gan 001; Ramin M. Hasani; Mathias Lechner; Daniela Rus (ICLR, 2025)

Scaling Autonomous Agents via Automatic Reward Modeling And Planning. - Zhenfang Chen; Delin Chen; Rui Sun; Wenjun Liu; Chuang Gan 001 (ICLR, 2025)

Delta: Dense Efficient Long-Range 3D tracking for any video. - Tuan Duc Ngo; Peiye Zhuang; Evangelos Kalogerakis; Chuang Gan 001; Sergey Tulyakov; Hsin-Ying Lee 001; Chaoyang Wang 001 (ICLR, 2025)

TopoGaussian: Inferring Internal Topology Structures from Visual Clues. - Xiaoyu Xiong; Changyu Hu; Chunru Lin; Pingchuan Ma 002; Chuang Gan 001; Tao Du 001 (ICLR, 2025)

COMBO: Compositional World Models for Embodied Multi-Agent Cooperation. - Hongxin Zhang; Zeyuan Wang; Qiushi Lyu; Zheyuan Zhang; Sunli Chen; Tianmin Shu; Behzad Dariush; Kwonjoon Lee; Yilun Du; Chuang Gan 001 (ICLR, 2025)

Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search. - Maohao Shen; Guangtao Zeng; Zhenting Qi; Zhang-Wei Hong; Zhenfang Chen; Wei Lu; Gregory W. Wornell; Subhro Das; David Cox; Chuang Gan 001 (CoRR, 2025)

Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling. - Xiaowen Qiu; Jincheng Yang; Yian Wang 001; Zhehuan Chen; Yufei Wang 007; Tsun-Hsuan Wang; Zhou Xian; Chuang Gan 001 (CoRR, 2025)

MatchMaker: Automated Asset Generation for Robotic Assembly. - Yian Wang 001; Bingjie Tang; Chuang Gan 001; Dieter Fox; Kaichun Mo; Yashraj S. Narang; Iretiayo Akinola (CoRR, 2025)

LuciBot: Automated Robot Policy Learning from Generated Videos. - Xiaowen Qiu; Yian Wang 001; Jiting Cai; Zhehuan Chen; Chunru Lin; Tsun-Hsuan Wang; Chuang Gan 001 (CoRR, 2025)

AdaWorld: Learning Adaptable World Models with Latent Actions. - Shenyuan Gao; Siyuan Zhou; Yilun Du; Jun Zhang; Chuang Gan 001 (CoRR, 2025)

Towards Understanding Camera Motions in Any Video. - Zhiqiu Lin; Siyuan Cen; Daniel Jiang; Jay Karhade; Hewei Wang 001; Chancharik Mitra; Tiffany Ling; Yuhan Huang; Sifan Liu; Mingyu Chen; Rushikesh Zawar; Xue Bai; et al. (CoRR, 2025)

TesserAct: Learning 4D Embodied World Models. - Haoyu Zhen; Qiao Sun; Hongxin Zhang; Junyan Li; Siyuan Zhou; Yilun Du; Chuang Gan 001 (CoRR, 2025)

Learning 3D Persistent Embodied World Models. - Siyuan Zhou; Yilun Du; Yuncong Yang; Lei Han; Peihao Chen; Dit-Yan Yeung; Chuang Gan 001 (CoRR, 2025)

Satori-SWE: Evolutionary Test-Time Scaling for Sample-Efficient Software Engineering. - Guangtao Zeng; Maohao Shen; Delin Chen; Zhenting Qi; Subhro Das; Dan Gutfreund; David Cox; Gregory W. Wornell; Wei Lu; Zhang-Wei Hong; Chuang Gan 001 (CoRR, 2025)

Steering LLM Thinking with Budget Guidance. - Junyan Li; Wenshuo Zhao; Yang Zhang 001; Chuang Gan 001 (CoRR, 2025)

RobotSmith: Generative Robotic Tool Design for Acquisition of Complex Manipulation Skills. - Chunru Lin; Haotian Yuan 005; Yian Wang 001; Xiaowen Qiu; Tsun-Hsuan Wang; Minghao Guo; Bohan Wang; Yashraj Narang; Dieter Fox; Chuang Gan 001 (CoRR, 2025)

Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens. - Zeyuan Yang 002; Xueyang Yu; Delin Chen; Maohao Shen; Chuang Gan 001 (CoRR, 2025)

CommVQ: Commutative Vector Quantization for KV Cache Compression. - Junyan Li; Yang Zhang 001; Muhammad Yusuf Hassan; Talha Chafekar; Tianle Cai; Zhile Ren; Pengsheng Guo; Foroozan Karimzadeh; Colorado Reed; Chong Wang; Chuang Gan 001 (CoRR, 2025)

Ella: Embodied Social Agents with Lifelong Memory. - Hongxin Zhang; Zheyuan Zhang; Zeyuan Wang; Zunzhe Zhang; Lixing Fang; Qinhong Zhou; Chuang Gan 001 (CoRR, 2025)

LangSplatV2: High-dimensional 3D Language Gaussian Splatting with 450+ FPS. - Wanhua Li 001; Yujie Zhao; Minghan Qin; Yang Liu; Yuanhao Cai; Chuang Gan 001; Hanspeter Pfister (CoRR, 2025)

MindJourney: Test-Time Scaling with World Models for Spatial Reasoning. - Yuncong Yang; Jiageng Liu; Zheyuan Zhang; Siyuan Zhou; Reuben Tan; Jianwei Yang; Yilun Du; Chuang Gan 001 (CoRR, 2025)

ProsodyLM: Uncovering the Emerging Prosody Processing Capabilities in Speech Language Models. - Kaizhi Qian; Xulin Fan; Junrui Ni; Slava Shechtman; Mark Hasegawa-Johnson; Chuang Gan 001; Yang Zhang 001 (CoRR, 2025)

DELTAv2: Accelerating Dense 3D Tracking. - Tuan Duc Ngo; Ashkan Mirzaei; Guocheng Qian; Hanwen Liang; Chuang Gan 001; Evangelos Kalogerakis; Peter Wonka; Chaoyang Wang 001 (CoRR, 2025)

Virtual Community: An Open World for Humans, Robots, and Society. - Qinhong Zhou; Hongxin Zhang; Xiangye Lin; Zheyuan Zhang; Yutian Chen; Wenjun Liu; Zunzhe Zhang; Sunli Chen; Lixing Fang; Qiushi Lyu; Xinyu Sun; Jincheng Yang; et al. (CoRR, 2025)

Compositional Physical Reasoning of Objects and Events From Videos. - Zhenfang Chen; Shilong Dong; Kexin Yi; Yunzhu Li; Mingyu Ding; Antonio Torralba 001; Joshua B. Tenenbaum; Chuang Gan 001 (IEEE Trans. Pattern Anal. Mach. Intell., 2025)