Learning physically-instantiated game play through visual observation. - Andrei Barbu; Siddharth Narayanaswamy; Jeffrey Mark Siskind (ICRA, 2010)

A visual language model for estimating object pose and structure in a generative visual domain. - Siddharth Narayanaswamy; Andrei Barbu; Jeffrey Mark Siskind (ICRA, 2011)

Video In Sentences Out. - Andrei Barbu; Alexander Bridge; Zachary Burchill; Dan Coroian; Sven J. Dickinson; Sanja Fidler; Aaron Michaux; Sam Mussman; Siddharth Narayanaswamy; Dhaval Salvi; Lara Schmidt; Jiangnan Shangguan; et al. (UAI, 2012)

Simultaneous Object Detection, Tracking, and Event Recognition - Andrei Barbu; Aaron Michaux; Siddharth Narayanaswamy; Jeffrey Mark Siskind (CoRR, 2012)

Seeing Unseeability to See the Unseeable - Siddharth Narayanaswamy; Andrei Barbu; Jeffrey Mark Siskind (CoRR, 2012)

Large-Scale Automatic Labeling of Video Events with Verbs Based on Event-Participant Interaction - Andrei Barbu; Alexander Bridge; Dan Coroian; Sven J. Dickinson; Sam Mussman; Siddharth Narayanaswamy; Dhaval Salvi; Lara Schmidt; Jiangnan Shangguan; Jeffrey Mark Siskind; Jarrell W. Waggoner; Song Wang 002; et al. (CoRR, 2012)

Recognize Human Activities from Partially Observed Videos. - Yu Cao 003; Daniel Paul Barrett; Andrei Barbu; Siddharth Narayanaswamy; Haonan Yu; Aaron Michaux; Yuewei Lin; Sven J. Dickinson; Jeffrey Mark Siskind; Song Wang 002 (CVPR, 2013)

Saying What You're Looking For: Linguistics Meets Video Search. - Andrei Barbu; Siddharth Narayanaswamy; Jeffrey Mark Siskind (CoRR, 2013)

Reasoning Across Language and Vision in Machines and Humans - Andrei Barbu (2013)

Seeing What You're Told: Sentence-Guided Activity Recognition in Video. - N. Siddharth 001; Andrei Barbu; Jeffrey Mark Siskind (CVPR, 2014)

Seeing is Worse than Believing: Reading People's Minds Better than Computer-Vision Methods Recognize Actions. - Andrei Barbu; Daniel Paul Barrett; Wei Chen 134; Siddharth Narayanaswamy; Caiming Xiong; Jason J. Corso; Christiane D. Fellbaum; Catherine Hanson; Stephen José Hanson; Sébastien Hélie; Evguenia Malaia; Barak A. Pearlmutter; et al. (ECCV (5), 2014)

Do You See What I Mean? Visual Resolution of Linguistic Ambiguities. - Yevgeni Berzak; Andrei Barbu; Daniel Harari; Boris Katz; Shimon Ullman (EMNLP, 2015)

A Compositional Framework for Grounding Language Inference, Generation, and Acquisition in Video. - Haonan Yu; N. Siddharth 001; Andrei Barbu; Jeffrey Mark Siskind (J. Artif. Intell. Res., 2015)

Anchoring and Agreement in Syntactic Annotations. - Yevgeni Berzak; Yan Huang 014; Andrei Barbu; Anna Korhonen; Boris Katz (EMNLP, 2016)

Bias and Agreement in Syntactic Annotations. - Yevgeni Berzak; Yan Huang 014; Andrei Barbu; Anna Korhonen; Boris Katz (CoRR, 2016)

Saying What You're Looking For: Linguistics Meets Video Search. - Daniel Paul Barrett; Andrei Barbu; N. Siddharth 001; Jeffrey Mark Siskind (IEEE Trans. Pattern Anal. Mach. Intell., 2016)

Temporal Grounding Graphs for Language Understanding with Accrued Visual-Linguistic Context. - Rohan Paul; Andrei Barbu; Sue Felshin; Boris Katz; Nicholas Roy (IJCAI, 2017)

Partially Occluded Hands: - A Challenging New Dataset for Single-Image Hand Pose Estimation. - Battushig Myanganbayar; Cristina Mata; Gil Dekel; Boris Katz; Guy Ben-Yosef; Andrei Barbu (ACCV (5), 2018)

Grounding language acquisition by training semantic parsers using captioned videos. - Candace Ross; Andrei Barbu; Yevgeni Berzak; Battushig Myanganbayar; Boris Katz (EMNLP, 2018)

Deep Sequential Models for Sampling-Based Planning. - Yen-Ling Kuo; Andrei Barbu; Boris Katz (IROS, 2018)

ObjectNet: A large-scale bias-controlled dataset for pushing the limits of object recognition models. - Andrei Barbu; David Mayo; Julian Alverio; William Luo; Christopher Wang; Dan Gutfreund; Josh Tenenbaum 001; Boris Katz (NeurIPS, 2019)

Deep compositional robotic planners that follow natural language commands. - Yen-Ling Kuo; Boris Katz; Andrei Barbu (ViGIL@NeurIPS, 2019)

Learning Language from Vision. - Candace Ross; Cheahuychou Mao; Boris Katz; Andrei Barbu (ViGIL@NeurIPS, 2019)

Learning a natural-language to LTL executable semantic parser for grounded robotics. - Christopher Wang; Candace Ross; Yen-Ling Kuo; Boris Katz; Andrei Barbu (CoRL, 2020)

Encoding formulas as deep networks: Reinforcement learning for zero-shot execution of LTL formulas. - Yen-Ling Kuo; Boris Katz; Andrei Barbu (IROS, 2020)

Deep video-to-video transformations for accessibility with an application to photosensitivity. - Andrei Barbu; Dalitso Banda; Boris Katz (Pattern Recognit. Lett., 2020)

PHASE: PHysically-grounded Abstract Social Events for Machine Social Perception. - Aviv Netanyahu; Tianmin Shu; Boris Katz; Andrei Barbu; Joshua B. Tenenbaum (AAAI, 2021)

Social Interactions as Recursive MDPs. - Ravi Tejwani; Yen-Ling Kuo; Tianmin Shu; Boris Katz; Andrei Barbu (CoRL, 2021)

Compositional Networks Enable Systematic Generalization for Grounded Language Understanding. - Yen-Ling Kuo; Boris Katz; Andrei Barbu (EMNLP (Findings), 2021)

Multi-resolution modeling of a discrete stochastic process identifies causes of cancer. - Adam Uri Yaari; Maxwell Sherman; Oliver Clarke Priebe; Po-Ru Loh; Boris Katz; Andrei Barbu; Bonnie Berger (ICLR, 2021)

Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset. - Ian Palmer; Andrew Rouditchenko; Andrei Barbu; Boris Katz; James R. Glass (Interspeech, 2021)

Measuring Social Biases in Grounded Vision and Language Embeddings. - Candace Ross; Boris Katz; Andrei Barbu (NAACL-HLT, 2021)

Neural Regression, Representational Similarity, Model Zoology & Neural Taskonomy at Scale in Rodent Visual Cortex. - Colin Conwell; David Mayo; Andrei Barbu; Michael A. Buice; George Alvarez; Boris Katz (NeurIPS, 2021)

On the use of Cortical Magnification and Saccades as Biological Proxies for Data Augmentation. - Binxu Wang; David Mayo; Arturo Deza; Andrei Barbu; Colin Conwell (CoRR, 2021)

Compositional RL Agents That Follow Language Commands in Temporal Logic. - Yen-Ling Kuo; Boris Katz; Andrei Barbu (Frontiers Robotics AI, 2021)

Quantifying the Emergence of Symbolic Communication. - Emily Cheng; Yen-Ling Kuo; Josefina Correa; Boris Katz; Ignacio Cases; Andrei Barbu (CogSci, 2022)

The Aligned Multimodal Movie Treebank: An audio, video, dependency-parse treebank. - Adam Uri Yaari; Jan DeWitt; Henry Hu; Bennett Stankovits; Sue Felshin; Yevgeni Berzak; Helena Aparicio; Boris Katz; Ignacio Cases; Andrei Barbu (EMNLP, 2022)

Trajectory Prediction with Linguistic Representations. - Yen-Ling Kuo; Xin Huang 018; Andrei Barbu; Stephen G. McGill; Boris Katz; John J. Leonard; Guy Rosman (ICRA, 2022)

Incorporating Rich Social Interactions Into MDPs. - Ravi Tejwani; Yen-Ling Kuo; Tianmin Shu; Bennett Stankovits; Dan Gutfreund; Joshua B. Tenenbaum; Boris Katz; Andrei Barbu (ICRA, 2022)

Developing a Series of AI Challenges for the United States Department of the Air Force. - Vijay Gadepally; Gregory Angelides; Andrei Barbu; Andrew Bowne; Laura J. Brattain; Tamara Broderick; Armando Cabrera; Glenn Carl; Ronisha Carter; Miriam Cha; Emilie Cowen; Jesse Cummings; et al. (CoRR, 2022)

Query The Agent: Improving sample efficiency through epistemic uncertainty estimation. - Julian Alverio; Boris Katz; Andrei Barbu (CoRR, 2022)

Human or Machine? Turing Tests for Vision and Language. - Mengmi Zhang; Giorgia Dellaferrera; Ankur Sikarwar; Marcelo Armendáriz; Noga Mudrik; Prachi Agrawal; Spandan Madan; Andrei Barbu; Haochen Yang; Tanishq Kumar; Meghna Sadwani; Stella Dellaferrera; et al. (CoRR, 2022)

Zero-Shot Linear Combinations of Grounded Social Interactions with Linear Social MDPs. - Ravi Tejwani; Yen-Ling Kuo; Tianmin Shu; Bennett Stankovits; Dan Gutfreund; Joshua B. Tenenbaum; Boris Katz; Andrei Barbu (AAAI, 2023)

Modeling Visual Impairments with Artificial Neural Networks: a Review. - Lucia Schiatti; Monica Gori; Martin Schrimpf; Giulia Cappagli; Federica Morelli; Sabrina Signorini; Boris Katz; Andrei Barbu (ICCV (Workshops), 2023)

BrainBERT: Self-supervised representation learning for intracranial recordings. - Christopher Wang; Vighnesh Subramaniam; Adam Uri Yaari; Gabriel Kreiman; Boris Katz; Ignacio Cases; Andrei Barbu (ICLR, 2023)

How hard are computer vision datasets? Calibrating dataset difficulty to viewing time. - David Mayo; Jesse Cummings; Xinyu Lin; Dan Gutfreund; Boris Katz; Andrei Barbu (NeurIPS, 2023)

Revealing Vision-Language Integration in the Brain with Multimodal Networks. - Vighnesh Subramaniam; Colin Conwell; Christopher Wang; Gabriel Kreiman; Boris Katz; Ignacio Cases; Andrei Barbu (ICML, 2024)

BrainBits: How Much of the Brain are Generative Reconstruction Methods Using? - David Mayo; Christopher Wang; Asa Harbin; Abdulrahman Alabdulkareem; Albert E. Shaw; Boris Katz; Andrei Barbu (NeurIPS, 2024)

Brain Treebank: Large-scale intracranial recordings from naturalistic language stimuli. - Christopher Wang; Adam Uri Yaari; Aaditya Singh; Vighnesh Subramaniam; Dana Rosenfarb; Jan DeWitt; Pranav Misra; Joseph R. Madsen; Scellig S. Stone; Gabriel Kreiman; Boris Katz; Ignacio Cases; et al. (NeurIPS, 2024)

SecureLLM: Using Compositionality to Build Provably Secure Language Models for Private, Sensitive, and Secret Data. - Abdulrahman Alabdulakreem; Christian M. Arnold; Yerim Lee; Pieter M. Feenstra; Boris Katz; Andrei Barbu (CoRR, 2024)

Population Transformer: Learning Population-level Representations of Intracranial Activity. - Geeling Chau; Christopher Wang; Sabera Talukder; Vighnesh Subramaniam; Saraswati Soedarmadji; Yisong Yue; Boris Katz; Andrei Barbu (CoRR, 2024)

Baba Is AI: Break the Rules to Beat the Benchmark. - Nathan Cloos; Meagan Jens; Michelangelo Naim; Yen-Ling Kuo; Ignacio Cases; Andrei Barbu; Christopher J. Cueva (CoRR, 2024)

Training the Untrainable: Introducing Inductive Bias via Representational Alignment. - Vighnesh Subramaniam; David Mayo; Colin Conwell; Tomaso A. Poggio; Boris Katz; Brian Cheung; Andrei Barbu (CoRR, 2024)

Using Multimodal Deep Neural Networks to Disentangle Language from Visual Aesthetics. - Colin Conwell; Christopher Hamblin; Chelsea Boccagno; David Mayo; Jesse Cummings; Leyla Isik; Andrei Barbu (CoRR, 2024)

Population Transformer: Learning Population-level Representations of Neural Activity. - Geeling Chau; Christopher Wang; Sabera J. Talukder; Vighnesh Subramaniam; Saraswati Soedarmadji; Yisong Yue; Boris Katz; Andrei Barbu (ICLR, 2025)

SecureLLM: New private and confidential interfaces with LLMs. - Abdulrahman Alabdulkareem; Christian M. Arnold; Yerim Lee; Pieter M. Feenstra; Boris Katz; Andrei Barbu (IUI Workshops, 2025)

A Pilot Study: Naive smart interfaces can cause accidents. - Christian M. Arnold; Paul Robertson 001; Zoe Robertson; Robert Laddaga; Boris Katz; Andrei Barbu (IUI Workshops, 2025)