Generating Simulations of Motion Events from Verbal Descriptions. - James Pustejovsky; Nikhil Krishnaswamy (*SEM@COLING, 2014)

Visualizing Events: Simulating Meaning in Language. - James Pustejovsky; Nikhil Krishnaswamy (CogSci, 2016)

VoxSim: A Visual Platform for Modeling Motion Language. - Nikhil Krishnaswamy; James Pustejovsky (COLING (Demos), 2016)

VoxML: A Visualization Modeling Language. - James Pustejovsky; Nikhil Krishnaswamy (LREC, 2016)

Multimodal Semantic Simulations of Linguistically Underspecified Motion Events. - Nikhil Krishnaswamy; James Pustejovsky (Spatial Cognition, 2016)

ECAT: Event Capture Annotation Tool. - Tuan Do; Nikhil Krishnaswamy; James Pustejovsky (CoRR, 2016)

Communicating and Acting: Understanding Gesture in Simulation Semantics. - Nikhil Krishnaswamy; Pradyumna Narayana; Isaac Wang; Kyeongmin Rim; Rahul Bangar; Dhruva Patil; Gururaj Mulay; J. Ross Beveridge; Jaime Ruiz; Bruce A. Draper; James Pustejovsky (IWCS(2), 2017)

Teaching Virtual Agents to Perform Complex Spatial-Temporal Activities. - Tuan Do; Nikhil Krishnaswamy; James Pustejovsky (AAAI Spring Symposia, 2018)

Every Object Tells a Story. - James Pustejovsky; Nikhil Krishnaswamy (EventStory@Coling, 2018)

Cooperating with Avatars Through Gesture, Language and Action. - Pradyumna Narayana; Nikhil Krishnaswamy; Isaac Wang; Rahul Bangar; Dhruva Patil; Gururaj Mulay; Kyeongmin Rim; J. Ross Beveridge; Jaime Ruiz; James Pustejovsky; Bruce A. Draper (IntelliSys (1), 2018)

An Evaluation Framework for Multimodal Interaction. - Nikhil Krishnaswamy; James Pustejovsky (LREC, 2018)

Deictic Adaptation in a Virtual Environment. - Nikhil Krishnaswamy; James Pustejovsky (Spatial Cognition, 2018)

Multimodal Interactive Learning of Primitive Actions. - Tuan Do; Nikhil Krishnaswamy; Kyeongmin Rim; James Pustejovsky (CoRR, 2018)

Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise. - Nikhil Krishnaswamy; Scott Friedman 001; James Pustejovsky (AAAI, 2019)

Generating a Novel Dataset of Multimodal Referring Expressions. - Nikhil Krishnaswamy; James Pustejovsky (IWCS (2), 2019)

Situated Grounding Facilitates Multimodal Concept Learning for AI. - Nikhil Krishnaswamy; James Pustejovsky (ViGIL@NeurIPS, 2019)

Situational Grounding within Multimodal Simulations. - James Pustejovsky; Nikhil Krishnaswamy (CoRR, 2019)

Multimodal Continuation-style Architectures for Human-Robot Interaction. - Nikhil Krishnaswamy; James Pustejovsky (CoRR, 2019)

Diana's World: A Situated Multimodal Interactive Agent. - Nikhil Krishnaswamy; Pradyumna Narayana; Rahul Bangar; Kyeongmin Rim; Dhruva Patil; David G. McNeely-White; Jaime Ruiz; Bruce A. Draper; J. Ross Beveridge; James Pustejovsky (AAAI, 2020)

Situational Awareness in Human Computer Interaction: Diana's World. - Nikhil Krishnaswamy; J. Ross Beveridge; James Pustejovsky; Dhruva Patil; David G. McNeely-White; Heting Wang; Francisco R. Ortega 001 (ICAT-EGVE (Posters and Demos), 2020)

Jarvis: A Multimodal Visualization Tool for Bioinformatic Data. - Mark Hutchens; Nikhil Krishnaswamy; Brent Cochran; James Pustejovsky (HCI (45), 2020)

Embodied Human-Computer Interactions through Situated Grounding. - James Pustejovsky; Nikhil Krishnaswamy (IVA, 2020)

A Formal Analysis of Multimodal Referring Strategies Under Common Ground. - Nikhil Krishnaswamy; James Pustejovsky (LREC, 2020)

Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment. - Katherine Krajovic; Nikhil Krishnaswamy; Nathaniel J. Dimick; R. Pito Salas; James Pustejovsky (CoRR, 2020)

Neurosymbolic AI for Situated Language Understanding. - Nikhil Krishnaswamy; James Pustejovsky (CoRR, 2020)

The Role of Embodiment and Simulation in Evaluating HCI: Experiments and Evaluation. - Nikhil Krishnaswamy; James Pustejovsky (HCI (16), 2021)

The Role of Embodiment and Simulation in Evaluating HCI: Theory and Framework. - James Pustejovsky; Nikhil Krishnaswamy (HCI (16), 2021)

Embodied Human Computer Interaction. - James Pustejovsky; Nikhil Krishnaswamy (Künstliche Intell., 2021)

Exploiting Embodied Simulation to Detect Novel Object Classes Through Interaction. - Nikhil Krishnaswamy; Sadaf Ghaffari (CogSci, 2022)

A Generalized Method for Automated Multilingual Loanword Detection. - Abhijnan Nath; Sina Mahdipour Saravani; Ibrahim Khebour; Sheikh Mannan; Zihui Li; Nikhil Krishnaswamy (COLING, 2022)

A deep dive into microphone hardware for recording collaborative group work. - Mariah Bradford; Paige Hansen; J. Ross Beveridge; Nikhil Krishnaswamy; Nathaniel Blanchard (EDM, 2022)

Multimodal Semantics for Affordances and Actions. - James Pustejovsky; Nikhil Krishnaswamy (HCI (1), 2022)

The VoxWorld Platform for Multimodal Embodied Agents. - Nikhil Krishnaswamy; William Pickard; Brittany Cates; Nathaniel Blanchard; James Pustejovsky (LREC, 2022)

Detecting and Accommodating Novel Types and Concepts in an Embodied Simulation Environment. - Sadaf Ghaffari; Nikhil Krishnaswamy (CoRR, 2022)

Affordance embeddings for situated language understanding. - Nikhil Krishnaswamy; James Pustejovsky (Frontiers Artif. Intell., 2022)

Hybrid Machine Learning/Knowledge Base Systems Learning through Natural Language Dialogue with Deep Learning Models. - Sergei Nirenburg; Nikhil Krishnaswamy; Marjorie McShane (AAAI Spring Symposium: MAKE, 2023)

2*n is better than n²: Decomposing Event Coreference Resolution into Two Tractable Problems. - Shafiuddin Rehan Ahmed; Abhijnan Nath; James H. Martin; Nikhil Krishnaswamy (ACL (Findings), 2023)

AxomiyaBERTa: A Phonologically-aware Transformer Model for Assamese. - Abhijnan Nath; Sheikh Mannan; Nikhil Krishnaswamy (ACL (Findings), 2023)

Automatic Detection of Collaborative States in Small Groups Using Multimodal Features. - Mariah Bradford; Ibrahim Khebour; Nathaniel Blanchard; Nikhil Krishnaswamy (AIED, 2023)

Intentional Microgesture Recognition for Extended Human-Computer Interaction. - Chirag Kandoi; Changsoo Jung; Sheikh Mannan; Hannah VanderHoeven; Quincy Meisman; Nikhil Krishnaswamy; Nathaniel Blanchard (HCI (1), 2023)

Robust Motion Recognition Using Gesture Phase Annotation. - Hannah VanderHoeven; Nathaniel Blanchard; Nikhil Krishnaswamy (HCI (18), 2023)

A Methodology for Evaluating Multimodal Referring Expression Generation for Embodied Virtual Agents. - Nada Alalyani; Nikhil Krishnaswamy (ICMI Companion, 2023)

2*n is better than n2: Decomposing Event Coreference Resolution into Two Tractable Problems. - Shafiuddin Rehan Ahmed; Abhijnan Nath; James H. Martin; Nikhil Krishnaswamy (CoRR, 2023)

An Abstract Specification of VoxML as an Annotation Language. - Kiyong Lee; Nikhil Krishnaswamy; James Pustejovsky (CoRR, 2023)

Grounding and Distinguishing Conceptual Vocabulary Through Similarity Learning in Embodied Simulations. - Sadaf Ghaffari; Nikhil Krishnaswamy (CoRR, 2023)

How Good is Automatic Segmentation as a Multimodal Discourse Annotation Aid? - Corbyn Terpstra; Ibrahim Khebour; Mariah Bradford; Brett Wisniewski; Nikhil Krishnaswamy; Nathaniel Blanchard (CoRR, 2023)

How Good is the Model in Model-in-the-loop Event Coreference Resolution Annotation? - Shafiuddin Rehan Ahmed; Abhijnan Nath; Michael Regan; Adam Pollins; Nikhil Krishnaswamy; James H. Martin (CoRR, 2023)

Grounding human-object interaction to affordance behavior in multimodal datasets. - Alexander Henlein; Anju Gopinath; Nikhil Krishnaswamy; Alexander Mehler; James Pustejovsky (Frontiers Artif. Intell., 2023)

Exploring Failure Cases in Multimodal Reasoning About Physical Dynamics. - Sadaf Ghaffari; Nikhil Krishnaswamy (AAAI Spring Symposia, 2024)

Embodying Human-Like Modes of Balance Control Through Human-In-the-Loop Dyadic Learning. - Sheikh Mannan; Vivekanand Pandey Vimal; Paul DiZio; Nikhil Krishnaswamy (AAAI Spring Symposia, 2024)

Common Ground Tracking in Multimodal Dialogue. - Ibrahim Khalil Khebour; Kenneth Lai; Mariah Bradford; Yifan Zhu; Richard Brutti; Christopher Tam; Jingxuan Tu; Benjamin Ibarra; Nathaniel Blanchard; Nikhil Krishnaswamy; James Pustejovsky (LREC/COLING, 2024)

Cross-Lingual Transfer Robustness to Lower-Resource Languages on Adversarial Datasets. - Shadi Manafi; Nikhil Krishnaswamy (LREC/COLING, 2024)

Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles. - Abhijnan Nath; Huma Jamil; Shafiuddin Rehan Ahmed; George Arthur Baker; Rahul Ghosh; James H. Martin; Nathaniel Blanchard; Nikhil Krishnaswamy (LREC/COLING, 2024)

Propositional Extraction from Natural Speech in Small Group Collaborative Tasks. - Videep Venkatesha; Abhijnan Nath; Ibrahim Khebour; Avyakta Chelle; Mariah Bradford; Jingxuan Tu; James Pustejovsky; Nathaniel Blanchard; Nikhil Krishnaswamy (EDM, 2024)

Large Language Models Are Challenged by Habitat-Centered Reasoning. - Sadaf Ghaffari; Nikhil Krishnaswamy (EMNLP (Findings), 2024)

"Any Other Thoughts, Hedgehog?" Linking Deliberation Chains in Collaborative Dialogues. - Abhijnan Nath; Videep Venkatesha; Mariah Bradford; Avyakta Chelle; Austin Youngren; Carlos Mabrey; Nathaniel Blanchard; Nikhil Krishnaswamy (EMNLP (Findings), 2024)

Combating Spatial Disorientation in a Dynamic Self-Stabilization Task Using AI Assistants. - Sheikh Abdul Mannan; Paige Hansen; Vivekanand Pandey Vimal; Hannah N. Davies; Paul DiZio; Nikhil Krishnaswamy (HAI, 2024)

Multimodal Referring Expression Generation for Human-Computer Interaction. - Nada Alalyani; Nikhil Krishnaswamy (HCI (71), 2024)

Learning Foreign Language Vocabulary Through Task-Based Virtual Reality Immersion. - Ethan Seefried; Mariah Bradford; Swagatalaxmi Aich; Caspian Siebert; Nikhil Krishnaswamy; Nathaniel Blanchard (HCI (59), 2024)

Multimodal Design for Interactive Collaborative Problem-Solving Support. - Hannah VanderHoeven; Mariah Bradford; Changsoo Jung; Ibrahim Khebour; Kenneth Lai; James Pustejovsky; Nikhil Krishnaswamy; Nathaniel Blanchard (HCI (6), 2024)

Point Target Detection for Multimodal Communication. - Hannah VanderHoeven; Nathaniel Blanchard; Nikhil Krishnaswamy (HCI (26), 2024)

Modeling Theory of Mind in Multimodal HCI. - Yifan Zhu; Hannah VanderHoeven; Kenneth Lai; Mariah Bradford; Christopher Tam; Ibrahim Khebour; Richard Brutti; Nikhil Krishnaswamy; James Pustejovsky (HCI (1), 2024)

Okay, Let's Do This! Modeling Event Coreference with Generated Rationales and Knowledge Distillation. - Abhijnan Nath; Shadi Manafi Avari; Avyakta Chelle; Nikhil Krishnaswamy (NAACL-HLT, 2024)

Metacognitive AI: Framework and the Case for a Neurosymbolic Approach. - Hua Wei 001; Paulo Shakarian; Christian Lebiere; Bruce A. Draper; Nikhil Krishnaswamy; Sergei Nirenburg (NeSy (2), 2024)

From learning optimization to learner flourishing: Reimagining AI in Education at the Institute for Student-AI Teaming (iSAT). - Sidney K. D'Mello; Quentin Biddy; Thomas Breideband; Jeffrey Bush 001; Michael Alan Chang; Arturo Cortez; Jeffrey Flanigan; Peter W. Foltz; Jamie C. Gorman; Leanne M. Hirshfield; Monlin Monica Ko; Nikhil Krishnaswamy; et al. (AI Mag., 2024)

Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles. - Abhijnan Nath; Huma Jamil; Shafiuddin Rehan Ahmed; George Baker; Rahul Ghosh; James H. Martin; Nathaniel Blanchard; Nikhil Krishnaswamy (CoRR, 2024)

Computational Thought Experiments for a More Rigorous Philosophy and Science of the Mind. - Iris Oved; Nikhil Krishnaswamy; James Pustejovsky; Joshua K. Hartshorne (CoRR, 2024)

Simultaneous Reward Distillation and Preference Learning: Get You a Language Model Who Can Do Both. - Abhijnan Nath; Changsoo Jung; Ethan Seefried; Nikhil Krishnaswamy (CoRR, 2024)

Bidirectional Human-AI Learning in Real-Time Disoriented Balancing. - Sheikh Mannan; Nikhil Krishnaswamy (AAAI, 2025)

Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement. - Derek Palmer; Yifan Zhu; Kenneth Lai; Hannah VanderHoeven; Mariah Bradford; Ibrahim Khebour; Carlos Mabrey; Jack Fitzgerald; Nikhil Krishnaswamy; Martha Palmer; James Pustejovsky (AAAI, 2025)

Frictional Agent Alignment Framework: Slow Down and Don't Break Things. - Abhijnan Nath; Carine Graff; Andrei Bachinin; Nikhil Krishnaswamy (ACL (1), 2025)

The Impact of Background Speech on Interruption Detection in Collaborative Groups. - Mariah Bradford; Nikhil Krishnaswamy; Nathaniel Blanchard (AIED (3), 2025)

HuTCH: Human Teachable Concept Highlighter for Post-hoc Visual Explanations. - Erfan Mirhaji; Nikhil Krishnaswamy; Jill Zarestky; Lisa Mason; Sarath Sreedharan; Nathaniel Blanchard (AIED (5), 2025)

Tracking Individual Beliefs in Co-situated Groups Using Multimodal Input. - Mariah Bradford; Ibrahim Khebour; Hannah VanderHoeven; Videep Venkatesha; Nathaniel Blanchard; Nikhil Krishnaswamy (HCI (54), 2025)

Feature Contributions to Multimodal Interpretation of Common Ground. - Ibrahim Khebour; Changsoo Jung; Jack Fitzgerald; Huma Jamil; Nikhil Krishnaswamy (HCI (6), 2025)

Multimodal Situational Awareness: Neuro-Symbolic AI for Real-Time HCI in the Classroom. - Yifan Zhu; Kenneth Lai; Ibrahim Khebour; Marc Verhagen; Nikhil Krishnaswamy; James Pustejovsky (HCI (61), 2025)

DPL: Diverse Preference Learning Without A Reference Model. - Abhijnan Nath; Andrey Volozin; Saumajit Saha; Albert Nanda; Galina Grunin; Rahul Bhotika; Nikhil Krishnaswamy (NAACL (Long Papers), 2025)

TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues. - Hannah VanderHoeven; Brady Bhalla; Ibrahim Khebour; Austin Youngren; Videep Venkatesha; Mariah Bradford; Jack Fitzgerald; Carlos Mabrey; Jingxuan Tu; Yifan Zhu; Kenneth Lai; Changsoo Jung; et al. (CoRR, 2025)

Dynamic Epistemic Friction in Dialogue. - Timothy Obiso; Kenneth Lai; Abhijnan Nath; Nikhil Krishnaswamy; James Pustejovsky (CoRR, 2025)