Multimodal sentiment analysis with word-level fusion and reinforcement learning. - Minghai Chen; Sen Wang; Paul Pu Liang; Tadas Baltrusaitis; Amir Zadeh 001; Louis-Philippe Morency (ICMI, 2017)

Memory Fusion Network for Multi-view Sequential Learning. - Amir Zadeh 001; Paul Pu Liang; Navonil Mazumder; Soujanya Poria; Erik Cambria; Louis-Philippe Morency (AAAI, 2018)

Multi-attention Recurrent Network for Human Communication Comprehension. - Amir Zadeh 001; Paul Pu Liang; Soujanya Poria; Prateek Vij; Erik Cambria; Louis-Philippe Morency (AAAI, 2018)

Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion Graph. - Amir Zadeh 001; Paul Pu Liang; Soujanya Poria; Erik Cambria; Louis-Philippe Morency (ACL (1), 2018)

Efficient Low-rank Multimodal Fusion With Modality-Specific Factors. - Zhun Liu; Ying Shen 006; Varun Bharadhwaj Lakshminarasimhan; Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (ACL (1), 2018)

An Empirical Evaluation of Sketched SVD and its Application to Leverage Score Ordering. - Hui Han Chin; Paul Pu Liang (ACML, 2018)

Multimodal Language Analysis with Recurrent Multistage Fusion. - Paul Pu Liang; Ziyin Liu 001; Amir Zadeh 001; Louis-Philippe Morency (EMNLP, 2018)

Robust Modulation Classification under Uncertain Noise Condition Using Recurrent Neural Network. - Shisheng Hu; Yiyang Pei; Paul Pu Liang; Ying-Chang Liang (GLOBECOM, 2018)

A Machine Learning Approach to MIMO Communications. - Yu-Di Huang; Paul Pu Liang; Qianqian Zhang 001; Ying-Chang Liang (ICC, 2018)

Multimodal Local-Global Ranking Fusion for Emotion Recognition. - Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (ICMI, 2018)

Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis. - Hai Pham; Thomas Manzini; Paul Pu Liang; Barnabás Póczos (CoRR, 2018)

Label-Assisted Transmission for Short Packet Communications: A Machine Learning Approach. - Qianqian Zhang 001; Paul Pu Liang; Yu-Di Huang; Yiyang Pei; Ying-Chang Liang (IEEE Trans. Veh. Technol., 2018)

Found in Translation: Learning Robust Joint Representations by Cyclic Translations between Modalities. - Hai Pham; Paul Pu Liang; Thomas Manzini; Louis-Philippe Morency; Barnabás Póczos (AAAI, 2019)

Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors. - Yansen Wang; Ying Shen 006; Zhun Liu; Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (AAAI, 2019)

Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization. - Paul Pu Liang; Zhun Liu; Yao-Hung Hubert Tsai; Qibin Zhao; Ruslan Salakhutdinov; Louis-Philippe Morency (ACL (1), 2019)

Multimodal Transformer for Unaligned Multimodal Language Sequences. - Yao-Hung Hubert Tsai; Shaojie Bai; Paul Pu Liang; J. Zico Kolter; Louis-Philippe Morency; Ruslan Salakhutdinov (ACL (1), 2019)

Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence. - Amir Zadeh 001; Michael Chan; Paul Pu Liang; Edmund Tong; Louis-Philippe Morency (CVPR, 2019)

Learning Factorized Multimodal Representations. - Yao-Hung Hubert Tsai; Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency; Ruslan Salakhutdinov (ICLR (Poster), 2019)

Strong and Simple Baselines for Multimodal Utterance Embeddings. - Paul Pu Liang; Yao Chong Lim; Yao-Hung Hubert Tsai; Ruslan Salakhutdinov; Louis-Philippe Morency (NAACL-HLT (1), 2019)

Deep Gamblers: Learning to Abstain with Portfolio Theory. - Liu Ziyin 001; Zhikang Wang; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency; Masahito Ueda (NeurIPS, 2019)

Variational Auto-Decoder. - Amir Zadeh 001; Yao Chong Lim; Paul Pu Liang; Louis-Philippe Morency (CoRR, 2019)

Factorized Multimodal Transformer for Multimodal Sequential Learning. - Amir Zadeh 001; Chengfeng Mao; Kelly Shi; Yiwei Zhang; Paul Pu Liang; Soujanya Poria; Louis-Philippe Morency (CoRR, 2019)

Towards Debiasing Sentence Representations. - Paul Pu Liang; Irene Mengze Li; Emily Zheng; Yao Chong Lim; Ruslan Salakhutdinov; Louis-Philippe Morency (ACL, 2020)

On Emergent Communication in Competitive Multi-Agent Teams. - Paul Pu Liang; Jeffrey Chen; Ruslan Salakhutdinov; Louis-Philippe Morency; Satwik Kottur (AAMAS, 2020)

Diverse and Admissible Trajectory Forecasting Through Multimodal Context Understanding. - Seong Hyeon Park; Gyubok Lee; Jimin Seo; Manoj Bhat; Minseok Kang; Jonathan Francis; Ashwin R. Jadhav; Paul Pu Liang; Louis-Philippe Morency (ECCV (11), 2020)

CMU-MOSEAS: A Multimodal Language Dataset for Spanish, Portuguese, German and French. - AmirAli Bagher Zadeh; Yansheng Cao; Smon Hessner; Paul Pu Liang; Soujanya Poria; Louis-Philippe Morency (EMNLP (1), 2020)

Think Locally, Act Globally: Federated Learning with Local and Global Representations. - Paul Pu Liang; Terrance Liu; Liu Ziyin 001; Ruslan Salakhutdinov; Louis-Philippe Morency (CoRR, 2020)

Learning Not to Learn in the Presence of Noisy Labels. - Liu Ziyin 001; Blair Chen; Ru Wang; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency; Masahito Ueda (CoRR, 2020)

Anchor & Transform: Learning Sparse Representations of Discrete Objects. - Paul Pu Liang; Manzil Zaheer; Yuan Wang; Amr Ahmed 001 (CoRR, 2020)

An Investigation of how Label Smoothing Affects Generalization. - Blair Chen; Liu Ziyin 001; Zihao Wang 001; Paul Pu Liang (CoRR, 2020)

Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study. - Terrance Liu; Paul Pu Liang; Michal Muszynski; Ryo Ishii; David Brent; Randy Auerbach; Nicholas B. Allen; Louis-Philippe Morency (CoRR, 2020)

Foundations of Multimodal Co-learning. - Amir Zadeh 001; Paul Pu Liang; Louis-Philippe Morency (Inf. Fusion, 2020)

Deep Neural Network for Robust Modulation Classification Under Uncertain Noise Conditions. - Shisheng Hu; Yiyang Pei; Paul Pu Liang; Ying-Chang Liang (IEEE Trans. Veh. Technol., 2020)

Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data. - Paul Pu Liang; Terrance Liu; Anna Cai; Michal Muszynski; Ryo Ishii; Nicholas B. Allen; Randy Auerbach; David Brent; Ruslan Salakhutdinov; Louis-Philippe Morency (ACL/IJCNLP (1), 2021)

Understanding the Tradeoffs in Client-side Privacy for Downstream Speech Tasks. - Peter Wu; Paul Pu Liang; Jiatong Shi; Ruslan Salakhutdinov; Shinji Watanabe 001; Louis-Philippe Morency (APSIPA ASC, 2021)

Anchor & Transform: Learning Sparse Embeddings for Large Vocabularies. - Paul Pu Liang; Manzil Zaheer; Yuan Wang; Amr Ahmed 001 (ICLR, 2021)

Towards Understanding and Mitigating Social Biases in Language Models. - Paul Pu Liang; Chiyu Wu; Louis-Philippe Morency; Ruslan Salakhutdinov (ICML, 2021)

Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment. - Paul Pu Liang; Peter Wu; Liu Ziyin 001; Louis-Philippe Morency; Ruslan Salakhutdinov (ACM Multimedia, 2021)

StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer. - Yiwei Lyu; Paul Pu Liang; Hai Pham; Eduard H. Hovy; Barnabás Póczos; Ruslan Salakhutdinov; Louis-Philippe Morency (NAACL-HLT, 2021)

MultiBench: Multiscale Benchmarks for Multimodal Representation Learning. - Paul Pu Liang; Yiwei Lyu; Xiang Fan; Zetian Wu; Yun Cheng; Jason Wu 001; Leslie Chen; Peter Wu; Michelle A. Lee; Yuke Zhu; Ruslan Salakhutdinov; Louis-Philippe Morency (NeurIPS Datasets and Benchmarks, 2021)

Understanding the Tradeoffs in Client-Side Privacy for Speech Recognition. - Peter Wu; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency (CoRR, 2021)

Ask & Explore: Grounded Question Answering for Curiosity-Driven Exploration. - Jivat Neet Kaur; Yiding Jiang; Paul Pu Liang (CoRR, 2021)

DIME: Fine-grained Interpretations of Multimodal Models via Disentangled Local Explanations. - Yiwei Lyu; Paul Pu Liang; Zihao Deng; Ruslan Salakhutdinov; Louis-Philippe Morency (AIES, 2022)

Rethinking Architecture Design for Tackling Data Heterogeneity in Federated Learning. - Liangqiong Qu; Yuyin Zhou; Paul Pu Liang; Yingda Xia; Feifei Wang; Ehsan Adeli 001; Li Fei-Fei 001; Daniel L. Rubin (CVPR, 2022)

PACS: A Dataset for Physical Audiovisual CommonSense Reasoning. - Samuel Yu; Peter Wu; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency (ECCV (37), 2022)

Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis. - Yuxin Xiao; Paul Pu Liang; Umang Bhatt; Willie Neiswanger; Ruslan Salakhutdinov; Louis-Philippe Morency (EMNLP (Findings), 2022)

HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning. - Paul Pu Liang; Yiwei Lyu; Xiang Fan; Shentong Mo; Dani Yogatama; Louis-Philippe Morency; Ruslan Salakhutdinov (CoRR, 2022)

Brainish: Formalizing A Multimodal Language for Intelligence and Consciousness. - Paul Pu Liang (CoRR, 2022)

GEMv2: Multilingual NLG Benchmarking in a Single Line of Code. - Sebastian Gehrmann; Abhik Bhattacharjee; Abinaya Mahendiran; Alex Wang; Alexandros Papangelis; Aman Madaan; Angelina McMillan-Major; Anna Shvets; Ashish Upadhyay; Bingsheng Yao; Bryan Wilie; Chandra Bhagavatula; et al. (CoRR, 2022)

MultiViz: An Analysis Benchmark for Visualizing and Understanding Multimodal Models. - Paul Pu Liang; Yiwei Lyu; Gunjan Chhablani; Nihal Jain; Zihao Deng; Xingbo Wang 001; Louis-Philippe Morency; Ruslan Salakhutdinov (CoRR, 2022)

Face-to-Face Contrastive Learning for Social Intelligence Question-Answering. - Alex Wilf; Qianli M. Ma; Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (CoRR, 2022)

Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides. - Dong Won Lee 007; Chaitanya Ahuja; Paul Pu Liang; Sanika Natu; Louis-Philippe Morency (CoRR, 2022)

Foundations and Recent Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions. - Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (CoRR, 2022)

Demystify the Gravity Well in the Optimization Landscape (Student Abstract). - Jason Xiaotian Dou; Runxue Bao; Susan Song; Shuran Yang; Yanfu Zhang; Paul Pu Liang; Haiyi Harry Mao (AAAI, 2023)

Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control. - Xiang Fan; Yiwei Lyu; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency (ACL (Findings), 2023)

Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment. - Rohan Pandey; Rulin Shao; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency (ACL (1), 2023)

Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventions. - Himanshu Thakur; Atishay Jain; Praneetha Vaddamanu; Paul Pu Liang; Louis-Philippe Morency (ACL (2), 2023)

MultiViz: Towards User-Centric Visualizations and Interpretations of Multimodal Models. - Paul Pu Liang; Yiwei Lyu; Gunjan Chhablani; Nihal Jain; Zihao Deng; Xingbo Wang 001; Louis-Philippe Morency; Ruslan Salakhutdinov (CHI Extended Abstracts, 2023)

Difference-Masking: Choosing What to Mask in Continued Pretraining. - Alex Wilf; Syeda Nahida Akter; Leena Mathur; Paul Pu Liang; Sheryl Mathew; Mengrou Shou; Eric Nyberg; Louis-Philippe Morency (EMNLP (Findings), 2023)

Face-to-Face Contrastive Learning for Social Intelligence Question-Answering. - Alex Wilf; Martin Q. Ma; Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (FG, 2023)

Lecture Presentations Multimodal Dataset: Towards Understanding Multimodality in Educational Videos. - Dong Won Lee 007; Chaitanya Ahuja; Paul Pu Liang; Sanika Natu; Louis-Philippe Morency (ICCV, 2023)

Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP. - Vedant Palit; Rohan Pandey; Aryaman Arora; Paul Pu Liang (ICCV (Workshops), 2023)

MultiViz: Towards Visualizing and Understanding Multimodal Models. - Paul Pu Liang; Yiwei Lyu; Gunjan Chhablani; Nihal Jain; Zihao Deng; Xingbo Wang 001; Louis-Philippe Morency; Ruslan Salakhutdinov (ICLR, 2023)

HIINT: Historical, Intra- and Inter- personal Dynamics Modeling with Cross-person Memory Transformer. - Yubin Kim 002; Dong Won Lee 007; Paul Pu Liang; Sharifa Alghowinem; Cynthia Breazeal; Hae Won Park 001 (ICMI, 2023)

Multimodal Fusion Interactions: A Study of Human and Automatic Quantification. - Paul Pu Liang; Yun Cheng; Ruslan Salakhutdinov; Louis-Philippe Morency (ICMI, 2023)

Tutorial on Multimodal Machine Learning: Principles, Challenges, and Open Questions. - Paul Pu Liang; Louis-Philippe Morency (ICMI Companion, 2023)

Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework. - Paul Pu Liang; Yun Cheng; Xiang Fan; Chun Kai Ling; Suzanne Nie; Richard J. Chen; Zihao Deng; Nicholas B. Allen; Randy Auerbach; Faisal Mahmood 001; Russ Salakhutdinov; Louis-Philippe Morency (NeurIPS, 2023)

Factorized Contrastive Learning: Going Beyond Multi-view Redundancy. - Paul Pu Liang; Zihao Deng; Martin Q. Ma; James Y. Zou; Louis-Philippe Morency; Ruslan Salakhutdinov (NeurIPS, 2023)

Localized Symbolic Knowledge Distillation for Visual Commonsense Models. - Jae Sung Park; Jack Hessel; Khyathi Raghavi Chandu; Paul Pu Liang; Ximing Lu; Peter West; Youngjae Yu; Qiuyuan Huang; Jianfeng Gao 001; Ali Farhadi; Yejin Choi 001 (NeurIPS, 2023)

Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals. - Yue Wu 001; Yewen Fan; Paul Pu Liang; Amos Azaria; Yuanzhi Li; Tom M. Mitchell (NeurIPS, 2023)

Quantifying & Modeling Feature Interactions: An Information Decomposition Framework. - Paul Pu Liang; Yun Cheng; Xiang Fan; Chun Kai Ling; Suzanne Nie; Richard J. Chen; Zihao Deng; Faisal Mahmood 001; Ruslan Salakhutdinov; Louis-Philippe Morency (CoRR, 2023)

MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning. - Paul Pu Liang; Yiwei Lyu; Xiang Fan; Arav Agarwal; Yun Cheng; Louis-Philippe Morency; Ruslan Salakhutdinov (CoRR, 2023)

Comparative Knowledge Distillation. - Alex Wilf; Alex Tianyi Xu; Paul Pu Liang; Alexander Obolenskiy; Daniel Fried; Louis-Philippe Morency (CoRR, 2023)

MultiIoT: Towards Large-scale Multisensory Learning for the Internet of Things. - Shentong Mo; Paul Pu Liang; Russ Salakhutdinov; Louis-Philippe Morency (CoRR, 2023)

MMOE: Mixture of Multimodal Interaction Experts. - Haofei Yu; Paul Pu Liang; Ruslan Salakhutdinov; Louis-Philippe Morency (CoRR, 2023)

MultiZoo and MultiBench: A Standardized Toolkit for Multimodal Deep Learning. - Paul Pu Liang; Yiwei Lyu; Xiang Fan; Arav Agarwal; Yun Cheng; Louis-Philippe Morency; Ruslan Salakhutdinov (J. Mach. Learn. Res., 2023)

High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-Modality Representation Learning. - Paul Pu Liang; Yiwei Lyu; Xiang Fan; Jeffrey Tsaw; Yudong Liu; Shentong Mo; Dani Yogatama; Louis-Philippe Morency; Russ Salakhutdinov (Trans. Mach. Learn. Res., 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities. - Alex Wilf; Sihyun Shawn Lee; Paul Pu Liang; Louis-Philippe Morency (ACL (1), 2024)

Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction. - Guillaume Jaume; Anurag Vaidya; Richard J. Chen; Drew F. K. Williamson; Paul Pu Liang; Faisal Mahmood 001 (CVPR, 2024)

FLHetBench: Benchmarking Device and State Heterogeneity in Federated Learning. - Junyuan Zhang; Shuang Zeng; Miao Zhang; Runxi Wang; Feifei Wang; Yuyin Zhou; Paul Pu Liang; Liangqiong Qu (CVPR, 2024)

Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions. - Leena Mathur; Paul Pu Liang; Louis-Philippe Morency (EMNLP, 2024)

MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts. - Haofei Yu; Zhengyang Qi; Lawrence Jang; Russ Salakhutdinov; Louis-Philippe Morency; Paul Pu Liang (EMNLP, 2024)

Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications. - Paul Pu Liang; Chun Kai Ling; Yun Cheng; Alexander Obolenskiy; Yudong Liu; Rohan Pandey; Alex Wilf; Louis-Philippe Morency; Russ Salakhutdinov (ICLR, 2024)

HEMM: Holistic Evaluation of Multimodal Foundation Models. - Paul Pu Liang; Akshay Goindani; Talha Chafekar; Leena Mathur; Haofei Yu; Ruslan Salakhutdinov; Louis-Philippe Morency (NeurIPS, 2024)

Semantically Corrected Amharic Automatic Speech Recognition. - Samuael Adnew; Paul Pu Liang (CoRR, 2024)

Foundations of Multisensory Artificial Intelligence. - Paul Pu Liang (CoRR, 2024)

IoT-LM: Large Multisensory Language Models for the Internet of Things. - Shentong Mo; Russ Salakhutdinov; Louis-Philippe Morency; Paul Pu Liang (CoRR, 2024)

MultiMed: Massively Multimodal and Multitask Medical Understanding. - Shentong Mo; Paul Pu Liang (CoRR, 2024)

Quantitative Insights into Language Model Usage and Trust in Academia: An Empirical Study. - Minseok Jung; Aurora Zhang; Junho Lee; Paul Pu Liang (CoRR, 2024)

Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks. - Pranav Guruprasad; Harshvardhan Sikka; Jaewoo Song; Yangyue Wang; Paul Pu Liang (CoRR, 2024)

WiReSens Toolkit: An Open-source Platform towards Accessible Wireless Tactile Sensing. - Devin Murphy; Junyi Zhu 001; Paul Pu Liang; Wojciech Matusik; Yiyue Luo (CoRR, 2024)

Foundations of Multisensory Artificial Intelligence - Paul Pu Liang (2024)

Foundations & Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions. - Paul Pu Liang; Amir Zadeh 001; Louis-Philippe Morency (ACM Comput. Surv., 2024)

VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cues. - Jianshu Zhang 003; Dongyu Yao; Renjie Pi; Paul Pu Liang; Yi R. Fung 001 (ACL (1), 2025)

TAMP: Token-Adaptive Layerwise Pruning in Multimodal Large Language Models. - Jaewoo Lee; Keyang Xuan; Chanakya Ekbote; Sandeep Polisetty; Yi R. Fung 001; Paul Pu Liang (ACL (Findings), 2025)

Interactive Sketchpad: A Multimodal Tutoring System for Collaborative, Visual Problem-Solving. - Jimin Lee; Steven-Shine Chen; Paul Pu Liang (CHI Extended Abstracts, 2025)

Multimodal AI for Human Sensing and Interaction. - Paul Pu Liang; Karan Ahuja; Yiyue Luo (CHI Extended Abstracts, 2025)

Fits like a Flex-Glove: Automatic Design of Personalized FPCB-Based Tactile Sensing Gloves. - Devin Murphy; Yichen Li 004; Crystal Elaine Owens; Layla Stanton; Paul Pu Liang; Yiyue Luo; Antonio Torralba 001; Wojciech Matusik (CHI Extended Abstracts, 2025)

OS-ATLAS: Foundation Action Model for Generalist GUI Agents. - Zhiyong Wu 003; Zhenyu Wu; Fangzhi Xu; Yian Wang 003; Qiushi Sun; Chengyou Jia; Kanzhi Cheng; Zichen Ding 002; Liheng Chen; Paul Pu Liang; Yu Qiao 001 (ICLR, 2025)

Progressive Compositionality in Text-to-Image Generative Models. - Xu Han; Linghao Jin; Xiaofeng Liu; Paul Pu Liang (ICLR, 2025)

VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks. - Lawrence Keunho Jang; Yinheng Li; Dan Zhao; Charles Ding; Justin Lin; Paul Pu Liang; Rogerio Bonatti; Kazuhito Koishida (ICLR, 2025)

TeaserGen: Generating Teasers for Long Documentaries. - Weihan Xu; Paul Pu Liang; Haven Kim; Julian J. McAuley; Taylor Berg-Kirkpatrick; Hao-Wen Dong (ICLR, 2025)

CalPal: An Intelligent Multimodal Digital Wall Calendar (short paper). - Devin Murphy; Jenny Moralejo; Paul Pu Liang (IUI Workshops, 2025)

Comparative Knowledge Distillation. - Alex Tianyi Xu; Alex Wilf; Paul Pu Liang; Alexander Obolenskiv; Daniel Fried; Louis-Philippe Morency (WACV, 2025)

Foundation Models for CPS-IoT: Opportunities and Challenges. - Ozan Baris; Yizhuo Chen; Gaofeng Dong; Liying Han; Tomoyoshi Kimura; Pengrui Quan; Ruijie Wang 004; Tianchen Wang; Tarek F. Abdelzaher; Mario Bergés; Paul Pu Liang; Mani Srivastava 001 (CoRR, 2025)

Group-Adaptive Threshold Optimization for Robust AI-Generated Text Detection. - Minseok Jung; Cynthia Fuertes Panizo; Liam Dugan; Yi R. Fung 001; Pin-Yu Chen; Paul Pu Liang (CoRR, 2025)

VLM2-Bench: A Closer Look at How Well VLMs Implicitly Link Explicit Matching Visual Cues. - Jianshu Zhang 003; Dongyu Yao; Renjie Pi; Paul Pu Liang; Yi R. Fung 001 (CoRR, 2025)

The Multi-Faceted Monosemanticity in Multimodal Representations. - Hanqi Yan; Xiangxiang Cui; Lu Yin; Paul Pu Liang; Yulan He 001; Yifei Wang (CoRR, 2025)

Social Genome: Grounded Social Reasoning Abilities of Multimodal Models. - Leena Mathur; Marian Qian; Paul Pu Liang; Louis-Philippe Morency (CoRR, 2025)

Understanding the Emergence of Multimodal Representation Alignment. - Megan Tjandrasuwita; Chanakya Ekbote; Liu Ziyin 001; Paul Pu Liang (CoRR, 2025)

MimeQA: Towards Socially-Intelligent Nonverbal Foundation Models. - Hengzhi Li; Megan Tjandrasuwita; Yi R. Fung 001; Armando Solar-Lezama; Paul Pu Liang (CoRR, 2025)

Language Models' Factuality Depends on the Language of Inquiry. - Tushar Aggarwal; Kumar Tanmay; Ayush Agrawal; Kumar Ayush; Hamid Palangi; Paul Pu Liang (CoRR, 2025)

Fits like a Flex-Glove: Automatic Design of Personalized FPCB-Based Tactile Sensing Gloves. - Devin Murphy; Yichen Li 004; Crystal Elaine Owens; Layla Stanton; Young Joong Lee; Paul Pu Liang; Yiyue Luo; Antonio Torralba 001; Wojciech Matusik (CoRR, 2025)

CLIMB: Data Foundations for Large Scale Multimodal Clinical Foundation Models. - Wei Dai 013; Peilin Chen; Malinda Lu; Daniel Li; Haowen Wei; Hejie Cui; Paul Pu Liang (CoRR, 2025)

Can A Society of Generative Agents Simulate Human Behavior and Inform Public Health Policy? A Case Study on Vaccine Hesitancy. - Abe Bohan Hou; Hongru Du; Yichen Wang; Jingyu Zhang; Zixiao Wang; Paul Pu Liang; Daniel Khashabi; Lauren Gardner; Tianxing He (CoRR, 2025)

Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization. - Shujin Wu; Cheng Qian 008; Yi R. Fung 001; Paul Pu Liang; Heng Ji 001 (CoRR, 2025)

POET: Supporting Prompting Creativity and Personalization with Automated Expansion of Text-to-Image Generation. - Evans Xu Han; Alice Qian Zhang; Hong Shen 004; Haiyi Zhu; Paul Pu Liang; Jane Hsieh (CoRR, 2025)

RAVENEA: A Benchmark for Multimodal Retrieval-Augmented Visual Culture Understanding. - Jiaang Li 002; Yifei Yuan 002; Wenyan Li 001; Mohammad Aliannejadi; Daniel Hershcovich; Anders Søgaard; Ivan Vulic; Wenxuan Zhang 001; Paul Pu Liang; Yang Deng 002; Serge J. Belongie (CoRR, 2025)

REGen: Multimodal Retrieval-Embedded Generation for Long-to-Short Video Editing. - Weihan Xu; Yimeng Ma; Jingyue Huang; Yang Li; Wenye Ma; Taylor Berg-Kirkpatrick; Julian J. McAuley; Paul Pu Liang; Hao-Wen Dong (CoRR, 2025)

Deriving Strategic Market Insights with Large Language Models: A Benchmark for Forward Counterfactual Generation. - Keane Ong; Rui Mao 010; Deeksha Varshney; Paul Pu Liang; Erik Cambria; Gianmarco Mengaldo (CoRR, 2025)

SMELLNET: A Large-scale Dataset for Real-world Smell Recognition. - Dewei Feng; Carol Li; Wei Dai; Paul Pu Liang (CoRR, 2025)

QoQ-Med: Building Multimodal Clinical Foundation Models with Domain-Aware GRPO Training. - Wei Dai; Peilin Chen; Chanakya Ekbote; Paul Pu Liang (CoRR, 2025)

MINT: Multimodal Instruction Tuning with Multimodal Interaction Grouping. - Xiaojun Shan; Qi Cao; Xing Han; Haofei Yu; Paul Pu Liang (CoRR, 2025)

OpenFace 3.0: A Lightweight Multitask System for Comprehensive Facial Behavior Analysis. - Jiewen Hu; Leena Mathur; Paul Pu Liang; Louis-Philippe Morency (CoRR, 2025)

PuzzleWorld: A Benchmark for Multimodal, Open-Ended Reasoning in Puzzlehunts. - Hengzhi Li; Brendon Jiang; Alexander Naehu; Regan Song; Justin Zhang 010; Megan Tjandrasuwita; Chanakya Ekbote; Steven-Shine Chen; Adithya Balachandran; Wei Dai; Rebecca Chang; Paul Pu Liang (CoRR, 2025)

MEM1: Learning to Synergize Memory and Reasoning for Efficient Long-Horizon Agents. - Zijian Zhou; Ao Qu; Zhaoxuan Wu; Sunghwan Kim; Alok Prakash; Daniela Rus; Jinhua Zhao; Bryan Kian Hsiang Low; Paul Pu Liang (CoRR, 2025)

Decide less, communicate more: On the construct validity of end-to-end fact-checking in medicine. - Sebastian Joseph; Lily Chen; Barry Wei; Michael Mackert; Iain James Marshall; Paul Pu Liang; Ramez Kouzy; Byron C. Wallace; Junyi Jessy Li (CoRR, 2025)

Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning. - Jaedong Hwang; Kumar Tanmay; Seok-Jin Lee; Ayush Agrawal; Hamid Palangi; Kumar Ayush; Ila Fiete; Paul Pu Liang (CoRR, 2025)

Sotopia-RL: Reward Design for Social Intelligence. - Haofei Yu; Zhengyang Qi; Yining Zhao; Kolby Nottingham; Keyang Xuan; Bodhisattwa Prasad Majumder; Hao Zhu 011; Paul Pu Liang; Jiaxuan You (CoRR, 2025)

What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov Chains. - Chanakya Ekbote; Marco Bondaschi; Nived Rajaraman; Jason D. Lee; Michael Gastpar; Ashok Vardhan Makkuva; Paul Pu Liang (CoRR, 2025)