Daniel McDuff

Affiliations:
  • Microsoft Research, Redmond, WA, USA
  • Massachusetts Institute of Technology (MIT), Media Lab, Cambridge, MA, USA


According to our database1, Daniel McDuff authored at least 167 papers between 2010 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
On the Standardization of Behavioral Use Clauses and Their Adoption for Responsible Licensing of AI.
CoRR, 2024

Health-LLM: Large Language Models for Health Prediction via Wearable Sensor Data.
CoRR, 2024

2023
Editorial: Special Issue on Unobtrusive Physiological Measurement Methods for Affective Applications.
IEEE Trans. Affect. Comput., 2023

Camera Measurement of Physiological Vital Signs.
ACM Comput. Surv., 2023

Towards Accurate Differential Diagnosis with Large Language Models.
CoRR, 2023

From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models.
CoRR, 2023

Video-based sympathetic arousal assessment via peripheral blood flow estimation.
CoRR, 2023

Training Robust Deep Physiological Measurement Models with Synthetic Video-based Data.
CoRR, 2023

The Capability of Large Language Models to Measure Psychiatric Functioning.
CoRR, 2023

Research Protocol for the Google Health Digital Well-being Study.
CoRR, 2023

Large Language Models are Few-Shot Health Learners.
CoRR, 2023

"Can't Take the Pressure?": Examining the Challenges of Blood Pressure Estimation via Pulse Wave Analysis.
CoRR, 2023

A Review of Deep Learning for Video Captioning.
CoRR, 2023

Synthetic Data in Healthcare.
CoRR, 2023

Motion Matters: Neural Motion Transfer for Better Camera Physiological Sensing.
CoRR, 2023

BigSmall: Efficient Multi-Task Learning for Disparate Spatial and Temporal Physiological Measurements.
CoRR, 2023

MMPD: Multi-Domain Mobile Video Physiology Dataset.
CoRR, 2023

EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Cardiac Measurement.
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

rPPG-Toolbox: Deep Remote PPG Toolbox.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

SimPer: Simple Self-Supervised Learning of Periodic Targets.
Proceedings of the Eleventh International Conference on Learning Representations, 2023

MMPD: Multi-Domain Mobile Video Physiology Dataset.
Proceedings of the 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2023

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models.
Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Do You Even Need Sensors?: Synthetic Biomusic as an Empathic Technology.
Proceedings of the 11th International Conference on Affective Computing and Intelligent Interaction, 2023

2022
Spectral Synthesis for Geostationary Satellite-to-Satellite Translation.
IEEE Trans. Geosci. Remote. Sens., 2022

Using High-Fidelity Avatars to Advance Camera-Based Cardiac Pulse Measurement.
IEEE Trans. Biomed. Eng., 2022

MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing.
Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2022

No Pairs Left Behind: Improving Metric Learning with Regularized Triplet Objective.
CoRR, 2022

Deep Physiological Sensing Toolbox.
CoRR, 2022

Seeing beneath the skin with computational photography.
Commun. ACM, 2022

SCAMPS: Synthetics for Camera Measurement of Physiological Signals.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems.
Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022

Behavioral Use Licensing for Responsible AI.
Proceedings of the FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21, 2022

Federated Remote Physiological Measurement with Imperfect Data.
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2022

CausalCity: Complex Simulations with Agency for Causal Discovery and Reasoning.
Proceedings of the 1st Conference on Causal Learning and Reasoning, 2022

"I Didn't Know I Looked Angry": Characterizing Observed Emotion and Reported Affect at Work.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Design of Digital Workplace Stress-Reduction Intervention Systems: Effects of Intervention Type and Timing.
Proceedings of the CHI '22: CHI Conference on Human Factors in Computing Systems, New Orleans, LA, USA, 29 April 2022, 2022

Advancing the Understanding and Measurement of Workplace Stress in Remote Information Workers from Passive Sensors and Behavioral Data.
Proceedings of the 10th International Conference on Affective Computing and Intelligent Interaction, 2022

DeepFN: Towards Generalizable Facial Action Unit Recognition with Deep Face Normalization.
Proceedings of the 10th International Conference on Affective Computing and Intelligent Interaction, 2022

DOC2PPT: Automatic Presentation Slides Generation from Scientific Documents.
Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021
Theories of Conversation for Conversational IR.
ACM Trans. Inf. Syst., 2021

DeepMag: Source-Specific Change Magnification Using Gradient Ascent.
ACM Trans. Graph., 2021

Guest Editorial: Camera-Based Monitoring for Pervasive Healthcare Informatics.
IEEE J. Biomed. Health Informatics, 2021

Longitudinal Observational Evidence of the Impact of Emotion Regulation Strategies on Affective Expression.
IEEE Trans. Affect. Comput., 2021

Faded Smiles? A Largescale Observational Study of Smiling from Adolescence to Old Age.
IEEE Trans. Affect. Comput., 2021

Report on the future conversations workshop at CHIIR 2021.
SIGIR Forum, 2021

Camera-Based Physiological Sensing: Challenges and Future Directions.
CoRR, 2021

EfficientPhys: Enabling Simple, Fast and Accurate Camera-Based Vitals Measurement.
CoRR, 2021

Learning Higher-Order Dynamics in Video-Based Cardiac Measurement.
CoRR, 2021

Contrastive Learning of Global and Local Audio-Visual Representations.
CoRR, 2021

"Warm Bodies": A Post-Processing Technique for Animating Dynamic Blood Flow on Photos and Avatars.
CoRR, 2021

Do Affective Cues Validate Behavioural Metrics for Search?
Proceedings of the SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2021

Contrastive Learning of Global and Local Video Representations.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Modeling Affect-based Intrinsic Rewards for Exploration and Learning.
Proceedings of the IEEE International Conference on Robotics and Automation, 2021

Active Contrastive Learning of Audio-Visual Video Representations.
Proceedings of the 9th International Conference on Learning Representations, 2021

Beat-to-Beat Cardiac Pulse Rate Measurement From Video.
Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, 2021

The Benefit of Distraction: Denoising Camera-Based Physiological Measurements using Inverse Attention.
Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision, 2021

NICE: Neural Image Commenting with Empathy.
Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing.
Proceedings of the 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, 2021

Combining Magnification and Measurement for Non-Contact Cardiac Monitoring.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2021

MetaPhys: few-shot adaptation for non-contact physiological measurement.
Proceedings of the ACM CHIL '21: ACM Conference on Health, 2021

MeetingCoach: An Intelligent Dashboard for Supporting Effective & Inclusive Meetings.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

AffectiveSpotlight: Facilitating the Communication of Affective Responses from Audience Members during Online Presentations.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

Understanding Conversational and Expressive Style in a Multimodal Embodied Conversational Agent.
Proceedings of the CHI '21: CHI Conference on Human Factors in Computing Systems, 2021

Exploring the Effects of Virtual Agents' Smiles on Human-Agent Interaction: A Mixed-Methods Study.
Proceedings of the 9th International Conference on Affective Computing and Intelligent Interaction, 2021

Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications.
Proceedings of the 9th International Conference on Affective Computing and Intelligent Interaction, 2021

2020
Behavioral Use Licensing for Responsible AI.
CoRR, 2020

Advancing Non-Contact Vital Sign Measurement using Synthetic Avatars.
CoRR, 2020

The Benefit of Distraction: Denoising Remote Vitals Measurements using Inverse Attention.
CoRR, 2020

Spectral Synthesis for Satellite-to-Satellite Translation.
CoRR, 2020

MetaPhys: Unsupervised Few-Shot Adaptation for Non-Contact Physiological Measurement.
CoRR, 2020

Learning Audio-Visual Representations with Active Contrastive Coding.
CoRR, 2020

Expressions of Style in Information Seeking Conversation with an Agent.
Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, 2020

Multi-Task Temporal Shift Attention Networks for On-Device Contactless Vitals Measurement.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Conversational Error Analysis in Human-Agent Interaction.
Proceedings of the IVA '20: ACM International Conference on Intelligent Virtual Agents, 2020

Design and evaluation of intelligent agent prototypes for assistance with focus and productivity at work.
Proceedings of the IUI '20: 25th International Conference on Intelligent User Interfaces, 2020

Multi-Reference Neural TTS Stylization with Adversarial Cycle Consistency.
Proceedings of the Interspeech 2020, 2020

Spatio-Temporal Attention and Magnification for Classification of Parkinson's Disease from Videos Collected via the Internet.
Proceedings of the 15th IEEE International Conference on Automatic Face and Gesture Recognition, 2020

A Meta-Analysis of the Impact of Skin Type and Gender on Non-contact Photoplethysmography Measurements.
Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020

Optimizing for Happiness and Productivity: Modeling Opportune Moments for Transitions and Breaks at Work.
Proceedings of the CHI '20: CHI Conference on Human Factors in Computing Systems, 2020

Lessons Learned in Designing AI for Autistic Adults.
Proceedings of the ASSETS '20: The 22nd International ACM SIGACCESS Conference on Computers and Accessibility, 2020

2019
Wearable Motion-Based Heart Rate at Rest: A Workplace Evaluation.
IEEE J. Biomed. Health Informatics, 2019

AM-FED+: An Extended Dataset of Naturalistic Facial Expressions Collected in Everyday Settings.
IEEE Trans. Affect. Comput., 2019

Managing Stress: The Needs of Autistic Adults in Video Calling.
Proc. ACM Hum. Comput. Interact., 2019

Accessible Video Calling: Enabling Nonvisual Perception of Visual Conversation Cues.
Proc. ACM Hum. Comput. Interact., 2019

Circadian Rhythms and Physiological Synchrony: Evidence of the Impact of Diversity on Small Group Creativity.
Proc. ACM Hum. Comput. Interact., 2019

Do Facial Expressions Predict Ad Sharing? A Large-Scale Observational Study.
CoRR, 2019

Affect-based Intrinsic Rewards for Learning General Representations.
CoRR, 2019

A Scalable Approach for Facial Action Unit Classifier Training Using Noisy Data for Pre-Training.
CoRR, 2019

Designing Style Matching Conversational Agents.
CoRR, 2019

M3D-GAN: Multi-Modal Multi-Domain Translation with Universal Attention.
CoRR, 2019

A Multimodal Emotion Sensing Platform for Building Emotion-Aware Applications.
CoRR, 2019

Sensing Affective Response to Visual Narratives.
IEEE Comput. Intell. Mag., 2019

Characterizing Bias in Classifiers using Generative Models.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

An End-to-End Conversational Style Matching Agent.
Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents, 2019

A High-Fidelity Open Embodied Avatar with Lip Syncing and Expression Capabilities.
Proceedings of the International Conference on Multimodal Interaction, 2019

Visceral Machines: Risk-Aversion in Reinforcement Learning with Intrinsic Physiological Rewards.
Proceedings of the 7th International Conference on Learning Representations, 2019

Neural TTS Stylization with Adversarial and Collaborative Games.
Proceedings of the 7th International Conference on Learning Representations, 2019

Combating the Impact of Video Compression on Non-Contact Vital Sign Measurement Using Supervised Learning.
Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision Workshops, 2019

Unpaired Image-to-Speech Synthesis With Multimodal Information Bottleneck.
Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision, 2019

Building Emotionally Intelligent AI: From Sensing to Synthesis.
Proceedings of the 14th International Joint Conference on Computer Vision, 2019

iPhys: An Open Non-Contact Imaging-Based Physiological Measurement Toolbox.
Proceedings of the 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2019

Using Non-Contact Imaging Photoplethysmography to Recover Diurnal Patterns in Heart Rate.
Proceedings of the 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2019

Democratizing Psychological Insights from Analysis of Nonverbal Behavior.
Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction, 2019

A Conversational Agent in Support of Productivity and Wellbeing at Work.
Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction, 2019

Towards Understanding Emotional Intelligence for Behavior Change Chatbots.
Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction, 2019

EMMA: An Emotion-Aware Wellbeing Chatbot.
Proceedings of the 8th International Conference on Affective Computing and Intelligent Interaction, 2019

2018
Fusing Partial Camera Signals for Noncontact Pulse Rate Variability Measurement.
IEEE Trans. Biomed. Eng., 2018

EMMA: An Emotionally Intelligent Personal Assistant for Improving Wellbeing.
CoRR, 2018

Identifying Bias in AI using Simulation.
CoRR, 2018

DeepMag: Source Specific Motion Magnification Using Gradient Ascent.
CoRR, 2018

Visceral Machines: Reinforcement Learning with Intrinsic Rewards that Mimic the Human Nervous System.
CoRR, 2018

Designing emotionally sentient agents.
Commun. ACM, 2018

Improvements in remote video based estimation of heart rate variability using the Welch FFT method.
Artif. Life Robotics, 2018

Facial Expression Grounded Conversational Dialogue Generation.
Proceedings of the 13th IEEE International Conference on Automatic Face & Gesture Recognition, 2018

InPhysible: Camouflage Against Video-Based Physiological Measurement.
Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2018

Spectral Estimation Methods for Evaluating iPPG Pulse Rate Variability.
Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2018

DeepPhys: Video-Based Physiological Measurement Using Convolutional Attention Networks.
Proceedings of the Computer Vision - ECCV 2018, 2018

Deep Super Resolution for Recovering Physiological Information From Videos.
Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018

Style and Alignment in Information-Seeking Conversation.
Proceedings of the 2018 Conference on Human Information Interaction and Retrieval, 2018

Emotional Dialogue Generation using Image-Grounded Language Models.
Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 2018

2017
Applications of Automated Facial Coding in Media Measurement.
IEEE Trans. Affect. Comput., 2017

Pulse and vital sign measurement in mixed reality using a HoloLens.
Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology, 2017

Cardiolens: remote physiological monitoring in a mixed reality environment.
Proceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference, 2017

Multimodal analysis of vocal collaborative search: a public corpus and results.
Proceedings of the 19th ACM International Conference on Multimodal Interaction, 2017

Large-scale Affective Content Analysis: Combining Media Content Features and Facial Reactions.
Proceedings of the 12th IEEE International Conference on Automatic Face & Gesture Recognition, 2017

The Impact of Video Compression on Remote Cardiac Pulse Measurement Using Imaging Photoplethysmography.
Proceedings of the 12th IEEE International Conference on Automatic Face & Gesture Recognition, 2017

Historical Heterogeneity Predicts Smiling: Evidence from Large-Scale Observational Analyses.
Proceedings of the 12th IEEE International Conference on Automatic Face & Gesture Recognition, 2017

Smiling from adolescence to old age: A large observational study.
Proceedings of the Seventh International Conference on Affective Computing and Intelligent Interaction, 2017

2016
Wearable ESM: differences in the experience sampling method across wearable devices.
Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services, 2016

Understanding and Predicting Bonding in Conversations Using Thin Slices of Facial Expressions and Body Language.
Proceedings of the Intelligent Virtual Agents - 16th International Conference, 2016

Driver Frustration Detection from Audio and Video in the Wild.
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Discovering facial expressions for states of amused, persuaded, informed, sentimental and inspired.
Proceedings of the 18th ACM International Conference on Multimodal Interaction, 2016

Real-Time Physiological Measurement and Visualization Using a Synchronized Multi-camera System.
Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016

AFFDEX SDK: A Cross-Platform Real-Time Multi-Face Expression Recognition Toolkit.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

COGCAM: Contact-free Measurement of Cognitive Stress During Computer Tasks with a Digital Camera.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

2015
Predicting Ad Liking and Purchase Intent: Large-Scale Analysis of Facial Responses to Ads.
IEEE Trans. Affect. Comput., 2015

Biowatch: Estimation of heart and breathing rates from wrist motions.
Proceedings of the 9th International Conference on Pervasive Computing Technologies for Healthcare, 2015

Facial Action Unit Detection Using Active Learning and an Efficient Non-linear Kernel Approximation.
Proceedings of the 2015 IEEE International Conference on Computer Vision Workshop, 2015

Event detection: Ultra large-scale clustering of facial expressions.
Proceedings of the 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, 2015

Exploiting sparsity and co-occurrence structure for action unit recognition.
Proceedings of the 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, 2015

A survey of remote optical photoplethysmographic imaging methods.
Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2015

Biophone: Physiology monitoring from peripheral smartphone motions.
Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2015

BioInsights: Extracting personal data from "Still" wearable motion sensors.
Proceedings of the 12th IEEE International Conference on Wearable and Implantable Body Sensor Networks, 2015

Crowdsourcing facial responses to online videos: Extended abstract.
Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction, 2015

Exploring temporal patterns in classifying frustrated and delighted smiles (Extended abstract).
Proceedings of the 2015 International Conference on Affective Computing and Intelligent Interaction, 2015

2014
Remote Detection of Photoplethysmographic Systolic and Diastolic Peaks Using a Digital Camera.
IEEE Trans. Biomed. Eng., 2014

Improvements in Remote Cardiopulmonary Measurement Using a Five Band Digital Camera.
IEEE Trans. Biomed. Eng., 2014

Automatic measurement of ad preferences from facial responses gathered over the Internet.
Image Vis. Comput., 2014

Remote measurement of cognitive stress via heart rate variability.
Proceedings of the 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2014

AutoEmotive: bringing empathy to the driving experience to manage stress.
Proceedings of the Companion Publication of the 2014 ACM SIGCHI Conference on Designing Interactive Systems Conference, 2014

2013
Inside-out: Reflecting on your inner state.
Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications Workshops, 2013

Predicting online media effectiveness based on smile responses gathered over the Internet.
Proceedings of the 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, 2013

From dials to facial coding: Automated detection of spontaneous facial expressions for media research.
Proceedings of the 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, 2013

Affectiva-MIT Facial Expression Dataset (AM-FED): Naturalistic and Spontaneous Facial Expressions Collected "In-the-Wild".
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2013

Measuring Voter's Candidate Preference Based on Affective Responses to Election Debates.
Proceedings of the 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, 2013

2012
Crowdsourcing Facial Responses to Online Videos.
IEEE Trans. Affect. Comput., 2012

Exploring Temporal Patterns in Classifying Frustrated and Delighted Smiles.
IEEE Trans. Affect. Comput., 2012

AffectAura: Emotional wellbeing reflection system.
Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare, 2012

Towards sensing the influence of visual narratives on human affect.
Proceedings of the International Conference on Multimodal Interaction, 2012

AffectAura: an intelligent system for emotional memory.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2012

2011
Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam.
IEEE Trans. Biomed. Eng., 2011

A medical mirror for non-contact health monitoring.
Proceedings of the International Conference on Computer Graphics and Interactive Techniques, 2011

Crowdsourced data collection of facial responses.
Proceedings of the 13th International Conference on Multimodal Interfaces, 2011

Acume: A new visualization tool for understanding facial expression and gesture data.
Proceedings of the Ninth IEEE International Conference on Automatic Face and Gesture Recognition (FG 2011), 2011

Real-time inference of mental states from facial expressions and upper body gestures.
Proceedings of the Ninth IEEE International Conference on Automatic Face and Gesture Recognition (FG 2011), 2011

Machine Learning for Affective Computing.
Proceedings of the Affective Computing and Intelligent Interaction, 2011

2010
Affect valence inference from facial action unit spectrograms.
Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2010


  Loading...