A Generalization Error for Q-Learning. - Susan A. Murphy (J. Mach. Learn. Res., 2005)

Variable Selection for Optimal Decision Making. - Lacey Gunter; Ji Zhu; Susan A. Murphy (AIME, 2007)

Small Sample Inference for Generalization Error in Classification Using the CUD Bound. - Eric B. Laber; Susan A. Murphy (UAI, 2008)

Inferring bounds on the performance of a control policy from a sample of trajectories. - Raphaël Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (ADPRL, 2009)

A Cautious Approach to Generalization in Reinforcement Learning. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (ICAART (1), 2010)

Towards Min Max Generalization in Reinforcement Learning. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (ICAART (Revised Selected Papers), 2010)

Efficient Reinforcement Learning with Multiple Reward Functions for Randomized Controlled Trial Analysis. - Daniel J. Lizotte; Michael H. Bowling; Susan A. Murphy (ICML, 2010)

Model-Free Monte Carlo-like Policy Evaluation. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (AISTATS, 2010)

Active learning for personalizing treatment. - Kun Deng; Joelle Pineau; Susan A. Murphy (ADPRL, 2011)

Active exploration by searching for experiments that falsify the computed control policy. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (ADPRL, 2011)

Active Learning for Developing Personalized Treatment. - Kun Deng; Joelle Pineau; Susan A. Murphy (UAI, 2011)

Informing sequential clinical decision-making through reinforcement learning: an empirical study. - Susan M. Shortreed; Eric B. Laber; Daniel J. Lizotte; T. Scott Stroup; Joelle Pineau; Susan A. Murphy (Mach. Learn., 2011)

Estimation Monte Carlo sans modèle de politiques de décision. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (Rev. d'Intelligence Artif., 2011)

Linear fitted-Q iteration with multiple reward functions. - Daniel J. Lizotte; Michael Bowling; Susan A. Murphy (J. Mach. Learn. Res., 2012)

A robust MPC approach to the design of behavioural treatments. - Korkut Bekiroglu; Constantino M. Lagoa; Susan A. Murphy; Stephanie T. Lanza (CDC, 2013)

Batch mode reinforcement learning based on the synthesis of artificial trajectories. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (Ann. Oper. Res., 2013)

Stratégies d'échantillonnage pour l'apprentissage par renforcement batch. - Raphael Fonteneau; Susan A. Murphy; Louis Wehenkel; Damien Ernst (Rev. d'Intelligence Artif., 2013)

Budgeted Learning for Developing Personalized Treatment. - Kun Deng; Russ Greiner; Susan A. Murphy (ICMLA, 2014)

Center of excellence for mobile sensor data-to-knowledge (MD2K). - Santosh Kumar 001; Gregory D. Abowd; William T. Abraham; Mustafa al'Absi; J. Gayle Beck; Duen Horng Chau; Tyson Condie; David E. Conroy; Emre Ertin; Deborah Estrin; Deepak Ganesan; Cho Lam; et al. (J. Am. Medical Informatics Assoc., 2015)

A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average Reward. - Susan A. Murphy; Yanzhen Deng; Eric B. Laber; Hamid Reza Maei; Richard S. Sutton; Katie Witkiewitz (CoRR, 2016)

Introduction to Part I: mHealth Applications and Tools. - Santosh Kumar 001; James M. Rehg; Susan A. Murphy (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

Introduction to Part II: Sensors to mHealth Markers. - Santosh Kumar 001; James M. Rehg; Susan A. Murphy (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

Introduction to Part IV: Predictors to mHealth Interventions. - Susan A. Murphy; James M. Rehg; Santosh Kumar 001 (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

Introduction to Part III: Markers to mHealth Predictors. - James M. Rehg; Susan A. Murphy; Santosh Kumar 001 (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

From Markers to Interventions: The Case of Just-in-Time Stress Intervention. - Hillol Sarker; Karen Hovsepian; Soujanya Chatterjee; Inbal Nahum-Shani; Susan A. Murphy; Bonnie Spring; Emre Ertin; Mustafa al'Absi; Motohiro Nakajima; Santosh Kumar 001 (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

Design Lessons from a Micro-Randomized Pilot Study in Mobile Health. - Shawna N. Smith; Andy Jinseok Lee; Kelly Hall; Nicholas J. Seewald; Audrey Boruvka; Susan A. Murphy; Predrag V. Klasnja (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

From Ads to Interventions: Contextual Bandits in Mobile Health. - Ambuj Tewari; Susan A. Murphy (Mobile Health - Sensors, Analytic Methods, and Applications, 2017)

SARA: a mobile app to engage users in health data collection. - Mashfiqui Rabbi; Meredith Philyaw-Kotov; Jinseok Lee; Anthony Mansour; Laura Dent; Xiaolei Wang; Rebecca M. Cunningham; Erin E. Bonar; Inbal Nahum-Shani; Predrag V. Klasnja; Maureen A. Walton; Susan A. Murphy (UbiComp/ISWC Adjunct, 2017)

ewrapper: operationalizing engagement strategies in mHealth. - Blake Wagner III; Elaine Liu; Steven D. Shaw; Gleb Iakovlev; Linlu Zhou; Christina N. Harrington; Gregory D. Abowd; Carolyn Yoon; Santosh Kumar 001; Susan A. Murphy; Bonnie Spring; Inbal Nahum-Shani (UbiComp/ISWC Adjunct, 2017)

iSurvive: An Interpretable, Event-time Prediction Model for mHealth. - Walter H. Dempsey; Alexander Moreno; Christy K. Scott; Michael L. Dennis; David H. Gustafson 001; Susan A. Murphy; James M. Rehg (ICML, 2017)

Action Centered Contextual Bandits. - Kristjan H. Greenewald; Ambuj Tewari; Susan A. Murphy; Predrag V. Klasnja (NIPS, 2017)

An Actor-Critic Contextual Bandit Algorithm for Personalized Mobile Health Interventions. - Huitian Lei; Ambuj Tewari; Susan A. Murphy (CoRR, 2017)

Addressing the Computational Challenges of Personalized Medicine (Dagstuhl Seminar 17472). - Niko Beerenwinkel; Holger Fröhlich; Susan A. Murphy (Dagstuhl Reports, 2017)

Center of Excellence for Mobile Sensor Data-to-Knowledge (MD2K). - Santosh Kumar 001; Gregory D. Abowd; William T. Abraham; Mustafa al'Absi; Duen Horng Chau; Emre Ertin; Deborah Estrin; Deepak Ganesan; Timothy Hnat; Syed Monowar Hossain; Zachary G. Ives; Jacqueline Kerr; et al. (IEEE Pervasive Comput., 2017)

Control Engineering Methods for the Design of Robust Behavioral Treatments. - Korkut Bekiroglu; Constantino Lagoa; Susan A. Murphy; Stephanie T. Lanza (IEEE Trans. Control. Syst. Technol., 2017)

Personalizing Intervention Probabilities By Pooling. - Sabina Tomkins; Predrag V. Klasnja; Susan A. Murphy (CoRR, 2018)

Just-in-Time but Not Too Much: Determining Treatment Timing in Mobile Health. - Peng Liao; Walter Dempsey; Hillol Sarker; Syed Monowar Hossain; Mustafa al'Absi; Predrag V. Klasnja; Susan A. Murphy (Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2018)

A smartphone-based behavioural activation application using recommender system. - Tao Zhang; Geoff A. Jarrad; Susan A. Murphy; Niranjan Bidargaddi (UbiComp/ISWC Adjunct, 2019)

Off-Policy Estimation of Long-Term Average Outcomes with Applications to Mobile Health. - Peng Liao; Predrag V. Klasnja; Susan A. Murphy (CoRR, 2019)

ReVibe: A Context-assisted Evening Recall Approach to Improve Self-report Adherence. - Mashfiqui Rabbi; Katherine Li; H. Yanna Yan; Kelly Hall; Predrag V. Klasnja; Susan A. Murphy (Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2019)

Inference for Batched Bandits. - Kelly W. Zhang; Lucas Janson; Susan A. Murphy (NeurIPS, 2020)

Rapidly Personalizing Mobile Health Treatment Policies with Limited Data. - Sabina Tomkins; Peng Liao; Predrag V. Klasnja; Serena Yeung; Susan A. Murphy (CoRR, 2020)

Streamlined Empirical Bayes Fitting of Linear Mixed Models in Mobile Health. - Marianne Menictas; Sabina Tomkins; Susan A. Murphy (CoRR, 2020)

Translating Behavioral Theory into Technological Interventions: Case Study of an mHealth App to Increase Self-reporting of Substance-Use Related Data. - Mashfiqui Rabbi; Meredith Philyaw-Kotov; Jinseok Li; Katherine Li; Bess Rothman; Lexa Giragosian; Maya Reyes; Hannah Gadway; Rebecca M. Cunningham; Erin E. Bonar; Inbal Nahum-Shani; Maureen A. Walton; et al. (CoRR, 2020)

The Micro-Randomized Trial for Developing Digital Interventions: Experimental Design Considerations. - Ashley E. Walton; Linda M. Collins; Predrag V. Klasnja; Inbal Nahum-Shani; Mashfiqui Rabbi; Maureen A. Walton; Susan A. Murphy (CoRR, 2020)

Fast Physical Activity Suggestions: Efficient Hyperparameter Learning in Mobile Health. - Marianne Menictas; Sabina Tomkins; Susan A. Murphy (CoRR, 2020)

Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activity. - Peng Liao; Kristjan H. Greenewald; Predrag V. Klasnja; Susan A. Murphy (Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., 2020)

Power Constrained Bandits. - Jiayu Yao; Emma Brunskill; Weiwei Pan; Susan A. Murphy; Finale Doshi-Velez (MLHC, 2021)

Statistical Inference with M-Estimators on Adaptively Collected Data. - Kelly W. Zhang; Lucas Janson; Susan A. Murphy (NeurIPS, 2021)

Statistical Inference with M-Estimators on Bandit Data. - Kelly W. Zhang; Lucas Janson; Susan A. Murphy (CoRR, 2021)

Online structural kernel selection for mobile health. - Eura Shin; Pedja Klasnja; Susan A. Murphy; Finale Doshi-Velez (CoRR, 2021)

Comparison and Unification of Three Regularization Methods in Batch Reinforcement Learning. - Sarah Rathnam; Susan A. Murphy; Finale Doshi-Velez (CoRR, 2021)

IntelligentPooling: practical Thompson sampling for mHealth. - Sabina Tomkins; Peng Liao; Predrag V. Klasnja; Susan A. Murphy (Mach. Learn., 2021)

Data-driven Interpretable Policy Construction for Personalized Mobile Health. - Dimitris Bertsimas; Predrag V. Klasnja; Susan A. Murphy; Liangyuan Na (ICDH, 2022)

Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-Implementation Guidelines. - Anna L. Trella; Kelly W. Zhang; Inbal Nahum-Shani; Vivek Shetty; Finale Doshi-Velez; Susan A. Murphy (Algorithms, 2022)

Counterfactual inference for sequential experimental design. - Raaz Dwivedi; Susan A. Murphy; Devavrat Shah (CoRR, 2022)

Statistical Inference After Adaptive Sampling in Non-Markovian Environments. - Kelly W. Zhang; Lucas Janson; Susan A. Murphy (CoRR, 2022)

Doubly robust nearest neighbors in factor models. - Raaz Dwivedi; Katherine Tian; Sabina Tomkins; Predrag V. Klasnja; Susan A. Murphy; Devavrat Shah (CoRR, 2022)

Modeling Mobile Health Users as Reinforcement Learning Agents. - Eura Shin; Siddharth Swaroop; Weiwei Pan; Susan A. Murphy; Finale Doshi-Velez (CoRR, 2022)

Reward Design for an Online Reinforcement Learning Algorithm Supporting Oral Self-Care. - Anna L. Trella; Kelly W. Zhang; Inbal Nahum-Shani; Vivek Shetty; Finale Doshi-Velez; Susan A. Murphy (AAAI, 2023)

The Unintended Consequences of Discount Regularization: Improving Regularization in Certainty Equivalence Reinforcement Learning. - Sarah Rathnam; Sonali Parbhoo; Weiwei Pan; Susan A. Murphy; Finale Doshi-Velez (ICML, 2023)

Assessing the Impact of Context Inference Error and Partial Observability on RL Methods for Just-In-Time Adaptive Interventions. - Karine Karine; Predrag V. Klasnja; Susan A. Murphy; Benjamin M. Marlin (UAI, 2023)

Online learning in bandits with predicted context. - Yongyi Guo; Susan A. Murphy (CoRR, 2023)

Dyadic Reinforcement Learning. - Shuangning Li; Lluis Salvat Niell; Sung Won Choi; Inbal Nahum-Shani; Guy Shani; Susan A. Murphy (CoRR, 2023)

Estimating causal effects with optimization-based methods: A review and empirical comparison. - Martin Cousineau; Vedat Verter; Susan A. Murphy; Joelle Pineau (Eur. J. Oper. Res., 2023)

A randomized trial of a mobile health intervention to augment cardiac rehabilitation. - Jessica R. Golbus; Kashvi Gupta; Rachel Stevens; V. Swetha Jeganathan; Evan Luff; Jieru Shi; Walter Dempsey; Thomas Boyden; Bhramar Mukherjee; Sarah Kohnstamm; Vlad Taralunga; Vik Kheterpal; et al. (npj Digit. Medicine, 2023)

Online model selection by learning how compositional kernels evolve. - Eura Shin; Predrag Klasnja; Susan A. Murphy; Finale Doshi-Velez (Trans. Mach. Learn. Res., 2023)

Contextual Bandits with Budgeted Information Reveal. - Kyra Gan; Esmaeil Keyvanshokooh; Xueqing Liu; Susan A. Murphy (AISTATS, 2024)

Online learning in bandits with predicted context. - Yongyi Guo; Ziping Xu; Susan A. Murphy (AISTATS, 2024)

Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks. - Eura Nofshin; Siddharth Swaroop; Weiwei Pan; Susan A. Murphy; Finale Doshi-Velez (AAMAS, 2024)

ReBandit: Random Effects Based Online RL Algorithm for Reducing Cannabis Use. - Susobhan Ghosh; Yongyi Guo; Pei-Yao Hung; Lara N. Coughlin; Erin E. Bonar; Inbal Nahum-Shani; Maureen A. Walton; Susan A. Murphy (IJCAI, 2024)

Online Uniform Risk Times Sampling: First Approximation Algorithms, Learning Augmentation with Full Confidence Interval Integration. - Xueqing Liu; Kyra Gan; Esmaeil Keyvanshokooh; Susan A. Murphy (CoRR, 2024)

Non-Stationary Latent Auto-Regressive Bandits. - Anna L. Trella; Walter Dempsey; Finale Doshi-Velez; Susan A. Murphy (CoRR, 2024)

Monitoring Fidelity of Online Reinforcement Learning Algorithms in Clinical Trials. - Anna L. Trella; Kelly W. Zhang; Inbal Nahum-Shani; Vivek Shetty; Iris Yan; Finale Doshi-Velez; Susan A. Murphy (CoRR, 2024)

Towards Optimizing Human-Centric Objectives in AI-Assisted Decision-Making With Offline Reinforcement Learning. - Zana Buçinca; Siddharth Swaroop; Amanda E. Paluch; Susan A. Murphy; Krzysztof Z. Gajos (CoRR, 2024)

The Fallacy of Minimizing Local Regret in the Sequential Task Setting. - Ziping Xu; Kelly W. Zhang; Susan A. Murphy (CoRR, 2024)

Oralytics Reinforcement Learning Algorithm. - Anna L. Trella; Kelly W. Zhang; Stephanie Marita Carpenter; David Elashoff; Zara M. Greer; Inbal Nahum-Shani; Dennis Ruenger; Vivek Shetty; Susan A. Murphy (CoRR, 2024)

MiWaves Reinforcement Learning Algorithm. - Susobhan Ghosh; Yongyi Guo; Pei-Yao Hung; Lara N. Coughlin; Erin E. Bonar; Inbal Nahum-Shani; Maureen A. Walton; Susan A. Murphy (CoRR, 2024)

Effective Monitoring of Online Decision-Making Algorithms in Digital Intervention Implementation. - Anna L. Trella; Susobhan Ghosh; Erin E. Bonar; Lara N. Coughlin; Finale Doshi-Velez; Yongyi Guo; Pei-Yao Hung; Inbal Nahum-Shani; Vivek Shetty; Maureen A. Walton; Iris Yan; Kelly W. Zhang; et al. (CoRR, 2024)

BOTS: Batch Bayesian Optimization of Extended Thompson Sampling for Severely Episode-Limited RL Settings. - Karine Karine; Susan A. Murphy; Benjamin M. Marlin (CoRR, 2024)

Rethinking Discount Regularization: New Interpretations, Unintended Consequences, and Solutions for Regularization in Reinforcement Learning. - Sarah Rathnam; Sonali Parbhoo; Siddharth Swaroop; Weiwei Pan; Susan A. Murphy; Finale Doshi-Velez (J. Mach. Learn. Res., 2024)

Effect-Invariant Mechanisms for Policy Generalization. - Sorawit Saengkyongam; Niklas Pfister; Predrag Klasnja; Susan A. Murphy; Jonas Peters (J. Mach. Learn. Res., 2024)

Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resampling. - Susobhan Ghosh; Raphael Kim; Prasidh Chhabria; Raaz Dwivedi; Predrag Klasnja; Peng Liao; Kelly W. Zhang; Susan A. Murphy (Mach. Learn., 2024)

A Deployed Online Reinforcement Learning Algorithm in an Oral Health Clinical Trial. - Anna L. Trella; Kelly W. Zhang; Hinal Jajal; Inbal Nahum-Shani; Vivek Shetty; Finale Doshi-Velez; Susan A. Murphy (AAAI, 2025)

Reinforcement Learning on Dyads to Enhance Medication Adherence. - Ziping Xu; Hinal Jajal; Sung Won Choi; Inbal Nahum-Shani; Guy Shani; Alexandra M. Psihogios; Pei-Yao Hung; Susan A. Murphy (AIME (1), 2025)

Harnessing Causality in Reinforcement Learning with Bagged Decision Times. - Daiqi Gao; Hsin-Yu Lai; Predrag Klasnja; Susan A. Murphy (AISTATS, 2025)

Reinforcement Learning on AYA Dyads to Enhance Medication Adherence. - Ziping Xu; Hinal Jajal; Sung Won Choi; Inbal Nahum-Shani; Guy Shani; Alexandra M. Psihogios; Pei-Yao Hung; Susan A. Murphy (CoRR, 2025)

"It felt more real": Investigating the User Experience of the MiWaves Personalizing JITAI Pilot Study. - Susobhan Ghosh; Pei-Yao Hung; Lara N. Coughlin; Erin E. Bonar; Yongyi Guo; Inbal Nahum-Shani; Maureen A. Walton; Mark W. Newman; Susan A. Murphy (CoRR, 2025)

Uncertainty-Informed Scheduling of Decision Points for Intelligent Mobile Health Interventions. - Asim H. Gazi; Bhanu T. Gullapalli; Daiqi Gao; Benjamin M. Marlin; Vivek Shetty; Susan A. Murphy (CoRR, 2025)