Emma Brunskill

Orcid: 0000-0002-3971-7127

Affiliations:
  • Stanford University, CA, USA
  • Carnegie Mellon University, Pittsburgh, USA (former)


According to our database1, Emma Brunskill authored at least 167 papers between 2001 and 2024.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2024
Evaluating and Optimizing Educational Content with Large Language Model Judgments.
CoRR, 2024

A Fast and Accurate Machine Learning Autograder for the Breakout Assignment.
Proceedings of the 55th ACM Technical Symposium on Computer Science Education, 2024

Brief, Just-in-Time Teaching Tips to Support Computer Science Tutors.
Proceedings of the 55th ACM Technical Symposium on Computer Science Education, 2024

Improving Student Learning with Hybrid Human-AI Tutoring: A Three-Study Quasi-Experimental Investigation.
Proceedings of the 14th Learning Analytics and Knowledge Conference, 2024

Estimating the Causal Treatment Effect of Unproductive Persistence.
Proceedings of the 14th Learning Analytics and Knowledge Conference, 2024


2023
Adaptive Instrument Design for Indirect Experiments.
CoRR, 2023

Adaptive Interventions with User-Defined Goals for Health Behavior Change.
CoRR, 2023

Reinforcement Learning Tutor Better Supported Lower Performers in a Math Task.
CoRR, 2023

Estimating Optimal Policy Value in General Linear Contextual Bandits.
CoRR, 2023

Experiment Planning with Function Approximation.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Proportional Response: Contextual Bandits for Simple and Cumulative Regret Minimization.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Waypoint Transformer: Reinforcement Learning via Supervised Learning with Intermediate Targets.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Supervised Pretraining Can Learn In-Context Reinforcement Learning.
Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Understanding the Impact of Reinforcement Learning Personalization on Subgroups of Students in Math Tutoring.
Proceedings of the Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky, 2023

Towards the Future of AI-Augmented Human Tutoring in Math Learning.
Proceedings of the Artificial Intelligence in Education. Posters and Late Breaking Results, Workshops and Tutorials, Industry and Innovation Tracks, Practitioners, Doctoral Consortium and Blue Sky, 2023

Model-Based Offline Reinforcement Learning with Local Misspecification.
Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022
Offline policy optimization with eligible actions.
Proceedings of the Uncertainty in Artificial Intelligence, 2022

Data-Efficient Pipeline for Offline Reinforcement Learning with Limited Data.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Factored DRO: Factored Distributionally Robust Policies for Contextual Bandits.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Giving Feedback on Interactive Student Programs with Meta-Exploration.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Oracle Inequalities for Model Selection in Offline Reinforcement Learning.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Off-Policy Evaluation for Action-Dependent Non-stationary Environments.
Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Identification of Subgroups With Similar Benefits in Off-Policy Policy Evaluation.
Proceedings of the Conference on Health, Inference, and Learning, 2022

Constraint Sampling Reinforcement Learning: Incorporating Expertise for Faster Learning.
Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021
Learning to be Fair: A Consequentialist Approach to Equitable Decision-Making.
CoRR, 2021

On the Opportunities and Risks of Foundation Models.
CoRR, 2021

Provable Benefits of Actor-Critic Methods for Offline Reinforcement Learning.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Design of Experiments for Stochastic Contextual Linear Bandits.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Play to Grade: Testing Coding Games as Classifying Markov Decision Process.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Reinforcement Learning with State Observation Costs in Action-Contingent Noiselessly Observable Markov Decision Processes.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Universal Off-Policy Evaluation.
Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Power Constrained Bandits.
Proceedings of the Machine Learning for Healthcare Conference, 2021

EnglishBot: An AI-Powered Conversational System for Second Language Learning.
Proceedings of the IUI '21: 26th International Conference on Intelligent User Interfaces, 2021

Automatic Adaptive Sequencing in a Webgame.
Proceedings of the Intelligent Tutoring Systems - 17th International Conference, 2021

Online Model Selection for Reinforcement Learning with Function Approximation.
Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 2021

2020
Provably Good Batch Reinforcement Learning Without Great Exploration.
CoRR, 2020

Learning Abstract Models for Strategic Exploration and Fast Reward Transfer.
CoRR, 2020

Towards the Systematic Reporting of the Energy and Carbon Footprints of Machine Learning.
CoRR, 2020

Provably Efficient Reward-Agnostic Navigation with Linear Value Iteration.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Off-policy Policy Evaluation For Sequential Decisions Under Unobserved Confounding.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Provably Good Batch Off-Policy Reinforcement Learning Without Great Exploration.
Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Learning Near Optimal Policies with Low Inherent Bellman Error.
Proceedings of the 37th International Conference on Machine Learning, 2020

Interpretable Off-Policy Evaluation in Reinforcement Learning by Highlighting Influential Transitions.
Proceedings of the 37th International Conference on Machine Learning, 2020

Understanding the Curse of Horizon in Off-Policy Evaluation via Conditional Importance Sampling.
Proceedings of the 37th International Conference on Machine Learning, 2020

Towards Suggesting Actionable Interventions for Wheel Spinning Students.
Proceedings of the 13th International Conference on Educational Data Mining, 2020

Frequentist Regret Bounds for Randomized Least-Squares Value Iteration.
Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics, 2020

Sublinear Optimal Policy Value Estimation in Contextual Bandits.
Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics, 2020

Supporting children's math learning with feedback-augmented narrative technology.
Proceedings of the 19th ACM International Conference on Interaction Design and Children, 2020

Being Optimistic to Be Conservative: Quickly Learning a CVaR Policy.
Proceedings of the Thirty-Fourth AAAI Conference on Artificial Intelligence, 2020

2019
Missingness as Stability: Understanding the Structure of Missingness in Longitudinal EHR data and its Impact on Reinforcement Learning in Healthcare.
CoRR, 2019

Directed Exploration for Reinforcement Learning.
CoRR, 2019

Off-Policy Policy Gradient with State Distribution Correction.
CoRR, 2019

Separating value functions across time-scales.
CoRR, 2019

Where's the Reward?
Int. J. Artif. Intell. Educ., 2019

Value Driven Representation for Human-in-the-Loop Reinforcement Learning.
Proceedings of the 27th ACM Conference on User Modeling, Adaptation and Personalization, 2019

Off-Policy Policy Gradient with Stationary Distribution Correction.
Proceedings of the Thirty-Fifth Conference on Uncertainty in Artificial Intelligence, 2019

Fake It Till You Make It: Learning-Compatible Performance Support.
Proceedings of the Thirty-Fifth Conference on Uncertainty in Artificial Intelligence, 2019

Limiting Extrapolation in Linear Approximate Value Iteration.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Almost Horizon-Free Structure-Aware Best Policy Identification with a Generative Model.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Offline Contextual Bandits with High Probability Fairness Guarantees.
Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Key Phrase Extraction for Generating Educational Question-Answer Pairs.
Proceedings of the Sixth ACM Conference on Learning @ Scale, 2019

BookBuddy: Turning Digital Materials Into Interactive Foreign Language Lessons Through a Voice Chatbot.
Proceedings of the Sixth ACM Conference on Learning @ Scale, 2019

Fairer but Not Fair Enough On the Equitability of Knowledge Tracing.
Proceedings of the 9th International Conference on Learning Analytics & Knowledge, 2019

Tighter Problem-Dependent Regret Bounds in Reinforcement Learning without Domain Knowledge using Value Function Bounds.
Proceedings of the 36th International Conference on Machine Learning, 2019

Separable value functions across time-scales.
Proceedings of the 36th International Conference on Machine Learning, 2019

Combining parametric and nonparametric models for off-policy evaluation.
Proceedings of the 36th International Conference on Machine Learning, 2019

Policy Certificates: Towards Accountable Reinforcement Learning.
Proceedings of the 36th International Conference on Machine Learning, 2019

Learning Procedural Abstractions and Evaluating Discrete Latent Temporal Structure.
Proceedings of the 7th International Conference on Learning Representations, 2019

Not Everyone Writes Good Examples but Good Examples Can Come from Anywhere.
Proceedings of the Seventh AAAI Conference on Human Computation and Crowdsourcing, 2019

QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge.
Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019

PLOTS: Procedure Learning from Observations using subTask Structure.
Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems, 2019

2018
Distilling Information from a Flood: A Possibility for the Use of Meta-Analysis and Systematic Review in Machine Learning Research.
CoRR, 2018

Behaviour Policy Estimation in Off-Policy Policy Evaluation: Calibration Matters.
CoRR, 2018

Sample-Efficient Deep RL with Generative Adversarial Tree Search.
CoRR, 2018

Strategic Object Oriented Reinforcement Learning.
CoRR, 2018

When Simple Exploration is Sample Efficient: Identifying Sufficient Conditions for Random Exploration to Yield PAC RL Algorithms.
CoRR, 2018

Shared Autonomy for an Interactive AI System.
Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings, 2018

Representation Balancing MDPs for Off-policy Policy Evaluation.
Proceedings of the Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, 2018

Combining adaptivity with progression ordering for intelligent tutoring systems.
Proceedings of the Fifth Annual ACM Conference on Learning at Scale, 2018

Adaptive natural-language targeting for student feedback.
Proceedings of the Fifth Annual ACM Conference on Learning at Scale, 2018

Exploring the impact of the default option on student engagement and performance in a statistics MOOC.
Proceedings of the Fifth Annual ACM Conference on Learning at Scale, 2018

Efficient Exploration Through Bayesian Deep Q-Networks.
Proceedings of the 2018 Information Theory and Applications Workshop, 2018

Problem Dependent Reinforcement Learning Bounds Which Can Identify Bandit Structure in MDPs.
Proceedings of the 35th International Conference on Machine Learning, 2018

Decoupling Gradient-Like Learning Rules from Representations.
Proceedings of the 35th International Conference on Machine Learning, 2018

2017
Generalized Grounding Graphs: A Probabilistic Framework for Understanding Grounded Commands.
CoRR, 2017

On Ensuring that Intelligent Machines Are Well-Behaved.
CoRR, 2017

Decoupling Learning Rules from Representations.
CoRR, 2017

Policy Gradient Methods for Reinforcement Learning with Function Approximation and Action-Dependent Baselines.
CoRR, 2017

Using Options for Long-Horizon Off-Policy Evaluation.
CoRR, 2017

Sample Efficient Feature Selection for Factored MDPs.
CoRR, 2017

UBEV - A More Practical Algorithm for Episodic RL with Near-Optimal PAC and Regret Guarantees.
CoRR, 2017

Importance Sampling for Fair Policy Selection.
Proceedings of the Thirty-Third Conference on Uncertainty in Artificial Intelligence, 2017

Using Options and Covariance Testing for Long Horizon Off-Policy Policy Evaluation.
Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Regret Minimization in MDPs with Options without Prior Knowledge.
Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Unifying PAC and Regret: Uniform PAC Bounds for Episodic Reinforcement Learning.
Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, 2017

Robust Evaluation Matrix: Towards a More Principled Offline Exploration of Instructional Policies.
Proceedings of the Fourth ACM Conference on Learning @ Scale, 2017

Sample Efficient Policy Search for Optimal Stopping Domains.
Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, 2017

The Misidentified Identifiability Problem of Bayesian Knowledge Tracing.
Proceedings of the 10th International Conference on Educational Data Mining, 2017

Trading off Rewards and Errors in Multi-Armed Bandits.
Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 2017

Predictive Off-Policy Policy Evaluation for Nonstationary Decision Problems, with Applications to Digital Marketing.
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

Importance Sampling with Unequal Support.
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

Where to Add Actions in Human-in-the-Loop Reinforcement Learning.
Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, 2017

2016
Faster Teaching via POMDP Planning.
Cogn. Sci., 2016

Automatically Learning to Teach to the Learning Objectives.
Proceedings of the Third ACM Conference on Learning @ Scale, 2016

Latent Contextual Bandits and their Application to Personalized Recommendations for New Users.
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Efficient Bayesian Clustering for Reinforcement Learning.
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Questimator: Generating Knowledge Assessments for Arbitrary Topics.
Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, 2016

Energetic Natural Gradient Descent.
Proceedings of the 33nd International Conference on Machine Learning, 2016

Data-Efficient Off-Policy Policy Evaluation for Reinforcement Learning.
Proceedings of the 33nd International Conference on Machine Learning, 2016

Sequence Matters, But How Exactly? A Method for Evaluating Activity Sequences from Data.
Proceedings of the 9th International Conference on Educational Data Mining, 2016

Sequence Matters, But How Do I Discover How? Towards a Workflow for Evaluating Activity Sequences from Data.
Proceedings of the Workshop and Tutorial Proceedings of the 9th International Conference on Educational Data Mining, 2016

Interface Design Optimization as a Multi-Armed Bandit Problem.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

Toward a Learning Science for Complex Crowdsourcing Tasks.
Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

PAC Continuous State Online Multitask Reinforcement Learning with Identification.
Proceedings of the 2016 International Conference on Autonomous Agents & Multiagent Systems, 2016

A PAC RL Algorithm for Episodic POMDPs.
Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, 2016

Offline Evaluation of Online Reinforcement Learning Algorithms.
Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence, 2016

2015
The Online Discovery Problem and Its Application to Lifelong Reinforcement Learning.
CoRR, 2015

Sample Complexity of Episodic Fixed-Horizon Reinforcement Learning.
Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

Learning the Features Used To Decide How to Teach.
Proceedings of the Second ACM Conference on Learning @ Scale, 2015

From Predictive Models to Instructional Policies.
Proceedings of the 8th International Conference on Educational Data Mining, 2015

Towards Understanding How to Leverage Sense-making, Induction/Refinement and Fluency to Improve Robust Learning.
Proceedings of the 8th International Conference on Educational Data Mining, 2015

The Queue Method: Handling Delay, Heuristics, Prior Data, and Evaluation in Bandits.
Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015

Concurrent PAC RL.
Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, 2015

2014
Stochastic Optimization of a Locally Smooth Function under Correlated Bandit Feedback.
CoRR, 2014

PAC-inspired Option Discovery in Lifelong Reinforcement Learning.
Proceedings of the 31th International Conference on Machine Learning, 2014

Online Stochastic Optimization under Correlated Bandit Feedback.
Proceedings of the 31th International Conference on Machine Learning, 2014

Trading Off Scientific Knowledge and User Learning with Multi-Armed Bandits.
Proceedings of the 7th International Conference on Educational Data Mining, 2014

Towards automatic experimentation of educational knowledge.
Proceedings of the CHI Conference on Human Factors in Computing Systems, 2014

Offline policy evaluation across representations with applications to educational games.
Proceedings of the International conference on Autonomous Agents and Multi-Agent Systems, 2014

Quantifying Uncertainty in Batch Personalized Sequential Decision Making.
Proceedings of the Modern Artificial Intelligence for Health Analytics, 2014

2013
New Potentials for Data-Driven Intelligent Tutoring System Development and Optimization.
AI Mag., 2013

Sample Complexity of Multi-task Reinforcement Learning.
Proceedings of the Twenty-Ninth Conference on Uncertainty in Artificial Intelligence, 2013

Regret Bounds for Reinforcement Learning with Policy Advice.
Proceedings of the Machine Learning and Knowledge Discovery in Databases, 2013

Modeling Social Information Learning among Taxi Drivers.
Proceedings of the Advances in Knowledge Discovery and Data Mining, 2013

Sequential Transfer in Multi-armed Bandit with Finite Set of Models.
Proceedings of the Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5-8, 2013

Understanding Sequential Decisions via Inverse Reinforcement Learning.
Proceedings of the 2013 IEEE 14th International Conference on Mobile Data Management, Milan, Italy, June 3-6, 2013, 2013

Towards operationalizing outlier detection in community health programs.
Proceedings of the International conference on information and communication technologies and development, 2013

Estimating Student Knowledge from Paired Interaction Data.
Proceedings of the 6th International Conference on Educational Data Mining, 2013

Predicting Player Moves in an Educational Game: A Hybrid Approach.
Proceedings of the 6th International Conference on Educational Data Mining, 2013

Analysis of the impact of errors made during health data collection using mobile phones: exploring error modeling and automatic diagnosis.
Proceedings of the Annual Symposium on Computing for Development, 2013

2012
Incentive Decision Processes.
Proceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, 2012

Policy Building - An Extension To User Modeling.
Proceedings of the 5th International Conference on Educational Data Mining, 2012

The Impact on Individualizing Student Models on Necessary Practice Opportunities.
Proceedings of the 5th International Conference on Educational Data Mining, 2012

Bayes-optimal reinforcement learning for discrete uncertainty domains.
Proceedings of the International Conference on Autonomous Agents and Multiagent Systems, 2012

2011
Designing mobile interfaces for novice and low-literacy users.
ACM Trans. Comput. Hum. Interact., 2011

Efficient Planning under Uncertainty with Macro-actions.
J. Artif. Intell. Res., 2011

Partially Observable Sequential Decision Making for Problem Selection in an Intelligent Tutoring System.
Proceedings of the 4th International Conference on Educational Data Mining, 2011

Estimating Prerequisite Structure From Noisy Data.
Proceedings of the 4th International Conference on Educational Data Mining, 2011

Faster Teaching by POMDP Planning.
Proceedings of the Artificial Intelligence in Education - 15th International Conference, 2011

2010
Planning in partially-observable switching-mode continuous domains.
Ann. Math. Artif. Intell., 2010

RAPID: A Reachable Anytime Planner for Imprecisely-sensed Domains.
Proceedings of the UAI 2010, 2010

When Policies Can Be Trusted: Analyzing a Criteria to Identify Optimal Policies in MDPs with Unknown Model Parameters.
Proceedings of the 20th International Conference on Automated Planning and Scheduling, 2010

Learning to Identify Locally Actionable Health Anomalies.
Proceedings of the Artificial Intelligence for Development, 2010

Routing for Rural Health: Optimizing Community Health Worker Visit Schedules.
Proceedings of the Artificial Intelligence for Development, 2010

PUMA: Planning Under Uncertainty with Macro-Actions.
Proceedings of the Twenty-Fourth AAAI Conference on Artificial Intelligence, 2010

2009
Compact parametric models for efficient sequential decision making in high-dimensional, uncertain domains.
PhD thesis, 2009

Provably Efficient Learning with Typed Parametric Models.
J. Mach. Learn. Res., 2009

Evaluating the accuracy of data collection on mobile phones: A study of forms, SMS, and voice.
Proceedings of the 2009 International Conference on Information and Communication Technologies and Development, 2009

Where to go: Interpreting natural directions using global inference.
Proceedings of the 2009 IEEE International Conference on Robotics and Automation, 2009

2008
CORL: A Continuous-state Offset-dynamics Reinforcement Learner.
Proceedings of the UAI 2008, 2008

Continuous-State POMDPs with Hybrid Dynamics.
Proceedings of the International Symposium on Artificial Intelligence and Mathematics, 2008

2007
Collision detection in legged locomotion using supervised learning.
Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, October 29, 2007

Topological mapping using spectral clustering and classification.
Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, October 29, 2007

Continuous State POMDPs for Object Manipulation Tasks.
Proceedings of the Twenty-Second AAAI Conference on Artificial Intelligence, 2007

2005
SLAM using Incremental Probabilistic PCA and Dimensionality Reduction.
Proceedings of the 2005 IEEE International Conference on Robotics and Automation, 2005

2001
Building peer-to-peer systems with Chord, a distributed lookup service.
Proceedings of HotOS-VIII: 8th Workshop on Hot Topics in Operating Systems, 2001


  Loading...