A Reinforcement Learning Algorithm with Polynomial Interaction Complexity for Only-Costly-Observable MDPs. - Roy Fox; Moshe Tennenholtz (AAAI, 2007)

Bounded Planning in Passive POMDPs. - Roy Fox; Naftali Tishby (ICML, 2012)

A multi-agent control framework for co-adaptation in brain-computer interfaces. - Josh Merel; Roy Fox; Tony Jebara; Liam Paninski (NIPS, 2013)

G-Learning: Taming the Noise in Reinforcement Learning via Soft Updates. - Roy Fox; Ari Pakman; Naftali Tishby (CoRR, 2015)

Optimal Selective Attention in Reactive Agents. - Roy Fox; Naftali Tishby (CoRR, 2015)

Minimum-information LQG control Part II: Retentive controllers. - Roy Fox; Naftali Tishby (CDC, 2016)

Minimum-information LQG control part I: Memoryless controllers. - Roy Fox; Naftali Tishby (CDC, 2016)

Taming the Noise in Reinforcement Learning via Soft Updates. - Roy Fox; Ari Pakman; Naftali Tishby (UAI, 2016)

Information-Theoretic Methods for Planning and Learning in Partially Observable Markov Decision Processes. - Roy Fox (CoRR, 2016)

Principled Option Learning in Markov Decision Processes. - Roy Fox; Michal Moshkovitz; Naftali Tishby (CoRR, 2016)

Information-Theoretic Methods for Planning and Learning in Partially Observable Markov Decision Processes (שער נוסף בעברית: שיטות תורת-האינפורמציה לתכנון ולמידה בתהליכי החלטה מרקוב נצפים חלקית.). - Roy Fox (2016)

An algorithm and user study for teaching bilateral manipulation via iterated best response demonstrations. - Carolyn Chen; Sanjay Krishnan; Michael Laskey; Roy Fox; Ken Goldberg (CASE, 2017)

Statistical data cleaning for deep learning of automation tasks from demonstrations. - Caleb Chuck; Michael Laskey; Sanjay Krishnan; Ruta Joshi; Roy Fox; Ken Goldberg (CASE, 2017)

DDCO: Discovery of Deep Continuous Options for Robot Learning from Demonstrations. - Sanjay Krishnan; Roy Fox; Ion Stoica; Ken Goldberg (CoRL, 2017)

DART: Noise Injection for Robust Imitation Learning. - Michael Laskey; Jonathan Lee 002; Roy Fox; Anca D. Dragan; Ken Goldberg (CoRL, 2017)

Multi-Level Discovery of Deep Options. - Roy Fox; Sanjay Krishnan; Ion Stoica; Ken Goldberg (CoRR, 2017)

Iterative Noise Injection for Scalable Imitation Learning. - Michael Laskey; Jonathan Lee 002; Wesley Yu-Shu Hsieh; Richard Liaw; Jeffrey Mahler; Roy Fox; Ken Goldberg (CoRR, 2017)

DDCO: Discovery of Deep Continuous Options forRobot Learning from Demonstrations. - Sanjay Krishnan; Roy Fox; Ion Stoica; Ken Goldberg (CoRR, 2017)

Ray RLLib: A Composable and Scalable Reinforcement Learning Library. - Eric Liang; Richard Liaw; Robert Nishihara; Philipp Moritz; Roy Fox; Joseph Gonzalez 001; Ken Goldberg; Ion Stoica (CoRR, 2017)

Constraint Estimation and Derivative-Free Recovery for Robot Learning from Demonstrations. - Jonathan Lee 002; Michael Laskey; Roy Fox; Ken Goldberg (CASE, 2018)

Parametrized Hierarchical Procedures for Neural Programming. - Roy Fox; Richard Shin; Sanjay Krishnan; Ken Goldberg; Dawn Song; Ion Stoica (ICLR (Poster), 2018)

RLlib: Abstractions for Distributed Reinforcement Learning. - Eric Liang; Richard Liaw; Robert Nishihara; Philipp Moritz; Roy Fox; Ken Goldberg; Joseph Gonzalez 001; Michael I. Jordan; Ion Stoica (ICML, 2018)

Robustly Adjusting Indoor Drip Irrigation Emitters with the Toyota HSR Robot. - Ron Berenstein; Roy Fox; Stephen McKinley; Stefano Carpin; Ken Goldberg (ICRA, 2018)

Fast and Reliable Autonomous Surgical Debridement with Cable-Driven Robots Using a Two-Phase Calibration Procedure. - Daniel Seita; Sanjay Krishnan; Roy Fox; Stephen McKinley; John F. Canny; Ken Goldberg (ICRA, 2018)

Generalizing Robot Imitation Learning with Invariant Hidden Semi-Markov Models. - Ajay Kumar Tanwani; Jonathan Lee 002; Brijen Thananjeyan; Michael Laskey; Sanjay Krishnan; Roy Fox; Ken Goldberg; Sylvain Calinon (WAFR, 2018)

Derivative-Free Failure Avoidance Control for Manipulation using Learned Support Constraints. - Jonathan Lee 002; Michael Laskey; Roy Fox; Ken Goldberg (CoRR, 2018)

Multi-Task Hierarchical Imitation Learning for Home Automation. - Roy Fox; Ron Berenstein; Ion Stoica; Ken Goldberg (CASE, 2019)

Hierarchical Variational Imitation Learning of Control Programs. - Roy Fox; Richard Shin; William Paul; Yitian Zou; Dawn Song; Ken Goldberg; Pieter Abbeel; Ion Stoica (CoRR, 2019)

AutoPandas: neural-backed generators for program synthesis. - Rohan Bavishi; Caroline Lemieux; Roy Fox; Koushik Sen; Ion Stoica (Proc. ACM Program. Lang., 2019)

Pipeline PSRO: A Scalable Approach for Finding Approximate Nash Equilibria in Large Games. - Stephen McAleer; John B. Lanier; Roy Fox; Pierre Baldi (NeurIPS, 2020)

XDO: A Double Oracle Algorithm for Extensive-Form Games. - Stephen McAleer; John B. Lanier; Kevin A. Wang; Pierre Baldi; Roy Fox (NeurIPS, 2021)

A* Search Without Expansions: Learning Heuristic Functions with Deep Q-Networks. - Forest Agostinelli; Alexander Shmakov; Stephen McAleer; Roy Fox; Pierre Baldi (CoRR, 2021)

XDO: A Double Oracle Algorithm for Extensive-Form Games. - Stephen McAleer; John B. Lanier; Pierre Baldi; Roy Fox (CoRR, 2021)

Improving Social Welfare While Preserving Autonomy via a Pareto Mediator. - Stephen McAleer; John B. Lanier; Michael Dennis 001; Pierre Baldi; Roy Fox (CoRR, 2021)

Modular Framework for Visuomotor Language Grounding. - Kolby Nottingham; Litian Liang; Daeyun Shin; Charless C. Fowlkes; Roy Fox; Sameer Singh 001 (CoRR, 2021)

Temporal-Difference Value Estimation via Uncertainty-Guided Soft Updates. - Litian Liang; Yaosheng Xu; Stephen McAleer; Dailin Hu; Alexander Ihler; Pieter Abbeel; Roy Fox (CoRR, 2021)

Count-Based Temperature Scheduling for Maximum Entropy Reinforcement Learning. - Dailin Hu; Pieter Abbeel; Roy Fox (CoRR, 2021)

Target Entropy Annealing for Discrete Soft Actor-Critic. - Yaosheng Xu; Dailin Hu; Litian Liang; Stephen McAleer; Pieter Abbeel; Roy Fox (CoRR, 2021)

Independent Natural Policy Gradient always converges in Markov Potential Games. - Roy Fox; Stephen M. McAleer; Will Overman; Ioannis Panageas (AISTATS, 2022)

Reducing Variance in Temporal-Difference Value Estimation via Ensemble of Deep Networks. - Litian Liang; Yaosheng Xu; Stephen McAleer; Dailin Hu; Alexander Ihler; Pieter Abbeel; Roy Fox (ICML, 2022)

Anytime PSRO for Two-Player Zero-Sum Games. - Stephen McAleer; Kevin Wang 003; John B. Lanier; Marc Lanctot; Pierre Baldi; Tuomas Sandholm; Roy Fox (CoRR, 2022)

Learning to Query Internet Text for Informing Reinforcement Learning Agents. - Kolby Nottingham; Alekhya Pyla; Sameer Singh 001; Roy Fox (CoRR, 2022)

Self-Play PSRO: Toward Optimal Populations in Two-Player Zero-Sum Games. - Stephen McAleer; John B. Lanier; Kevin A. Wang; Pierre Baldi; Roy Fox; Tuomas Sandholm (CoRR, 2022)

Feasible Adversarial Robust Reinforcement Learning for Underspecified Environments. - John B. Lanier; Stephen McAleer; Pierre Baldi; Roy Fox (CoRR, 2022)

Learning to Design Analog Circuits to Meet Threshold Specifications. - Dmitrii Krylov; Pooya Khajeh; Junhan Ouyang; Thomas Reeves; Tongkai Liu; Hiba Ajmal; Hamidreza Aghasi; Roy Fox (ICML, 2023)

Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling. - Kolby Nottingham; Prithviraj Ammanabrolu; Alane Suhr; Yejin Choi 001; Hannaneh Hajishirzi; Sameer Singh 001; Roy Fox (ICML, 2023)

Selective Perception: Optimizing State Descriptions with Reinforcement Learning for Language Model Actors. - Kolby Nottingham; Yasaman Razeghi; Kyungmin Kim 002; JB Lanier; Pierre Baldi; Roy Fox; Sameer Singh 001 (CoRR, 2023)

Toward Optimal Policy Population Growth in Two-Player Zero-Sum Games. - Stephen Marcus McAleer; JB Lanier; Kevin A. Wang; Pierre Baldi; Tuomas Sandholm; Roy Fox (ICLR, 2024)

Skill Set Optimization: Reinforcing Language Model Behavior via Transferable Skills. - Kolby Nottingham; Bodhisattwa Prasad Majumder; Bhavana Dalvi Mishra; Sameer Singh 001; Peter Clark; Roy Fox (ICML, 2024)

Selective Perception: Learning Concise State Descriptions for Language Model Actors. - Kolby Nottingham; Yasaman Razeghi; Kyungmin Kim 002; JB Lanier; Pierre Baldi; Roy Fox; Sameer Singh 001 (NAACL (Short Papers), 2024)

Verification-Guided Shielding for Deep Reinforcement Learning. - Davide Corsi; Guy Amir; Andoni Rodríguez; Guy Katz; César Sánchez 001; Roy Fox (RLJ, 2024)

Reinforcement Learning from Delayed Observations via World Models. - Armin Karamzade; Kyungmin Kim 002; Montek Kalsi; Roy Fox (RLJ, 2024)

Moonwalk: Inverse-Forward Differentiation. - Dmitrii Krylov; Armin Karamzade; Roy Fox (CoRR, 2024)

Make the Pertinent Salient: Task-Relevant Reconstruction for Visual Control with Distractions. - Kyungmin Kim 002; JB Lanier; Pierre Baldi; Charless C. Fowlkes; Roy Fox (CoRR, 2024)

Realizable Continuous-Space Shields for Safe Reinforcement Learning. - Kyungmin Kim 002; Davide Corsi; Andoni Rodríguez; JB Lanier; Benjami Parellada; Pierre Baldi; César Sánchez 001; Roy Fox (L4DC, 2025)

Adapting World Models with Latent-State Dynamics Residuals. - JB Lanier; Kyungmin Kim 002; Armin Karamzade; Yifei Liu; Ankita Sinha; Kat He; Davide Corsi; Roy Fox (CoRR, 2025)

Explanations for Unrealizability of Infinite-State Safety Shields. - Andoni Rodríguez; Irfansha Shaik; Davide Corsi; Roy Fox; César Sánchez 001 (CoRR, 2025)