Clockwork Orange: The Dutch RoboSoccer Team. - Matthijs T. J. Spaan; Marco A. Wiering; Robert Bartelds; Raymond Donkervoort; Pieter P. Jonker; Frans C. A. Groen (RoboCup, 2001)

Team Coordination among Robotic Soccer Players. - Matthijs T. J. Spaan; Frans C. A. Groen (RoboCup, 2002)

A Point-based POMDP Algorithm for Robot Planning. - Matthijs T. J. Spaan; Nikos Vlassis (ICRA, 2004)

Robot Planning in Partially Observable Continuous Domains. - Josep M. Porta; Matthijs T. J. Spaan; Nikos Vlassis (BNAIC, 2005)

Planning with Continuous Actions in Partially Observable Environments. - Matthijs T. J. Spaan; Nikos Vlassis (ICRA, 2005)

Real World Multi-agent Systems: Information Sharing, Coordination and Planning. - Frans C. A. Groen; Matthijs T. J. Spaan; Jelle R. Kok; Gregor Pavlin (TbiLLC, 2005)

Perseus: Randomized Point-based Value Iteration for POMDPs. - Matthijs T. J. Spaan; Nikos Vlassis (J. Artif. Intell. Res., 2005)

Non-communicative multi-robot coordination in dynamic environments. - Jelle R. Kok; Matthijs T. J. Spaan; Nikos Vlassis (Robotics Auton. Syst., 2005)

Decentralized planning under uncertainty for teams of communicating agents. - Matthijs T. J. Spaan; Geoffrey J. Gordon; Nikos Vlassis (AAMAS, 2006)

Point-Based Value Iteration for Continuous POMDPs. - Josep M. Porta; Nikos Vlassis; Matthijs T. J. Spaan; Pascal Poupart (J. Mach. Learn. Res., 2006)

Multiagent Planning Under Uncertainty with Stochastic Communication Delays. - Matthijs T. J. Spaan; Frans A. Oliehoek; Nikos Vlassis (ICAPS, 2008)

Exploiting locality of interaction in factored Dec-POMDPs. - Frans A. Oliehoek; Matthijs T. J. Spaan; Shimon Whiteson; Nikos Vlassis (AAMAS (1), 2008)

Interaction-driven Markov games for decentralized multiagent planning under uncertainty. - Matthijs T. J. Spaan; Francisco S. Melo (AAMAS (1), 2008)

Optimal and Approximate Q-value Functions for Decentralized POMDPs. - Frans A. Oliehoek; Matthijs T. J. Spaan; Nikos Vlassis (J. Artif. Intell. Res., 2008)

A Decision-Theoretic Approach to Dynamic Sensor Selection in Camera Networks. - Matthijs T. J. Spaan; Pedro U. Lima (ICAPS, 2009)

Lossless clustering of histories in decentralized POMDPs. - Frans A. Oliehoek; Shimon Whiteson; Matthijs T. J. Spaan (AAMAS (1), 2009)

ISROBOTNET: A testbed for sensor and robot network systems. - Marco Barbosa; Alexandre Bernardino; Dario Figueira; José António Gaspar; Nelson Gonçalves; Pedro U. Lima; Plinio Moreno; Abdolkarim Pahliani; José Santos-Victor; Matthijs T. J. Spaan; João Sequeira 001 (IROS, 2009)

Decision-theoretic robot guidance for active cooperative perception. - Abdolkarim Pahliani; Matthijs T. J. Spaan; Pedro U. Lima (IROS, 2009)

Signal Processing Advances in Robots and Autonomy. - Frank Ehlers; Fredrik Gustafsson; Matthijs T. J. Spaan (EURASIP J. Adv. Signal Process., 2009)

Heuristic search for identical payoff Bayesian games. - Frans A. Oliehoek; Matthijs T. J. Spaan; Jilles Steeve Dibangoye; Christopher Amato (AAMAS, 2010)

A Bayesian game based adaptive fuzzy controller for multiagent POMDPs. - Rajneesh Sharma; Matthijs T. J. Spaan (FUZZ-IEEE, 2010)

Multirobot coordination by auctioning POMDPs. - Matthijs T. J. Spaan; Nelson Gonçalves; João Sequeira 001 (ICRA, 2010)

Fault-tolerant probabilistic sensor fusion for Multi-Agent Systems. - Abdolkarim Pahliani; Matthijs T. J. Spaan; Pedro U. Lima (IROS, 2010)

Active cooperative perception in network robot systems using POMDPs. - Matthijs T. J. Spaan; Tiago Veiga; Pedro U. Lima (IROS, 2010)

Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas. - Alberto Sanfeliu; Juan Andrade-Cetto; Marco Barbosa; Richard Bowden; Jesús Capitán; Andreu Corominas Murtra; Andrew Gilbert; John Illingworth; Luis Merino; Josep M. Mirats Tur; Plinio Moreno; Aníbal Ollero; et al. (Sensors, 2010)

QueryPOMDP: POMDP-Based Communication in Multiagent Systems. - Francisco S. Melo; Matthijs T. J. Spaan; Stefan J. Witwicki (EUMAS, 2011)

Fuzzy reinforcement learning control for decentralized partially observable Markov decision processes. - Rajneesh Sharma; Matthijs T. J. Spaan (FUZZ-IEEE, 2011)

Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion. - Matthijs T. J. Spaan; Frans A. Oliehoek; Christopher Amato (IJCAI, 2011)

Efficient Offline Communication Policies for Factored Multiagent POMDPs. - João V. Messias; Matthijs T. J. Spaan; Pedro U. Lima (NIPS, 2011)

Exploiting Agent and Type Independence in Collaborative Graphical Bayesian Games - Frans A. Oliehoek; Shimon Whiteson; Matthijs T. J. Spaan (CoRR, 2011)

Partially Observable Markov Decision Processes. - Matthijs T. J. Spaan (Reinforcement Learning, 2012)

Tree-Based Solution Methods for Multiagent POMDPs with Delayed Communication. - Frans Adriaan Oliehoek; Matthijs T. J. Spaan (AAAI, 2012)

Tree-based pruning for multiagent POMDPs with delayed communication. - Frans A. Oliehoek; Matthijs T. J. Spaan (AAMAS, 2012)

Exploiting Structure in Cooperative Bayesian Games. - Frans A. Oliehoek; Shimon Whiteson; Matthijs T. J. Spaan (UAI, 2012)

Bayesian-Game-Based Fuzzy Reinforcement Learning Control for Decentralized POMDPs. - Rajneesh Sharma; Matthijs T. J. Spaan (IEEE Trans. Comput. Intell. AI Games, 2012)

GSMDPs for Multi-Robot Sequential Decision-Making. - João Vicente Messias; Matthijs T. J. Spaan; Pedro U. Lima (AAAI, 2013)

Planning under Uncertainty for Coordinating Infrastructural Maintenance. - Joris Scharpff; Matthijs T. J. Spaan; Leentje Volker; Mathijs de Weerdt (ICAPS, 2013)

A Flexible Approach to Modeling Unpredictable Events in MDPs. - Stefan J. Witwicki; Francisco S. Melo; Jesús Capitán; Matthijs T. J. Spaan (ICAPS, 2013)

Multiagent POMDPs with asynchronous execution. - João V. Messias; Matthijs T. J. Spaan; Pedro U. Lima (AAMAS, 2013)

Approximate solutions for factored Dec-POMDPs with many agents. - Frans A. Oliehoek; Shimon Whiteson; Matthijs T. J. Spaan (AAMAS, 2013)

Coordinating maintenance planning under uncertainty: (demonstration). - Joris Scharpff; Matthijs T. J. Spaan; Leentje Volker; Mathijs de Weerdt (AAMAS, 2013)

Decentralized multi-robot cooperation with auctioned POMDPs. - Jesús Capitán; Matthijs T. J. Spaan; Luis Merino; Aníbal Ollero (Int. J. Robotics Res., 2013)

Incremental Clustering and Expansion for Faster Optimal Planning in Dec-POMDPs. - Frans A. Oliehoek; Matthijs T. J. Spaan; Christopher Amato; Shimon Whiteson (J. Artif. Intell. Res., 2013)

Point-Based POMDP Solving with Factored Value Function Approximation. - Tiago Veiga; Matthijs T. J. Spaan; Pedro U. Lima (AAAI, 2014)

Bounded Approximations for Linear Multi-Objective Planning Under Uncertainty. - Diederik Marijn Roijers; Joris Scharpff; Matthijs T. J. Spaan; Frans A. Oliehoek; Mathijs de Weerdt; Shimon Whiteson (ICAPS, 2014)

A testbed for autonomous robot surveillance. - Stefan J. Witwicki; José Carlos Castillo 001; Jesús Capitán; João V. Messias; João C. G. Reis; Pedro U. Lima; Francisco S. Melo; Matthijs T. J. Spaan (AAMAS, 2014)

Best-Response Planning of Thermostatically Controlled Loads under Power Constraints. - Frits de Nijs; Matthijs T. J. Spaan; Mathijs de Weerdt (AAAI, 2015)

The MADP Toolbox: An Open-Source Library for Planning and Learning in (Multi-)Agent Systems. - Frans A. Oliehoek; Matthijs T. J. Spaan; Philipp Robbel; João V. Messias (AAAI Fall Symposia, 2015)

Influence-Optimistic Local Values for Multiagent Planning. - Frans A. Oliehoek; Matthijs T. J. Spaan; Stefan J. Witwicki (AAMAS, 2015)

Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure. - Tiago S. Veiga; Matthijs T. J. Spaan; Pedro U. Lima (AAMAS, 2015)

Factored Upper Bounds for Multiagent Planning Problems under Uncertainty with Non-Factored Value Functions. - Frans Adriaan Oliehoek; Matthijs T. J. Spaan; Stefan J. Witwicki (IJCAI, 2015)

Planning under Uncertainty with Weighted State Scenarios. - Erwin Walraven; Matthijs T. J. Spaan (UAI, 2015)

Decision-theoretic planning under uncertainty with information rewards for active cooperative perception. - Matthijs T. J. Spaan; Tiago S. Veiga; Pedro U. Lima (Auton. Agents Multi Agent Syst., 2015)

Influence-Optimistic Local Values for Multiagent Planning - Extended Version. - Frans A. Oliehoek; Matthijs T. J. Spaan; Stefan J. Witwicki (CoRR, 2015)

Solving Transition-Independent Multi-agent MDPs with Sparse Interactions (Extended version). - Joris Scharpff; Diederik M. Roijers; Frans A. Oliehoek; Matthijs T. J. Spaan; Mathijs de Weerdt (CoRR, 2015)

Solving Transition-Independent Multi-Agent MDPs with Sparse Interactions. - Joris Scharpff; Diederik M. Roijers; Frans A. Oliehoek; Matthijs T. J. Spaan; Mathijs Michiel de Weerdt (AAAI, 2016)

Planning under Uncertainty for Aggregated Electric Vehicle Charging Using Markov Decision Processes. - Erwin Walraven; Matthijs T. J. Spaan (AAAI Workshop: AI for Smart Grids and Smart Buildings, 2016)

Decoupling a Resource Constraint Through Fictitious Play in Multi-Agent Sequential Decision Making. - Frits de Nijs; Matthijs T. J. Spaan; Mathijs Michiel de Weerdt (ECAI, 2016)

Planning Under Uncertainty for Aggregated Electric Vehicle Charging with Renewable Energy Supply. - Erwin Walraven; Matthijs T. J. Spaan (ECAI, 2016)

The 2015 AAAI Fall Symposium Series Reports. - Nisar Ahmed; Paul Bello; Selmer Bringsjord; Micah Clark; Bradley Hayes; Christopher Miller; Frans A. Oliehoek; Frank Stein; Matthijs T. J. Spaan (AI Mag., 2016)

Traffic flow optimization: A reinforcement learning approach. - Erwin Walraven; Matthijs T. J. Spaan; Bram Bakker (Eng. Appl. Artif. Intell., 2016)

Bounding the Probability of Resource Constraint Violations in Multi-Agent MDPs. - Frits de Nijs; Erwin Walraven; Mathijs Michiel de Weerdt; Matthijs T. J. Spaan (AAAI, 2017)

Accelerated Vector Pruning for Optimal POMDP Solvers. - Erwin Walraven; Matthijs T. J. Spaan (AAAI, 2017)

The MADP Toolbox: An Open Source Library for Planning and Learning in (Multi-)Agent Systems. - Frans A. Oliehoek; Matthijs T. J. Spaan; Bas Terwijn; Philipp Robbel; João V. Messias (J. Mach. Learn. Res., 2017)

Preallocation and Planning Under Stochastic Resource Constraints. - Frits de Nijs; Matthijs T. J. Spaan; Mathijs Michiel de Weerdt (AAAI, 2018)

Bootstrapping LPs in Value Iteration for Multi-Objective and Partially Observable MDPs. - Diederik M. Roijers; Erwin Walraven; Matthijs T. J. Spaan (ICAPS, 2018)

Capacity-aware Sequential Recommendations. - Frits de Nijs; Georgios Theocharous; Nikos Vlassis; Mathijs Michiel de Weerdt; Matthijs T. J. Spaan (AAMAS, 2018)

Improving Offline Value-Function Approximations for POMDPs by Reducing Discount Factors. - Yi-Chun Chen 004; Mykel J. Kochenderfer; Matthijs T. J. Spaan (IROS, 2018)

Fleet Management for Pickup and Delivery Problems with Multiple Locations and Preferences. - Johan Los; Matthijs T. J. Spaan; Rudy R. Negenborn (LDIC, 2018)

Stability and Decentralized Control of Plug-and-Play DC Distribution Grids. - Nils H. Van Der Blij; Laura M. Ramirez-Elizondo; Matthijs T. J. Spaan; Pavol Bauer (IEEE Access, 2018)

Exploiting submodular value functions for scaling up active perception. - Yash Satsangi; Shimon Whiteson; Frans A. Oliehoek; Matthijs T. J. Spaan (Auton. Robots, 2018)

Column Generation Algorithms for Constrained POMDPs. - Erwin Walraven; Matthijs T. J. Spaan (J. Artif. Intell. Res., 2018)

Safe Policy Improvement with Baseline Bootstrapping in Factored Environments. - Thiago D. Simão; Matthijs T. J. Spaan (AAAI, 2019)

Structure Learning for Safe Policy Improvement. - Thiago D. Simão; Matthijs T. J. Spaan (IJCAI, 2019)

Point-Based Value Iteration for Finite-Horizon POMDPs. - Erwin Walraven; Matthijs T. J. Spaan (J. Artif. Intell. Res., 2019)

Decentralized Combinatorial Auctions for Dynamic and Large-Scale Collaborative Vehicle Routing. - Johan Los; Frederik Schulte; Margaretha Gansterer; Richard F. Hartl; Matthijs T. J. Spaan; Rudy R. Negenborn (ICCL, 2020)

Improved Power Flow Methods for DC Grids. - Nils H. Van Der Blij; Dario Chaifouroosh; Claudio A. Cañizares; Thiago Batista Soeiro; Laura M. Ramirez-Elizondo; Matthijs T. J. Spaan; Pavol Bauer (ISIE, 2020)

A Unified Decision-Theoretic Model for Information Gathering and Communication Planning. - Jennifer Renoux; Tiago S. Veiga; Pedro U. Lima; Matthijs T. J. Spaan (RO-MAN, 2020)

WCSAC: Worst-Case Soft Actor Critic for Safety-Constrained Reinforcement Learning. - Qisong Yang; Thiago D. Simão; Simon H. Tindemans; Matthijs T. J. Spaan (AAAI, 2021)

Abstraction-Guided Policy Recovery from Expert Demonstrations. - Canmanie T. Ponnambalam; Frans A. Oliehoek; Matthijs T. J. Spaan (ICAPS, 2021)

AlwaysSafe: Reinforcement Learning without Safety Constraint Violations during Training. - Thiago D. Simão; Nils Jansen 001; Matthijs T. J. Spaan (AAMAS, 2021)

Safe Policies for Factored Partially Observable Stochastic Games. - Steven Carr 002; Nils Jansen 001; Sudarshanan Bharadwaj; Matthijs T. J. Spaan; Ufuk Topcu (Robotics: Science and Systems, 2021)

Constrained Multiagent Markov Decision Processes: a Taxonomy of Problems and Algorithms. - Frits de Nijs; Erwin Walraven; Mathijs Michiel de Weerdt; Matthijs T. J. Spaan (J. Artif. Intell. Res., 2021)

Speeding up Deep Reinforcement Learning through Influence-Augmented Local Simulators. - Miguel Suau; Jinke He; Matthijs T. J. Spaan; Frans A. Oliehoek (AAMAS, 2022)

Abstraction-Refinement for Hierarchical Probabilistic Models. - Sebastian Junges; Matthijs T. J. Spaan (CAV (1), 2022)

Influence-Augmented Local Simulators: a Scalable Solution for Fast Deep RL in Large Networked Systems. - Miguel Suau; Jinke He; Matthijs T. J. Spaan; Frans A. Oliehoek (ICML, 2022)

A Modern Perspective on Safe Automated Driving for Different Traffic Dynamics Using Constrained Reinforcement Learning. - Danial Kamran; Thiago D. Simão; Qisong Yang; Canmanie T. Ponnambalam; Johannes Fischer 007; Matthijs T. J. Spaan; Martin Lauer (ITSC, 2022)

Distributed Influence-Augmented Local Simulators for Parallel MARL in Large Networked Systems. - Miguel Suau; Jinke He; Mustafa Mert Çelikok; Matthijs T. J. Spaan; Frans A. Oliehoek (NeurIPS, 2022)

Planning with Uncertainty: Deep Exploration in Model-Based Reinforcement Learning. - Yaniv Oren; Matthijs T. J. Spaan; Wendelin Böhmer (CoRR, 2022)

CEM: Constrained Entropy Maximization for Task-Agnostic Safe Exploration. - Qisong Yang; Matthijs T. J. Spaan (AAAI, 2023)

Reinforcement Learning by Guided Safe Exploration. - Qisong Yang; Thiago D. Simão; Nils Jansen 001; Simon H. Tindemans; Matthijs T. J. Spaan (ECAI, 2023)

Scalable Safe Policy Improvement via Monte Carlo Tree Search. - Alberto Castellini; Federico Bianchi 002; Edoardo Zorzi; Thiago D. Simão; Alessandro Farinelli; Matthijs T. J. Spaan (ICML, 2023)

The Role of Diverse Replay for Generalisation in Reinforcement Learning. - Max Weltevrede; Matthijs T. J. Spaan; Wendelin Böhmer (CoRR, 2023)

Safety-constrained reinforcement learning with a distributional safety critic. - Qisong Yang; Thiago D. Simão; Simon H. Tindemans; Matthijs T. J. Spaan (Mach. Learn., 2023)

Bayesian Ensembles for Exploration in Deep Q-Learning. - Pascal R. van der Vaart; Neil Yorke-Smith; Matthijs T. J. Spaan (AAMAS, 2024)

Diverse Projection Ensembles for Distributional Reinforcement Learning. - Moritz Akiya Zanger; Wendelin Boehmer; Matthijs T. J. Spaan (ICLR, 2024)

Scalable Safe Policy Improvement for Factored Multi-Agent MDPs. - Federico Bianchi 002; Edoardo Zorzi; Alberto Castellini; Thiago D. Simão; Matthijs T. J. Spaan; Alessandro Farinelli (ICML, 2024)

Bad Habits: Policy Confounding and Out-of-Trajectory Generalization in RL. - Miguel Suau; Matthijs T. J. Spaan; Frans A. Oliehoek (RLJ, 2024)

When Do Off-Policy and On-Policy Policy Gradient Methods Align? - Davide Mambelli; Stephan Bongers; Onno Zoeter; Matthijs T. J. Spaan; Frans A. Oliehoek (CoRR, 2024)

Exploring LLMs as a Source of Targeted Synthetic Textual Data to Minimize High Confidence Misclassifications. - Philip Lippmann; Matthijs T. J. Spaan; Jie Yang 028 (CoRR, 2024)

Value Improved Actor Critic Algorithms. - Yaniv Oren; Moritz A. Zanger; Pascal R. van der Vaart; Matthijs T. J. Spaan; Wendelin Böhmer (CoRR, 2024)

Explore-Go: Leveraging Exploration for Generalisation in Deep Reinforcement Learning. - Max Weltevrede; Felix Kaubek; Matthijs T. J. Spaan; Wendelin Böhmer (CoRR, 2024)

Pessimistic Iterative Planning for Robust POMDPs. - Maris F. L. Galesloot; Marnix Suilen; Thiago D. Simão; Steven Carr 002; Matthijs T. J. Spaan; Ufuk Topcu; Nils Jansen 001 (CoRR, 2024)

Training on more Reachable Tasks for Generalisation in Reinforcement Learning. - Max Weltevrede; Caroline Horsch; Matthijs T. J. Spaan; Wendelin Böhmer (CoRR, 2024)

Positive Experience Reflection for Agents in Interactive Text Environments. - Philip Lippmann; Matthijs T. J. Spaan; Jie Yang 028 (CoRR, 2024)

Epistemic Bellman Operators. - Pascal R. van der Vaart; Matthijs T. J. Spaan; Neil Yorke-Smith (AAAI, 2025)

Epistemic Monte Carlo Tree Search. - Yaniv Oren; Viliam Vadocz; Matthijs T. J. Spaan; Wendelin Boehmer (ICLR, 2025)

Contextual Similarity Distillation: Ensemble Uncertainties with a Single Model. - Moritz A. Zanger; Pascal R. van der Vaart; Wendelin Böhmer; Matthijs T. J. Spaan (CoRR, 2025)

Trust-Region Twisted Policy Improvement. - Joery A. de Vries; Jinke He; Yaniv Oren; Matthijs T. J. Spaan (CoRR, 2025)

VeRecycle: Reclaiming Guarantees from Probabilistic Certificates for Stochastic Dynamical Systems after Change. - Sterre Lutz; Matthijs T. J. Spaan; Anna Lukina (CoRR, 2025)

How Ensembles of Distilled Policies Improve Generalisation in Reinforcement Learning. - Max Weltevrede; Moritz A. Zanger; Matthijs T. J. Spaan; Wendelin Böhmer (CoRR, 2025)

Bayesian Meta-Reinforcement Learning with Laplace Variational Recurrent Networks. - Joery A. de Vries; Jinke He; Mathijs Michiel de Weerdt; Matthijs T. J. Spaan (CoRR, 2025)

Universal Value-Function Uncertainties. - Moritz A. Zanger; Max Weltevrede; Yaniv Oren; Pascal R. van der Vaart; Caroline Horsch; Wendelin Böhmer; Matthijs T. J. Spaan (CoRR, 2025)

RecBayes: Recurrent Bayesian Ad Hoc Teamwork in Large Partially Observable Domains. - João G. Ribeiro; Yaniv Oren; Alberto Sardinha; Matthijs T. J. Spaan; Francisco S. Melo (CoRR, 2025)

Large-scale collaborative vehicle routing. - Johan Los; Frederik Schulte; Margaretha Gansterer; Richard F. Hartl; Matthijs T. J. Spaan; Rudy R. Negenborn (Ann. Oper. Res., 2025)