Bellman goes relational. - Kristian Kersting; Martijn van Otterlo; Luc De Raedt (ICML, 2004)

The logic of adaptive behavior : knowledge representation and algorithms for the Markov decision process framework in first-order domains. - Martijn van Otterlo (2008)

Intensional dynamic programming. A Rosetta stone for structured dynamic programming. - Martijn van Otterlo (J. Algorithms, 2009)

The Logic of Adaptive Behavior - Knowledge Representation and Algorithms for Adaptive Sequential Decision Making under Uncertainty in First-Order and Relational Domains - Martijn van Otterlo (IOS Press, 2009)

DTProbLog: A Decision-Theoretic Probabilistic Prolog. - Guy Van den Broeck; Ingo Thon; Martijn van Otterlo; Luc De Raedt (AAAI, 2010)

Not Far Away from Home: A Relational Distance-Based Approach to Understanding Images of Houses. - Laura Antanas; Martijn van Otterlo; José Oramas M.; Tinne Tuytelaars; Luc De Raedt (ILP, 2010)

Spatial Role Labeling: Task Definition and Annotation Scheme. - Parisa Kordjamshidi; Martijn van Otterlo; Marie-Francine Moens (LREC, 2010)

Relational Learning for Spatial Relation Extraction from Natural Language. - Parisa Kordjamshidi; Paolo Frasconi; Martijn van Otterlo; Marie-Francine Moens; Luc De Raedt (ILP, 2011)

Statistical Relational Learning of Object Affordances for Robotic Manipulation. - Bogdan Moldovan; Martijn van Otterlo; Luc De Raedt; Plinio Moreno; José Santos-Victor (ILP (Late Breaking Papers), 2011)

Spatial role labeling: Towards extraction of spatial relations from natural language. - Parisa Kordjamshidi; Martijn van Otterlo; Marie-Francine Moens (ACM Trans. Speech Lang. Process., 2011)

Solving Relational and First-Order Logical Markov Decision Processes: A Survey. - Martijn van Otterlo (Reinforcement Learning, 2012)

Reinforcement Learning and Markov Decision Processes. - Martijn van Otterlo; Marco A. Wiering (Reinforcement Learning, 2012)

Conclusions, Future Directions and Outlook. - Marco A. Wiering; Martijn van Otterlo (Reinforcement Learning, 2012)

A Relational Distance-based Framework for Hierarchical Image Understanding. - Laura Antanas; Martijn van Otterlo; José Oramas M.; Tinne Tuytelaars; Luc De Raedt (ICPRAM (2), 2012)

Learning relational affordance models for robots in multi-object manipulation tasks. - Bogdan Moldovan; Plinio Moreno; Martijn van Otterlo; José Santos-Victor; Luc De Raedt (ICRA, 2012)

On the use of probabilistic relational affordance models for sequential manipulation tasks in robotics. - Bogdan Moldovan; Plinio Moreno; Martijn van Otterlo (ICRA, 2013)

Machine learning for interactive systems and robots: a brief introduction. - Heriberto Cuayáhuitl; Martijn van Otterlo; Nina Dethlefs; Lutz Frommberger (MLIS@IJCAI, 2013)

There are plenty of places like home: Using relational representations in hierarchies for distance-based image understanding. - Laura Antanas; Martijn van Otterlo; José Oramas Mogrovejo; Tinne Tuytelaars; Luc De Raedt (Neurocomputing, 2014)

Proceedings of the 4th Workshop on Machine Learning for Interactive Systems (MLIS-2015). - Heriberto Cuayáhuitl; Nina Dethlefs; Lutz Frommberger; Martijn van Otterlo; Olivier Pietquin (MLIS@ICML, 2015)

Reports of the AAAI 2014 Conference Workshops. - Stefano V. Albrecht; André da Motta Salles Barreto; Darius Braziunas; David L. Buckeridge; Heriberto Cuayáhuitl; Nina Dethlefs; Markus Endres; Amir-massoud Farahmand; Mark Fox; Lutz Frommberger; Sam Ganzfried; Yolanda Gil; et al. (AI Mag., 2015)

Learning to Play Donkey Kong Using Neural Networks and Reinforcement Learning. - Paul Ozkohen; Jelle Visser; Martijn van Otterlo; Marco A. Wiering (BNCAI, 2017)

From Algorithmic Black Boxes to Adaptive White Boxes: Declarative Decision-Theoretic Ethical Programs as Codes of Ethics. - Martijn van Otterlo (CoRR, 2017)

On Requirements and Design Criteria for Explainability in Legal AI. - Martijn van Otterlo; Martin Atzmueller (XAILA@JURIX, 2018)

Personalization of Health Interventions Using Cluster-Based Reinforcement Learning. - Ali el Hassouni; Mark Hoogendoorn; Martijn van Otterlo; Eduardo Barbaro (PRIMA, 2018)

Gatekeeping Algorithms with Human Ethical Bias: The ethics of algorithms in archives, libraries and society. - Martijn van Otterlo (CoRR, 2018)

End-to-end Personalization of Digital Health Interventions using Raw Sensor Data with Deep Reinforcement Learning. - Ali el Hassouni; Mark Hoogendoorn; A. E. Eiben; Martijn van Otterlo; Vesa Muhonen (WI, 2019)

A Conceptual View on the Design and Properties of Explainable AI Systems for Legal Settings. - Martijn van Otterlo; Martin Atzmueller (AICOL, 2020)

Regular Decision Processes for Grid Worlds. - Nicky Lenaers; Martijn van Otterlo (BNAIC/BENELEARN, 2021)