A Change Detection Model for Non-Stationary k-Armed Bandit Problems. - Carlos Diuk; Michael L. Littman (AAAI Spring Symposium: Between a Rock and a Hard Place: Cognitive Science Principles Meet AI-Hard Problems, 2006)

A hierarchical approach to efficient reinforcement learning in deterministic domains. - Carlos Diuk; Alexander L. Strehl; Michael L. Littman (AAMAS, 2006)

Efficient Structure Learning in Factored-State MDPs. - Alexander L. Strehl; Carlos Diuk; Michael L. Littman (AAAI, 2007)

An object-oriented representation for efficient reinforcement learning. - Carlos Diuk; Andre Cohen; Michael L. Littman (ICML, 2008)

The adaptive k-meteorologists problem and its application to structure learning and feature selection in reinforcement learning. - Carlos Diuk; Lihong Li 001; Bethany R. Leffler (ICML, 2009)

Workshop summary: Results of the 2009 reinforcement learning competition. - David Wingate; Carlos Diuk; Lihong Li 001; Matthew Taylor; Jordan Frank (ICML, 2009)

Exploring compact reinforcement-learning representations with linear regression. - Thomas J. Walsh 001; Istvan Szita; Carlos Diuk; Michael L. Littman (UAI, 2009)

Hierarchical Reinforcement Learning. - Carlos Diuk; Michael L. Littman (Encyclopedia of Artificial Intelligence, 2009)

Generalizing Apprenticeship Learning across Hypothesis Classes. - Thomas J. Walsh 001; Kaushik Subramanian; Michael L. Littman; Carlos Diuk (ICML, 2010)

The emergence of the modern concept of introspection: a quantitative linguistic analysis. - Iván Raskovsky; Diego Fernández Slezak; Carlos Diuk; Guillermo A. Cecchi (NAACL (Young Investigators Workshop), 2010)

Divide and Conquer: Hierarchical Reinforcement Learning and Task Decomposition in Humans. - Carlos Diuk; Anna C. Schapiro; Natalia Córdova; José Ribas-Fernandes; Yael Niv; Matthew M. Botvinick (Computational and Robotic Models of the Hierarchical Organization of Behavior, 2013)

Optimal Behavioral Hierarchy. - Alec Solway; Carlos Diuk; Natalia Córdova; Debbie Yee; Andrew G. Barto; Yael Niv; Matthew M. Botvinick (PLoS Comput. Biol., 2014)

Parsing Heuristic and Forward Search in First-Graders' Game-Play Behavior. - Luciano Paz; Andrea Paula Goldin; Carlos Diuk; Mariano Sigman (Cogn. Sci., 2015)

Social Catalysts: Characterizing People Who Spark Conversations Among Others. - Martin Saveski; Farshad Kooti; Sylvia Morelli Vitousek; Carlos Diuk; Bryce Bartlett; Lada A. Adamic (Proc. ACM Hum. Comput. Interact., 2021)