Actor-critic algorithms for hierarchical Markov decision processes. - Shalabh Bhatnagar; J. Ranjan Panigrahi (Autom., 2006)