Convergence and stability of Q-learning in Hierarchical Reinforcement Learning. - Massimiliano Manenti; Andrea Iannelli (CoRR, 2025)