Finite dimensional algorithms for the hidden Markov model multi-armed bandit problem. - Vikram Krishnamurthy; Josipa Mickova (ICASSP, 1999)