On Q-learning Convergence for Non-Markov Decision Processes. - Sultan Javed Majeed; Marcus Hutter (IJCAI, 2018)

Performance Guarantees for Homomorphisms beyond Markov Decision Processes. - Sultan Javed Majeed; Marcus Hutter (AAAI, 2019)

Conditions on Features for Temporal Difference-Like Methods to Converge. - Marcus Hutter; Samuel Yang-Zhao; Sultan Javed Majeed (IJCAI, 2019)

Exact Reduction of Huge Action Spaces in General Reinforcement Learning. - Sultan Javed Majeed; Marcus Hutter (AAAI, 2021)

Reducing Planning Complexity of General Reinforcement Learning with Non-Markovian Abstractions. - Sultan Javed Majeed; Marcus Hutter (CoRR, 2021)

Abstractions of General Reinforcement Learning. - Sultan Javed Majeed (CoRR, 2021)