Planning with Expectation Models. - Yi Wan 004; Muhammad Zaheer; Adam White 001; Martha White; Richard S. Sutton (IJCAI, 2019)

Learning and Planning in Average-Reward Markov Decision Processes. - Yi Wan 004; Abhishek Naik; Richard S. Sutton (ICML, 2021)

Average-Reward Off-Policy Policy Evaluation with Function Approximation. - Shangtong Zhang; Yi Wan 004; Richard S. Sutton; Shimon Whiteson (ICML, 2021)

Average-Reward Learning and Planning with Options. - Yi Wan 004; Abhishek Naik; Richard S. Sutton (NeurIPS, 2021)

Planning with Expectation Models for Control. - Katya Kudashkina; Yi Wan 004; Abhishek Naik; Richard S. Sutton (CoRR, 2021)

Toward Discovering Options that Achieve Faster Planning. - Yi Wan 004; Richard S. Sutton (CoRR, 2022)

On Convergence of Average-Reward Off-Policy Control Algorithms in Weakly-Communicating MDPs. - Yi Wan 004; Richard S. Sutton (CoRR, 2022)

A Note on Stability in Asynchronous Stochastic Approximation without Communication Delays. - Huizhen Yu; Yi Wan 004; Richard S. Sutton (CoRR, 2023)

Reward Centering. - Abhishek Naik; Yi Wan 004; Manan Tomar; Richard S. Sutton (RLJ, 2024)

On Convergence of Average-Reward Q-Learning in Weakly Communicating Markov Decision Processes. - Yi Wan 004; Huizhen Yu; Richard S. Sutton (CoRR, 2024)

Asynchronous Stochastic Approximation and Average-Reward Reinforcement Learning. - Huizhen Yu; Yi Wan 004; Richard S. Sutton (CoRR, 2024)