Direct Gradient Temporal Difference Learning. - Xiaochi Qian; Shangtong Zhang (CoRR, 2023)

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise. - Xiaochi Qian; Zixuan Xie; Xinyu Liu; Shangtong Zhang (CoRR, 2024)

Revisiting a Design Choice in Gradient Temporal Difference Learning. - Xiaochi Qian; Shangtong Zhang (ICLR, 2025)