Generalisation of RLHF under Reward Shift and Clipped KL Regularisation. - Kenton Tang; Yuzhu Chen; Fengxiang He (CoRR, 2026)