A Descriptive and Normative Theory of Human Beliefs in RLHF. - Sylee Dandekar; Shripad Deshmukh; Frank Chiu; W. Bradley Knox; Scott Niekum (CoRR, 2025)