Generalist Reward Models: Found Inside Large Language Models. - Yi-Chen Li 001; Tian Xu 003; Yang Yu 001; Xuqin Zhang; Xiong-Hui Chen; Zhongxiang Ling; Ningjing Chao; Lei Yuan 005; Zhi-Hua Zhou (CoRR, 2025)