Retrospex: Language Agent Meets Offline Reinforcement Learning Critic. - Yufei Xiang; Yiqun Shen; Yeqin Zhang; Cam-Tu Nguyen (EMNLP, 2024)