Adversarial Policy Optimization for Offline Preference-based Reinforcement Learning. - Hyungkyu Kang; Min-hwan Oh (ICLR, 2025)