Transformers Struggle to Learn to Search. - Abulhair Saparov; Srushti Ajay Pawar; Shreyas Pimpalgaonkar; Nitish Joshi; Richard Yuanzhe Pang; Vishakh Padmakumar; Mehran Kazemi; Najoung Kim; He He 001 (ICLR, 2025)