RL with Learnable Textual Feedback: A Bilevel Approach. - Utsav Singh; Sidhaarth Sredharan; Souradip Chakraborty; Amrit Singh Bedi (CoRR, 2026)