When Do Transformers Shine in RL? Decoupling Memory from Credit Assignment. - Tianwei Ni; Michel Ma; Benjamin Eysenbach; Pierre-Luc Bacon (NeurIPS, 2023)

Bridging State and History Representations: Understanding Self-Predictive RL. - Tianwei Ni; Benjamin Eysenbach; Erfan Seyedsalehi; Michel Ma; Clement Gehring; Aditya Mahajan; Pierre-Luc Bacon (ICLR, 2024)

Do Transformer World Models Give Better Policy Gradients? - Michel Ma; Tianwei Ni; Clement Gehring; Pierluca D'Oro; Pierre-Luc Bacon (ICML, 2024)