Sainbayar Sukhbaatar

According to our database, Sainbayar Sukhbaatar authored at least 42 papers between 2011 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Reverse Training to Nurse the Reversal Curse.

Olga Golovneva, Zeyuan Allen-Zhu, Jason Weston, Sainbayar Sukhbaatar

CoRR, 2024

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM.

Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma, Hu Xu, Xi Victoria Lin, Baptiste Rozière, Jacob Kahn, Daniel Li, Wen-tau Yih, Jason Weston, Xian Li

CoRR, 2024

Teaching Large Language Models to Reason with Reinforcement Learning.

Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, Christoforos Nalmpantis, Jane Dwivedi-Yu, Maksym Zhuravinskyi, Eric Hambro, Sainbayar Sukhbaatar, Roberta Raileanu

CoRR, 2024

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping.

Lucas Lehnert, Sainbayar Sukhbaatar, Paul McVay, Michael Rabbat, Yuandong Tian

CoRR, 2024

Self-Rewarding Language Models.

Weizhe Yuan, Richard Yuanzhe Pang, Kyunghyun Cho, Sainbayar Sukhbaatar, Jing Xu, Jason Weston

CoRR, 2024

2023

Some things are more CRINGE than others: Preference Optimization with the Pairwise Cringe Loss.

Jing Xu, Andrew Lee, Sainbayar Sukhbaatar, Jason Weston

CoRR, 2023

System 2 Attention (is something you might need too).

Jason Weston, Sainbayar Sukhbaatar

CoRR, 2023

Improving Open Language Models by Learning from Organic Interactions.

Jing Xu, Da Ju, Joshua Lane, Mojtaba Komeili, Eric Michael Smith, Megan Ung, Morteza Behrooz, William Ngan, Rashel Moritz, Sainbayar Sukhbaatar, Y-Lan Boureau, Jason Weston, Kurt Shuster

CoRR, 2023

Large Language Model Programs.

Imanol Schlag, Sainbayar Sukhbaatar, Asli Celikyilmaz, Wen-tau Yih, Jason Weston, Jürgen Schmidhuber, Xian Li

CoRR, 2023

Think Before You Act: Unified Policy for Interleaving Language Reasoning with Actions.

Lina Mezghani, Piotr Bojanowski, Karteek Alahari, Sainbayar Sukhbaatar

CoRR, 2023

MINOTAUR: Multi-task Video Grounding From Multimodal Queries.

Raghav Goyal, Effrosyni Mavroudi, Xitong Yang, Sainbayar Sukhbaatar, Leonid Sigal, Matt Feiszli, Lorenzo Torresani, Du Tran

CoRR, 2023

Learning to Reason and Memorize with Self-Notes.

Jack Lanchantin, Shubham Toshniwal, Jason Weston, Arthur Szlam, Sainbayar Sukhbaatar

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

The CRINGE Loss: Learning what language not to model.

Leonard Adolphs, Tianyu Gao, Jing Xu, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

A Data Source for Reasoning Embodied Agents.

Jack Lanchantin, Sainbayar Sukhbaatar, Gabriel Synnaeve, Yuxuan Sun, Kavya Srinet, Arthur Szlam

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Walk the Random Walk: Learning to Discover and Reach Goals Without Supervision.

Lina Mezghani, Sainbayar Sukhbaatar, Piotr Bojanowski, Karteek Alahari

CoRR, 2022

Temporal abstractions-augmented temporally contrastive learning: An alternative to the Laplacian in RL.

Akram Erraqabi, Marlos C. Machado, Mingde Zhao, Sainbayar Sukhbaatar, Alessandro Lazaric, Ludovic Denoyer, Yoshua Bengio

Proceedings of the Uncertainty in Artificial Intelligence, 2022

Staircase Attention for Recurrent Processing of Sequences.

Da Ju, Stephen Roller, Sainbayar Sukhbaatar, Jason Weston

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Memory-Augmented Reinforcement Learning for Image-Goal Navigation.

Lina Mezghani, Sainbayar Sukhbaatar, Thibaut Lavril, Oleksandr Maksymets, Dhruv Batra, Piotr Bojanowski, Karteek Alahari

Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, 2022

Director: Generator-Classifiers For Supervised Language Modeling.

Kushal Arora, Kurt Shuster, Sainbayar Sukhbaatar, Jason Weston

Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, 2022

Learning Goal-Conditioned Policies Offline with Self-Supervised Reward Shaping.

Lina Mezghani, Sainbayar Sukhbaatar, Piotr Bojanowski, Alessandro Lazaric, Karteek Alahari

Proceedings of the Conference on Robot Learning, 2022

2021

Hash Layers For Large Sparse Models.

Stephen Roller, Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Not All Memories are Created Equal: Learning to Forget by Expiring.

Sainbayar Sukhbaatar, Da Ju, Spencer Poff, Stephen Roller, Arthur Szlam, Jason Weston, Angela Fan

Proceedings of the 38th International Conference on Machine Learning, 2021

2020

Learning to Visually Navigate in Photorealistic Environments Without any Supervision.

Lina Mezghani, Sainbayar Sukhbaatar, Arthur Szlam, Armand Joulin, Piotr Bojanowski

CoRR, 2020

Accessing Higher-level Representations in Sequential Transformers with Feedback Memory.

Angela Fan, Thibaut Lavril, Edouard Grave, Armand Joulin, Sainbayar Sukhbaatar

CoRR, 2020

2019

Augmenting Self-attention with Persistent Memory.

Sainbayar Sukhbaatar, Edouard Grave, Guillaume Lample, Hervé Jégou, Armand Joulin

CoRR, 2019

Learning when to Communicate at Scale in Multiagent Cooperative and Competitive Tasks.

Amanpreet Singh, Tushar Jain, Sainbayar Sukhbaatar

Proceedings of the 7th International Conference on Learning Representations, 2019

Adaptive Attention Span in Transformers.

Sainbayar Sukhbaatar, Edouard Grave, Piotr Bojanowski, Armand Joulin

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

Training Hybrid Language Models by Marginalizing over Segmentations.

Edouard Grave, Sainbayar Sukhbaatar, Piotr Bojanowski, Armand Joulin

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Elements of Intelligence: Memory, Communication and Intrinsic Motivation.

Sainbayar Sukhbaatar

PhD thesis, 2018

Learning Goal Embeddings via Self-Play for Hierarchical Reinforcement Learning.

Sainbayar Sukhbaatar, Emily Denton, Arthur Szlam, Rob Fergus

CoRR, 2018

Planning with Arithmetic and Geometric Attributes.

David Folqué, Sainbayar Sukhbaatar, Arthur Szlam, Joan Bruna

CoRR, 2018

Composable Planning with Attributes.

Amy Zhang, Sainbayar Sukhbaatar, Adam Lerer, Arthur Szlam, Rob Fergus

Proceedings of the 35th International Conference on Machine Learning, 2018

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play.

Sainbayar Sukhbaatar, Zeming Lin, Ilya Kostrikov, Gabriel Synnaeve, Arthur Szlam, Rob Fergus

Proceedings of the 6th International Conference on Learning Representations, 2018

2017

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play.

Sainbayar Sukhbaatar, Ilya Kostrikov, Arthur Szlam, Rob Fergus

CoRR, 2017

2016

Learning Multiagent Communication with Backpropagation.

Sainbayar Sukhbaatar, Arthur Szlam, Rob Fergus

Proceedings of the Advances in Neural Information Processing Systems 29: Annual Conference on Neural Information Processing Systems 2016, 2016

2015

Simple Baseline for Visual Question Answering.

Bolei Zhou, Yuandong Tian, Sainbayar Sukhbaatar, Arthur Szlam, Rob Fergus

CoRR, 2015

Weakly Supervised Memory Networks.

Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, Rob Fergus

CoRR, 2015

MazeBase: A Sandbox for Learning from Games.

Sainbayar Sukhbaatar, Arthur Szlam, Gabriel Synnaeve, Soumith Chintala, Rob Fergus

CoRR, 2015

Learning from Noisy Labels with Deep Neural Networks.

Sainbayar Sukhbaatar, Rob Fergus

Proceedings of the 3rd International Conference on Learning Representations, 2015

End-To-End Memory Networks.

Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston, Rob Fergus

Proceedings of the Advances in Neural Information Processing Systems 28: Annual Conference on Neural Information Processing Systems 2015, 2015

2013

Auto-pooling: Learning to Improve Invariance of Image Features from Image Sequences

Sainbayar Sukhbaatar, Takaki Makino, Kazuyuki Aihara

Proceedings of the 1st International Conference on Learning Representations, 2013

2011

Robust Generation of Dynamical Patterns in Human Motion by a Deep Belief Nets.

Sainbayar Sukhbaatar, Takaki Makino, Kazuyuki Aihara, Takashi Chikayama

Proceedings of the 3rd Asian Conference on Machine Learning, 2011