Olga Golovneva

According to our database, Olga Golovneva authored at least 23 papers between 2020 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Self-Improving Pretraining: using post-trained models to pretrain better models.

Ellen Xiaoqing Tan, Shehzaad Dhuliawala, Jing Xu, Ping Yu, Sainbayar Sukhbaatar, Jason Weston, Olga Golovneva

CoRR, January, 2026

2025

The Era of Real-World Human Interaction: RL from User Conversations.

Chuanyang Jin, Jing Xu, Bo Liu, Leitian Tao, Olga Golovneva, Tianmin Shu, Wenting Zhao, Xian Li, Jason Weston

CoRR, September, 2025

StepWiser: Stepwise Generative Judges for Wiser Reasoning.

Wei Xiong, Wenting Zhao, Weizhe Yuan, Olga Golovneva, Tong Zhang, Jason Weston, Sainbayar Sukhbaatar

CoRR, August, 2025

CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks.

Ping Yu, Jack Lanchantin, Tianlu Wang, Weizhe Yuan, Olga Golovneva, Ilia Kulikov, Sainbayar Sukhbaatar, Jason Weston, Jing Xu

CoRR, July, 2025

Recycling the Web: A Method to Enhance Pre-training Data Quality and Quantity for Language Models.

Thao Nguyen, Yang Li, Olga Golovneva, Luke Zettlemoyer, Sewoong Oh, Ludwig Schmidt, Xian Li

CoRR, June, 2025

Multi-Token Attention.

Olga Golovneva, Tianlu Wang, Jason Weston, Sainbayar Sukhbaatar

CoRR, April, 2025

R.I.P.: Better Models by Survival of the Fittest Prompts.

Ping Yu, Weizhe Yuan, Olga Golovneva, Tianhao Wu, Sainbayar Sukhbaatar, Jason E. Weston, Jing Xu

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge.

Tianhao Wu, Weizhe Yuan, Olga Golovneva, Jing Xu, Yuandong Tian, Jiantao Jiao, Jason E. Weston, Sainbayar Sukhbaatar

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

Efficient Tool Use with Chain-of-Abstraction Reasoning.

Silin Gao, Jane Dwivedi-Yu, Ping Yu, Xiaoqing Ellen Tan, Ramakanth Pasunuru, Olga Golovneva, Koustuv Sinha, Asli Celikyilmaz, Antoine Bosselut, Tianlu Wang

Proceedings of the 31st International Conference on Computational Linguistics, 2025

2024

Self-Taught Evaluators.

Tianlu Wang, Ilia Kulikov, Olga Golovneva, Ping Yu, Weizhe Yuan, Jane Dwivedi-Yu, Richard Yuanzhe Pang, Maryam Fazel-Zarandi, Jason Weston, Xian Li

CoRR, 2024

Contextual Position Encoding: Learning to Count What's Important.

Olga Golovneva, Tianlu Wang, Jason Weston, Sainbayar Sukhbaatar

CoRR, 2024

Reverse Training to Nurse the Reversal Curse.

Olga Golovneva, Zeyuan Allen-Zhu, Jason Weston, Sainbayar Sukhbaatar

CoRR, 2024

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM.

Sainbayar Sukhbaatar, Olga Golovneva, Vasu Sharma, Hu Xu, Xi Victoria Lin, Baptiste Rozière, Jacob Kahn, Daniel Li, Wen-tau Yih, Jason Weston, Xian Li

CoRR, 2024

2023

PathFinder: Guided Search over Multi-Step Reasoning Paths.

Olga Golovneva, Sean O'Brien, Ramakanth Pasunuru, Tianlu Wang, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz

CoRR, 2023

DOMINO: A Dual-System for Multi-step Visual Language Reasoning.

Peifang Wang, Olga Golovneva, Armen Aghajanyan, Xiang Ren, Muhao Chen, Asli Celikyilmaz, Maryam Fazel-Zarandi

CoRR, 2023

Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning.

Lili Yu, Bowen Shi, Ramakanth Pasunuru, Benjamin Muller, Olga Golovneva, Tianlu Wang, Arun Babu, Binh Tang, Brian Karrer, Shelly Sheynin, Candace Ross, Adam Polyak, Russell Howes, Vasu Sharma, Puxin Xu, Hovhannes Tamoyan, Oron Ashual, Uriel Singer, Shang-Wen Li, Susan Zhang, Richard James, Gargi Ghosh, Yaniv Taigman, Maryam Fazel-Zarandi, Asli Celikyilmaz, Luke Zettlemoyer, Armen Aghajanyan

CoRR, 2023

Shepherd: A Critic for Language Model Generation.

Tianlu Wang, Ping Yu, Xiaoqing Ellen Tan, Sean O'Brien, Ramakanth Pasunuru, Jane Dwivedi-Yu, Olga Golovneva, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz

CoRR, 2023

ROSCOE: A Suite of Metrics for Scoring Step-by-Step Reasoning.

Olga Golovneva, Moya Chen, Spencer Poff, Martin Corredor, Luke Zettlemoyer, Maryam Fazel-Zarandi, Asli Celikyilmaz

Proceedings of the Eleventh International Conference on Learning Representations, 2023

ALERT: Adapt Language Models to Reasoning Tasks.

Ping Yu, Tianlu Wang, Olga Golovneva, Badr AlKhamissi, Siddharth Verma, Zhijing Jin, Gargi Ghosh, Mona T. Diab, Asli Celikyilmaz

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

ALERT: Adapting Language Models to Reasoning Tasks.

Ping Yu, Tianlu Wang, Olga Golovneva, Badr AlKhamissy, Gargi Ghosh, Mona T. Diab, Asli Celikyilmaz

CoRR, 2022

Cross-lingual transfer for low-resource Arabic language understanding.

Khadige Abboud, Olga Golovneva, Christopher DiPersio

Proceedings of the The Seventh Arabic Natural Language Processing Workshop, 2022

2020

Generative Adversarial Networks for Annotated Data Augmentation in Data Sparse NLU.

Olga Golovneva, Charith Peris

Proceedings of the 17th International Conference on Natural Language Processing, 2020

Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models.

Lizhen Tan, Olga Golovneva

Proceedings of the 28th International Conference on Computational Linguistics, 2020