Shayne Longpre

According to our database, Shayne Longpre authored at least 30 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

On the Societal Impact of Open Foundation Models.

Sayash Kapoor, Rishi Bommasani, Kevin Klyman, Shayne Longpre, Ashwin Ramaswami, Peter Cihon, Aspen Hopkins, Kevin Bankston, Stella Biderman, Miranda Bogen, Rumman Chowdhury, Alex Engler, Peter Henderson, Yacine Jernite, Seth Lazar, Stefano Maffulli, Alondra Nelson, Joelle Pineau, Aviya Skowron, Dawn Song, Victor Storchan, Daniel Zhang, Daniel E. Ho, Percy Liang, Arvind Narayanan

CoRR, 2024

A Safe Harbor for AI Evaluation and Red Teaming.

Shayne Longpre, Sayash Kapoor, Kevin Klyman, Ashwin Ramaswami, Rishi Bommasani, Borhane Blili-Hamelin, Yangsibo Huang, Aviya Skowron, Zheng Xin Yong, Suhas Kotha, Yi Zeng, Weiyan Shi, Xianjun Yang, Reid Southen, Alexander Robey, Patrick Chao, Diyi Yang, Ruoxi Jia, Daniel Kang, Sandy Pentland, Arvind Narayanan, Percy Liang, Peter Henderson

CoRR, 2024

A Survey on Data Selection for Language Models.

Alon Albalak, Yanai Elazar, Sang Michael Xie, Shayne Longpre, Nathan Lambert, Xinyi Wang, Niklas Muennighoff, Bairu Hou, Liangming Pan, Haewon Jeong, Colin Raffel, Shiyu Chang, Tatsunori Hashimoto, William Yang Wang

CoRR, 2024

Foundation Model Transparency Reports.

Rishi Bommasani, Kevin Klyman, Shayne Longpre, Betty Xiong, Sayash Kapoor, Nestor Maslej, Arvind Narayanan, Percy Liang

CoRR, 2024

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model.

Ahmet Üstün, Viraat Aryabumi, Zheng Xin Yong, Wei-Yin Ko, Daniel D'souza, Gbemileke Onilude, Neel Bhandari, Shivalika Singh, Hui-Lee Ooi, Amr Kayid, Freddie Vargus, Phil Blunsom, Shayne Longpre, Niklas Muennighoff, Marzieh Fadaee, Julia Kreutzer, Sara Hooker

CoRR, 2024

2023

The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI.

Shayne Longpre, Robert Mahari, Anthony Chen, Naana Obeng-Marnu, Damien Sileo, William Brannon, Niklas Muennighoff, Nathan Khazam, Jad Kabbara, Kartik Perisetla, Xinyi Wu, Enrico Shippole, Kurt D. Bollacker, Tongshuang Wu, Luis Villa, Sandy Pentland, Deb Roy, Sara Hooker

CoRR, 2023

The Foundation Model Transparency Index.

Rishi Bommasani, Kevin Klyman, Shayne Longpre, Sayash Kapoor, Nestor Maslej, Betty Xiong, Daniel Zhang, Percy Liang

CoRR, 2023

Prometheus: Inducing Fine-grained Evaluation Capability in Language Models.

Seungone Kim, Jamin Shin, Yejin Cho, Joel Jang, Shayne Longpre, Hwaran Lee, Sangdoo Yun, Seongjin Shin, Sungdong Kim, James Thorne, Minjoon Seo

CoRR, 2023

OctoPack: Instruction Tuning Code Large Language Models.

Niklas Muennighoff, Qian Liu, Armel Zebaze, Qinkai Zheng, Binyuan Hui, Terry Yue Zhuo, Swayam Singh, Xiangru Tang, Leandro von Werra, Shayne Longpre

CoRR, 2023

Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts.

Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Longpre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Y. Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, Denny Zhou

CoRR, 2023

A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity.

Shayne Longpre, Gregory Yauney, Emily Reif, Katherine Lee, Adam Roberts, Barret Zoph, Denny Zhou, Jason Wei, Kevin Robinson, David Mimno, Daphne Ippolito

CoRR, 2023

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning.

Shayne Longpre, Le Hou, Tu Vu, Albert Webson, Hyung Won Chung, Yi Tay, Denny Zhou, Quoc V. Le, Barret Zoph, Jason Wei, Adam Roberts

Proceedings of the International Conference on Machine Learning, 2023

2022

Scaling Instruction-Finetuned Language Models.

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Eric Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, Albert Webson, Shixiang Shane Gu, Zhuyun Dai, Mirac Suzgun, Xinyun Chen, Aakanksha Chowdhery, Sharan Narang, Gaurav Mishra, Adams Yu, Vincent Y. Zhao, Yanping Huang, Andrew M. Dai, Hongkun Yu, Slav Petrov, Ed H. Chi, Jeff Dean, Jacob Devlin, Adam Roberts, Denny Zhou, Quoc V. Le, Jason Wei

CoRR, 2022

MIA 2022 Shared Task: Evaluating Cross-lingual Open-Retrieval Question Answering for 16 Diverse Languages.

Akari Asai, Shayne Longpre, Jungo Kasai, Chia-Hsuan Lee, Rui Zhang, Junjie Hu, Ikuya Yamada, Jonathan H. Clark, Eunsol Choi

CoRR, 2022

Active Learning Over Multiple Domains in Natural Language Tasks.

Shayne Longpre, Julia Reisler, Edward Greg Huang, Yi Lu, Andrew J. Frank, Nikhil Ramesh, Chris DuBois

CoRR, 2022

The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset.

Hugo Laurençon, Lucile Saulnier, Thomas Wang, Christopher Akiki, Albert Villanova del Moral, Teven Le Scao, Leandro von Werra, Chenghao Mou, Eduardo González Ponferrada, Huu Nguyen, Jörg Frohberg, Mario Sasko, Quentin Lhoest, Angelina McMillan-Major, Gérard Dupont, Stella Biderman, Anna Rogers, Loubna Ben Allal, Francesco De Toni, Giada Pistilli, Olivier Nguyen, Somaieh Nikpoor, Maraim Masoud, Pierre Colombo, Javier de la Rosa, Paulo Villegas, Tristan Thrush, Shayne Longpre, Sebastian Nagel, Leon Weber, Manuel Muñoz, Jian Zhu, Daniel van Strien, Zaid Alyafeai, Khalid Almubarak, Minh Chien Vu, Itziar Gonzalez-Dios, Aitor Soroa, Kyle Lo, Manan Dey, Pedro Ortiz Suarez, Aaron Gokaslan, Shamik Bose, David Ifeoluwa Adelani, Long Phan, Hieu Tran, Ian Yu, Suhas Pai, Jenny Chim, Violette Lepercq, Suzana Ilic, Margaret Mitchell, Alexandra Sasha Luccioni, Yacine Jernite

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks.

Rajiv Movva, Jinhao Lei, Shayne Longpre, Ajay Gupta, Chris DuBois

Proceedings of the 29th International Conference on Computational Linguistics, 2022

2021

MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering.

Shayne Longpre, Yi Lu, Joachim Daiber

Trans. Assoc. Comput. Linguistics, 2021

Question Rewriting for Conversational Question Answering.

Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, Raviteja Anantha

Proceedings of the WSDM '21, 2021

On the Transferability of Minimal Prediction Preserving Inputs in Question Answering.

Shayne Longpre, Yi Lu, Chris DuBois

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Open-Domain Question Answering Goes Conversational via Question Rewriting.

Raviteja Anantha, Svitlana Vakulenko, Zhucheng Tu, Shayne Longpre, Stephen Pulman, Srinivas Chappidi

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Entity-Based Knowledge Conflicts in Question Answering.

Shayne Longpre, Kartik Perisetla, Anthony Chen, Nikhil Ramesh, Chris DuBois, Sameer Singh

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

A Comparison of Question Rewriting Methods for Conversational Passage Retrieval.

Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre

Proceedings of the Advances in Information Retrieval, 2021

Evaluating Entity Disambiguation and the Role of Popularity in Retrieval-Based NLP.

Anthony Chen, Pallavi Gudipati, Shayne Longpre, Xiao Ling, Sameer Singh

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Pivot Through English: Reliably Answering Multilingual Questions without Document Retrieval.

Ivan Montero, Shayne Longpre, Ni Lao, Andrew J. Frank, Christopher DuBois

CoRR, 2020

A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answering.

Svitlana Vakulenko, Shayne Longpre, Zhucheng Tu, Raviteja Anantha

CoRR, 2020

Leveraging Query Resolution and Reading Comprehension for Conversational Passage Retrieval.

Svitlana Vakulenko, Nikos Voskarides, Zhucheng Tu, Shayne Longpre

Proceedings of the Twenty-Ninth Text REtrieval Conference, 2020

How Effective is Task-Agnostic Data Augmentation for Pretrained Transformers?

Shayne Longpre, Yu Wang, Chris DuBois

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

2019

An Exploration of Data Augmentation and Sampling Techniques for Domain-Agnostic Question Answering.

Shayne Longpre, Yi Lu, Zhucheng Tu, Chris DuBois

Proceedings of the 2nd Workshop on Machine Reading for Question Answering, 2019

2016

A Way out of the Odyssey: Analyzing and Combining Recent Insights for LSTMs.

Shayne Longpre, Sabeek Pradhan, Caiming Xiong, Richard Socher

CoRR, 2016