Jesse Dodge

According to our database, Jesse Dodge authored at least 44 papers between 2012 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

OLMo: Accelerating the Science of Language Models.

Dirk Groeneveld, Iz Beltagy, Pete Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Harsh Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, Shane Arora, David Atkinson, Russell Authur, Khyathi Raghavi Chandu, Arman Cohan, Jennifer Dumas, Yanai Elazar, Yuling Gu, Jack Hessel, Tushar Khot, William Merrill, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Valentina Pyatkin, Abhilasha Ravichander, Dustin Schwenk, Saurabh Shah, Will Smith, Emma Strubell, Nishant Subramani, Mitchell Wortsman, Pradeep Dasigi, Nathan Lambert, Kyle Richardson, Luke Zettlemoyer, Jesse Dodge, Kyle Lo, Luca Soldaini, Noah A. Smith, Hannaneh Hajishirzi

CoRR, 2024

Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research.

Luca Soldaini, Rodney Kinney, Akshita Bhagia, Dustin Schwenk, David Atkinson, Russell Authur, Ben Bogin, Khyathi Chandu, Jennifer Dumas, Yanai Elazar, Valentin Hofmann, Ananya Harsh Jha, Sachin Kumar, Li Lucy, Xinxi Lyu, Nathan Lambert, Ian Magnusson, Jacob Morrison, Niklas Muennighoff, Aakanksha Naik, Crystal Nam, Matthew E. Peters, Abhilasha Ravichander, Kyle Richardson, Zejiang Shen, Emma Strubell, Nishant Subramani, Oyvind Tafjord, Pete Walsh, Luke Zettlemoyer, Noah A. Smith, Hannaneh Hajishirzi, Iz Beltagy, Dirk Groeneveld, Jesse Dodge, Kyle Lo

CoRR, 2024

AboutMe: Using Self-Descriptions in Webpages to Document the Effects of English Pretraining Data Filters.

Li Lucy, Suchin Gururangan, Luca Soldaini, Emma Strubell, David Bamman, Lauren Klein, Jesse Dodge

CoRR, 2024

2023

Paloma: A Benchmark for Evaluating Language Model Fit.

Ian Magnusson, Akshita Bhagia, Valentin Hofmann, Luca Soldaini, Ananya Harsh Jha, Oyvind Tafjord, Dustin Schwenk, Evan Pete Walsh, Yanai Elazar, Kyle Lo, Dirk Groeneveld, Iz Beltagy, Hannaneh Hajishirzi, Noah A. Smith, Kyle Richardson, Jesse Dodge

CoRR, 2023

Catwalk: A Unified Language Model Evaluation Framework for Many Datasets.

Dirk Groeneveld, Anas Awadalla, Iz Beltagy, Akshita Bhagia, Ian Magnusson, Hao Peng, Oyvind Tafjord, Pete Walsh, Kyle Richardson, Jesse Dodge

CoRR, 2023

What's In My Big Data?

Yanai Elazar, Akshita Bhagia, Ian Magnusson, Abhilasha Ravichander, Dustin Schwenk, Alane Suhr, Pete Walsh, Dirk Groeneveld, Luca Soldaini, Sameer Singh, Hanna Hajishirzi, Noah A. Smith, Jesse Dodge

CoRR, 2023

Language Models Hallucinate, but May Excel at Fact Verification.

Jian Guan, Jesse Dodge, David Wadden, Minlie Huang, Hao Peng

CoRR, 2023

The Rise of Open Science: Tracking the Evolution and Perceived Value of Data and Methods Link-Sharing Practices.

Hancheng Cao, Jesse Dodge, Kyle Lo, Daniel A. McFarland, Lucy Lu Wang

CoRR, 2023

Efficiency Pentathlon: A Standardized Arena for Efficiency Evaluation.

Hao Peng, Qingqing Cao, Jesse Dodge, Matthew E. Peters, Jared Fernandez, Tom Sherborne, Kyle Lo, Sam Skjonsberg, Emma Strubell, Darrell Plessas, Iz Beltagy, Evan Pete Walsh, Noah A. Smith, Hannaneh Hajishirzi

CoRR, 2023

Surveying (Dis)Parities and Concerns of Compute Hungry NLP Research.

Ji-Ung Lee, Haritz Puerto, Betty van Aken, Yuki Arase, Jessica Zosa Forde, Leon Derczynski, Andreas Rücklé, Iryna Gurevych, Roy Schwartz, Emma Strubell, Jesse Dodge

CoRR, 2023

Evaluating the Social Impact of Generative AI Systems in Systems and Society.

Irene Solaiman, Zeerak Talat, William Agnew, Lama Ahmad, Dylan K. Baker, Su Lin Blodgett, Hal Daumé III, Jesse Dodge, Ellie Evans, Sara Hooker, Yacine Jernite, Alexandra Sasha Luccioni, Alberto Lusoli, Margaret Mitchell, Jessica Newman, Marie-Therese Png, Andrew Strait, Apostol Vassilev

CoRR, 2023

Multimodal C4: An Open, Billion-scale Corpus of Images Interleaved with Text.

Wanrong Zhu, Jack Hessel, Anas Awadalla, Samir Yitzhak Gadre, Jesse Dodge, Alex Fang, Youngjae Yu, Ludwig Schmidt, William Yang Wang, Yejin Choi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

AdapterSoup: Weight Averaging to Improve Generalization of Pretrained Language Models.

Alexandra Chronopoulou, Matthew E. Peters, Alexander Fraser, Jesse Dodge

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

Stubborn Lexical Bias in Data and Models.

Sofia Serrano, Jesse Dodge, Noah A. Smith

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Reproducibility in NLP: What Have We Learned from the Checklist?

Ian Magnusson, Noah A. Smith, Jesse Dodge

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

Words as Gatekeepers: Measuring Discipline-specific Terms and Meanings in Scholarly Publications.

Li Lucy, Jesse Dodge, David Bamman, Katherine A. Keith

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

Efficient and Equitable Natural Language Processing in the Age of Deep Learning (Dagstuhl Seminar 22232).

Jesse Dodge, Iryna Gurevych, Roy Schwartz, Emma Strubell, Betty van Aken

Dagstuhl Reports, 2022

Data Governance in the Age of Large-Scale Data-Driven Language Technology.

Yacine Jernite, Huu Nguyen, Stella Biderman, Anna Rogers, Maraim Masoud, Valentin Danchev, Samson Tan, Alexandra Sasha Luccioni, Nishant Subramani, Gérard Dupont, Jesse Dodge, Kyle Lo, Zeerak Talat, Isaac Johnson, Dragomir R. Radev, Somaieh Nikpoor, Jörg Frohberg, Aaron Gokaslan, Peter Henderson, Rishi Bommasani, Margaret Mitchell

CoRR, 2022

Findings of the WMT'22 Shared Task on Large-Scale Machine Translation Evaluation for African Languages.

David Ifeoluwa Adelani, Md Mahfuz Ibn Alam, Antonios Anastasopoulos, Akshita Bhagia, Marta R. Costa-jussà, Jesse Dodge, Fahim Faisal, Christian Federmann, Natalia Fedorova, Francisco Guzmán, Sergey Koshelev, Jean Maillard, Vukosi Marivate, Jonathan Mbuya, Alexandre Mourachko, Safiyyah Saleem, Holger Schwenk, Guillaume Wenzek

Proceedings of the Seventh Conference on Machine Translation, 2022

Modeling the Machine Learning Multiverse.

Samuel J. Bell, Onno Kampman, Jesse Dodge, Neil D. Lawrence

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Efficient Hierarchical Domain Adaptation for Pretrained Language Models.

Alexandra Chronopoulou, Matthew E. Peters, Jesse Dodge

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Staged Training for Transformer Language Models.

Sheng Shen, Pete Walsh, Kurt Keutzer, Jesse Dodge, Matthew E. Peters, Iz Beltagy

Proceedings of the International Conference on Machine Learning, 2022

Data Governance in the Age of Large-Scale Data-Driven Language Technology.

Yacine Jernite, Huu Nguyen, Stella Biderman, Anna Rogers, Maraim Masoud, Valentin Danchev, Samson Tan, Alexandra Sasha Luccioni, Nishant Subramani, Isaac Johnson, Gérard Dupont, Jesse Dodge, Kyle Lo, Zeerak Talat, Dragomir R. Radev, Aaron Gokaslan, Somaieh Nikpoor, Peter Henderson, Rishi Bommasani, Margaret Mitchell

Proceedings of the FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21, 2022

Measuring the Carbon Intensity of AI in Cloud Instances.

Jesse Dodge, Taylor Prewitt, Remi Tachet des Combes, Erika Odmark, Roy Schwartz, Emma Strubell, Alexandra Sasha Luccioni, Noah A. Smith, Nicole DeCario, Will Buchanan

Proceedings of the FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency, Seoul, Republic of Korea, June 21, 2022

Towards Reproducible Machine Learning Research in Natural Language Processing.

Ana Lucic, Maurits J. R. Bleeker, Samarth Bhargav, Jessica Zosa Forde, Koustuv Sinha, Jesse Dodge, Sasha Luccioni, Robert Stojnic

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, 2022

2021

Documenting the English Colossal Clean Crawled Corpus.

Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Matt Gardner

CoRR, 2021

Documenting Large Webtext Corpora: A Case Study on the Colossal Clean Crawled Corpus.

Jesse Dodge, Maarten Sap, Ana Marasovic, William Agnew, Gabriel Ilharco, Dirk Groeneveld, Margaret Mitchell, Matt Gardner

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Expected Validation Performance and Estimation of a Random Variable's Maximum.

Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Competency Problems: On Finding and Removing Artifacts in Language Data.

Matt Gardner, William Merrill, Jesse Dodge, Matthew E. Peters, Alexis Ross, Sameer Singh, Noah A. Smith

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

2020

Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping.

Jesse Dodge, Gabriel Ilharco, Roy Schwartz, Ali Farhadi, Hannaneh Hajishirzi, Noah A. Smith

CoRR, 2020

Green AI.

Roy Schwartz, Jesse Dodge, Noah A. Smith, Oren Etzioni

Commun. ACM, 2020

The Right Tool for the Job: Matching Model and Instance Complexities.

Roy Schwartz, Gabriel Stanovsky, Swabha Swayamdipta, Jesse Dodge, Noah A. Smith

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

RNN Architecture Learning with Sparse Regularization.

Jesse Dodge, Roy Schwartz, Hao Peng, Noah A. Smith

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Show Your Work: Improved Reporting of Experimental Results.

Jesse Dodge, Suchin Gururangan, Dallas Card, Roy Schwartz, Noah A. Smith

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2017

Random Search for Hyperparameters using Determinantal Point Processes.

Jesse Dodge, Catrìona Anderson, Noah A. Smith

CoRR, 2017

2016

Large Scale Retrieval and Generation of Image Descriptions.

Vicente Ordonez, Xufeng Han, Polina Kuznetsova, Girish Kulkarni, Margaret Mitchell, Kota Yamaguchi, Karl Stratos, Amit Goyal, Jesse Dodge, Alyssa C. Mensch, Hal Daumé III, Alexander C. Berg, Yejin Choi, Tamara L. Berg

Int. J. Comput. Vis., 2016

Evaluating Prerequisite Qualities for Learning End-to-End Dialog Systems.

Jesse Dodge, Andreea Gane, Xiang Zhang, Antoine Bordes, Sumit Chopra, Alexander H. Miller, Arthur Szlam, Jason Weston

Proceedings of the 4th International Conference on Learning Representations, 2016

Key-Value Memory Networks for Directly Reading Documents.

Alexander H. Miller, Adam Fisch, Jesse Dodge, Amir-Hossein Karimi, Antoine Bordes, Jason Weston

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016

2015

Retrofitting Word Vectors to Semantic Lexicons.

Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar, Chris Dyer, Eduard H. Hovy, Noah A. Smith

Proceedings of the NAACL HLT 2015, The 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Denver, Colorado, USA, May 31, 2015

2014

CMU: Arc-Factored, Discriminative Semantic Dependency Parsing.

Sam Thomson, Brendan O'Connor, Jeffrey Flanigan, David Bamman, Jesse Dodge, Swabha Swayamdipta, Nathan Schneider, Chris Dyer, Noah A. Smith

Proceedings of the 8th International Workshop on Semantic Evaluation, 2014

Context-dependent Semantic Parsing for Time Expressions.

Kenton Lee, Yoav Artzi, Jesse Dodge, Luke Zettlemoyer

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2012

Detecting Visual Text.

Jesse Dodge, Amit Goyal, Xufeng Han, Alyssa C. Mensch, Margaret Mitchell, Karl Stratos, Kota Yamaguchi, Yejin Choi, Hal Daumé III, Alexander C. Berg, Tamara L. Berg

Proceedings of the Human Language Technologies: Conference of the North American Chapter of the Association of Computational Linguistics, 2012

Midge: Generating Image Descriptions From Computer Vision Detections.

Margaret Mitchell, Jesse Dodge, Amit Goyal, Kota Yamaguchi, Karl Stratos, Xufeng Han, Alyssa C. Mensch, Alexander C. Berg, Tamara L. Berg, Hal Daumé III

Proceedings of the EACL 2012, 2012

Understanding and predicting importance in images.

Alexander C. Berg, Tamara L. Berg, Hal Daumé III, Jesse Dodge, Amit Goyal, Xufeng Han, Alyssa C. Mensch, Margaret Mitchell, Aneesh Sood, Karl Stratos, Kota Yamaguchi

Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, 2012