A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (EMNLP, 2016)

INSIGHT-1 at SemEval-2016 Task 4: Convolutional Neural Networks for Sentiment Classification and Quantification. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (SemEval@NAACL-HLT, 2016)

INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (SemEval@NAACL-HLT, 2016)

An overview of gradient descent optimization algorithms. - Sebastian Ruder (CoRR, 2016)

Character-level and Multi-channel Convolutional Neural Networks for Large-scale Authorship Attribution. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (CoRR, 2016)

Towards a continuous modeling of natural language domains. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (CoRR, 2016)

Learning to select data for transfer learning with Bayesian Optimization. - Sebastian Ruder; Barbara Plank (EMNLP, 2017)

A survey of cross-lingual embedding models. - Sebastian Ruder (CoRR, 2017)

An Overview of Multi-Task Learning in Deep Neural Networks. - Sebastian Ruder (CoRR, 2017)

Sluice networks: Learning what to share between loosely related tasks. - Sebastian Ruder; Joachim Bingel; Isabelle Augenstein; Anders Søgaard (CoRR, 2017)

Knowledge Adaptation: Teaching to Adapt. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (CoRR, 2017)

Data Selection Strategies for Multi-Domain Sentiment Analysis. - Sebastian Ruder; Parsa Ghaffari; John G. Breslin (CoRR, 2017)

Strong Baselines for Neural Semi-Supervised Learning under Domain Shift. - Sebastian Ruder; Barbara Plank (ACL (1), 2018)

Universal Language Model Fine-tuning for Text Classification. - Jeremy Howard; Sebastian Ruder (ACL (1), 2018)

On the Limitations of Unsupervised Bilingual Dictionary Induction. - Anders Søgaard; Sebastian Ruder; Ivan Vulic (ACL (1), 2018)

Generalizing Procrustes Analysis for Better Bilingual Dictionary Induction. - Yova Kementchedjhieva; Sebastian Ruder; Ryan Cotterell; Anders Søgaard (CoNLL, 2018)

A Discriminative Latent-Variable Model for Bilingual Lexicon Induction. - Sebastian Ruder; Ryan Cotterell; Yova Kementchedjhieva; Anders Søgaard (EMNLP, 2018)

Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces. - Isabelle Augenstein; Sebastian Ruder; Anders Søgaard (NAACL-HLT, 2018)

360° Stance Detection. - Sebastian Ruder; John Glover; Afshin Mehrabani; Parsa Ghaffari (NAACL-HLT (Demonstrations), 2018)

Fine-tuned Language Models for Text Classification. - Jeremy Howard; Sebastian Ruder (CoRR, 2018)

Off-the-Shelf Unsupervised NMT. - Chris Hokamp; Sebastian Ruder; John Glover (CoRR, 2018)

Latent Multi-Task Architecture Learning. - Sebastian Ruder; Joachim Bingel; Isabelle Augenstein; Anders Søgaard (AAAI, 2019)

A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks. - Victor Sanh; Thomas Wolf 008; Sebastian Ruder (AAAI, 2019)

How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions. - Goran Glavas; Robert Litschko; Sebastian Ruder; Ivan Vulic (ACL (1), 2019)

Unsupervised Cross-Lingual Representation Learning. - Sebastian Ruder; Anders Søgaard; Ivan Vulic (ACL (4), 2019)

Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction. - Paula Czarnowska; Sebastian Ruder; Edouard Grave; Ryan Cotterell; Ann A. Copestake (EMNLP/IJCNLP (1), 2019)

MultiFiT: Efficient Multi-lingual Language Model Fine-tuning. - Julian Eisenschlos; Sebastian Ruder; Piotr Czapla; Marcin Kardas; Sylvain Gugger; Jeremy Howard (EMNLP/IJCNLP (1), 2019)

Transfer Learning in Natural Language Processing. - Sebastian Ruder; Matthew E. Peters; Swabha Swayamdipta; Thomas Wolf 008 (NAACL-HLT (Tutorial Abstracts), 2019)

Episodic Memory in Lifelong Language Learning. - Cyprien de Masson d'Autume; Sebastian Ruder; Lingpeng Kong; Dani Yogatama (NeurIPS, 2019)

To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks. - Matthew E. Peters; Sebastian Ruder; Noah A. Smith (RepL4NLP@ACL, 2019)

What do Deep Networks Like to Read? - Jonas Pfeiffer; Aishwarya Kamath; Iryna Gurevych; Sebastian Ruder (CoRR, 2019)

A Survey of Cross-lingual Word Embedding Models. - Sebastian Ruder; Ivan Vulic; Anders Søgaard (J. Artif. Intell. Res., 2019)

Cross-Lingual Word Embeddings - Anders Søgaard; Ivan Vulic; Sebastian Ruder; Manaal Faruqui (Morgan & Claypool Publishers, 2019)

On the Cross-lingual Transferability of Monolingual Representations. - Mikel Artetxe; Sebastian Ruder; Dani Yogatama (ACL, 2020)

A Call for More Rigor in Unsupervised Cross-lingual Learning. - Mikel Artetxe; Sebastian Ruder; Dani Yogatama; Gorka Labaka; Eneko Agirre (ACL, 2020)

Morphologically Aware Word-Level Translation. - Paula Czarnowska; Sebastian Ruder; Ryan Cotterell; Ann A. Copestake (COLING, 2020)

AxCell: Automatic Extraction of Results from Machine Learning Papers. - Marcin Kardas; Piotr Czapla; Pontus Stenetorp; Sebastian Ruder; Sebastian Riedel 001; Ross Taylor; Robert Stojnic (EMNLP (1), 2020)

AdapterHub: A Framework for Adapting Transformers. - Jonas Pfeiffer; Andreas Rücklé; Clifton Poth; Aishwarya Kamath; Ivan Vulic; Sebastian Ruder; Kyunghyun Cho; Iryna Gurevych (EMNLP (Demos), 2020)

MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer. - Jonas Pfeiffer; Ivan Vulic; Iryna Gurevych; Sebastian Ruder (EMNLP (1), 2020)

Are All Good Word Vector Spaces Isomorphic? - Ivan Vulic; Sebastian Ruder; Anders Søgaard (EMNLP (1), 2020)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. - Junjie Hu 001; Sebastian Ruder; Aditya Siddhant; Graham Neubig; Orhan Firat; Melvin Johnson (ICML, 2020)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization. - Junjie Hu 001; Sebastian Ruder; Aditya Siddhant; Graham Neubig; Orhan Firat; Melvin Johnson (CoRR, 2020)

Analogy Training Multilingual Encoders. - Nicolas Garneau; Mareike Hartmann; Anders Sandholm 001; Sebastian Ruder; Ivan Vulic; Anders Søgaard (AAAI, 2021)

Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks. - Rabeeh Karimi Mahabadi; Sebastian Ruder; Mostafa Dehghani 001; James Henderson 001 (ACL/IJCNLP (1), 2021)

How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. - Phillip Rust; Jonas Pfeiffer; Ivan Vulic; Sebastian Ruder; Iryna Gurevych (ACL/IJCNLP (1), 2021)

MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer. - Alan Ansell; Edoardo Maria Ponti; Jonas Pfeiffer; Sebastian Ruder; Goran Glavas; Ivan Vulic; Anna Korhonen (EMNLP (Findings), 2021)

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. - Samuel Cahyawijaya; Genta Indra Winata; Bryan Wilie; Karissa Vincentio; Xiaohong Li; Adhiguna Kuncoro; Sebastian Ruder; Zhi Yuan Lim; Syafri Bahar; Masayu Leylia Khodra; Ayu Purwarianti; Pascale Fung (EMNLP (1), 2021)

UNKs Everywhere: Adapting Multilingual Language Models to New Scripts. - Jonas Pfeiffer; Ivan Vulic; Iryna Gurevych; Sebastian Ruder (EMNLP (1), 2021)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. - Sebastian Ruder; Noah Constant; Jan A. Botha; Aditya Siddhant; Orhan Firat; Jinlan Fu; Pengfei Liu 003; Junjie Hu 001; Dan Garrette; Graham Neubig; Melvin Johnson (EMNLP (1), 2021)

Efficient Test Time Adapter Ensembling for Low-resource Language Varieties. - Xinyi Wang 001; Yulia Tsvetkov; Sebastian Ruder; Graham Neubig (EMNLP (Findings), 2021)

Rethinking Embedding Coupling in Pre-trained Language Models. - Hyung Won Chung; Thibault Févry; Henry Tsai; Melvin Johnson; Sebastian Ruder (ICLR, 2021)

Long Range Arena : A Benchmark for Efficient Transformers. - Yi Tay; Mostafa Dehghani 001; Samira Abnar; Yikang Shen; Dara Bahri; Philip Pham; Jinfeng Rao; Liu Yang; Sebastian Ruder; Donald Metzler (ICLR, 2021)

Multi-view Subword Regularization. - Xinyi Wang 001; Sebastian Ruder; Graham Neubig (NAACL-HLT, 2021)

LiRo: Benchmark and leaderboard for Romanian language tasks. - Stefan Daniel Dumitrescu; Petru Rebeja; Beáta Lorincz; Mihaela Gaman; Andrei-Marius Avram; Mihai Ilie; Andrei Pruteanu; Adriana Stan; Lorena Rosia; Cristina Iacobescu; Luciana Morogan; George Dima; et al. (NeurIPS Datasets and Benchmarks, 2021)

Mind the Gap: Assessing Temporal Generalization in Neural Language Models. - Angeliki Lazaridou; Adhiguna Kuncoro; Elena Gribovskaya; Devang Agrawal; Adam Liska; Tayfun Terzi; Mai Gimenez; Cyprien de Masson d'Autume; Tomás Kociský; Sebastian Ruder; Dani Yogatama; Kris Cao; et al. (NeurIPS, 2021)

Compacter: Efficient Low-Rank Hypercomplex Adapter Layers. - Rabeeh Karimi Mahabadi; James Henderson 001; Sebastian Ruder (NeurIPS, 2021)

Pitfalls of Static Language Modelling. - Angeliki Lazaridou; Adhiguna Kuncoro; Elena Gribovskaya; Devang Agrawal; Adam Liska; Tayfun Terzi; Mai Gimenez; Cyprien de Masson d'Autume; Sebastian Ruder; Dani Yogatama; Kris Cao; Tomás Kociský; et al. (CoRR, 2021)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. - Sebastian Ruder; Noah Constant; Jan A. Botha; Aditya Siddhant; Orhan Firat; Jinlan Fu; Pengfei Liu 003; Junjie Hu 001; Graham Neubig; Melvin Johnson (CoRR, 2021)

BERT memorisation and pitfalls in low-resource scenarios. - Michael Tänzer; Sebastian Ruder; Marek Rei (CoRR, 2021)

FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding. - Yanan Zheng; Jing Zhou; Yujie Qian; Ming Ding 004; Jian Li 015; Ruslan Salakhutdinov; Jie Tang 001; Sebastian Ruder; Zhilin Yang 001 (CoRR, 2021)

Balancing Average and Worst-case Accuracy in Multitask Learning. - Paul Michel; Sebastian Ruder; Dani Yogatama (CoRR, 2021)

NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation. - Kaustubh D. Dhole; Varun Gangal; Sebastian Gehrmann; Aadesh Gupta; Zhenhao Li; Saad Mahamood; Abinaya Mahendiran; Simon Mille; Ashish Srivastava; Samson Tan; Tongshuang Wu; Jascha Sohl-Dickstein; et al. (CoRR, 2021)

MasakhaNER: Named Entity Recognition for African Languages. - David Ifeoluwa Adelani; Jade Z. Abbott; Graham Neubig; Daniel D'souza; Julia Kreutzer; Constantine Lignos; Chester Palen-Michel; Happy Buzaaba; Shruti Rijhwani; Sebastian Ruder; Stephen Mayhew 002; Israel Abebe Azime; et al. (Trans. Assoc. Comput. Linguistics, 2021)

One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia. - Alham Fikri Aji; Genta Indra Winata; Fajri Koto; Samuel Cahyawijaya; Ade Romadhony; Rahmad Mahendra; Kemal Kurniawan; David Moeljadi; Radityo Eko Prasojo; Timothy Baldwin; Jey Han Lau; Sebastian Ruder (ACL (1), 2022)

Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold. - Sebastian Ruder; Ivan Vulic; Anders Søgaard (ACL (Findings), 2022)

Memorisation versus Generalisation in Pre-trained Language Models. - Michael Tänzer; Sebastian Ruder; Marek Rei (ACL (1), 2022)

Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation. - Xinyi Wang 001; Sebastian Ruder; Graham Neubig (ACL (1), 2022)

FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding. - Yanan Zheng; Jing Zhou; Yujie Qian; Ming Ding 004; Chonghua Liao; Li Jian; Ruslan Salakhutdinov; Jie Tang 001; Sebastian Ruder; Zhilin Yang 001 (ACL (1), 2022)

MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition. - David Ifeoluwa Adelani; Graham Neubig; Sebastian Ruder; Shruti Rijhwani; Michael Beukman; Chester Palen-Michel; Constantine Lignos; Jesujoba O. Alabi; Shamsuddeen Hassan Muhammad; Peter Nabende; Cheikh M. Bamba Dione; Andiswa Bukula; et al. (EMNLP, 2022)

Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. - Ahmet Üstün; Arianna Bisazza; Gosse Bouma; Gertjan van Noord; Sebastian Ruder (EMNLP, 2022)

ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. - Vamsi Aribandi; Yi Tay; Tal Schuster; Jinfeng Rao; Huaixiu Steven Zheng; Sanket Vaibhav Mehta; Honglei Zhuang; Vinh Q. Tran 002; Dara Bahri; Jianmo Ni; Jai Prakash Gupta 001; Kai Hui 001; et al. (ICLR, 2022)

Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. - Yi Tay; Vinh Q. Tran 002; Sebastian Ruder; Jai Prakash Gupta 001; Hyung Won Chung; Dara Bahri; Zhen Qin 001; Simon Baumgartner; Cong Yu 001; Donald Metzler (ICLR, 2022)

XTREME-S: Evaluating Cross-lingual Speech Representations. - Alexis Conneau; Ankur Bapna; Yu Zhang 033; Min Ma; Patrick von Platen; Anton Lozhkov; Colin Cherry; Ye Jia; Clara Rivera; Mihir Kale; Daan van Esch; Vera Axelrod; et al. (INTERSPEECH, 2022)

Writing System and Speaker Metadata for 2, 800+ Language Varieties. - Daan van Esch; Tamar Lucassen; Sebastian Ruder; Isaac Caswell; Clara Rivera (LREC, 2022)

NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis. - Shamsuddeen Hassan Muhammad; David Ifeoluwa Adelani; Sebastian Ruder; Ibrahim Said Ahmad; Idris Abdulmumin; Bello Shehu Bello; Monojit Choudhury; Chris Chinenye Emezue; Saheed Abdullahi Salahudeen; Aremu Anuoluwapo; Alípio Jeorge; Pavel Brazdil (CoRR, 2022)

Evaluating Inclusivity, Equity, and Accessibility of NLP Technology: A Case Study for Indian Languages. - Simran Khanuja; Sebastian Ruder; Partha P. Talukdar (CoRR, 2022)

NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages. - Genta Indra Winata; Alham Fikri Aji; Samuel Cahyawijaya; Rahmad Mahendra; Fajri Koto; Ade Romadhony; Kemal Kurniawan; David Moeljadi; Radityo Eko Prasojo; Pascale Fung; Timothy Baldwin; Jey Han Lau; et al. (CoRR, 2022)

NusaCrowd: Open Source Initiative for Indonesian NLP Resources. - Samuel Cahyawijaya; Holy Lovenia; Alham Fikri Aji; Genta Indra Winata; Bryan Wilie; Rahmad Mahendra; Christian Wibisono; Ade Romadhony; Karissa Vincentio; Fajri Koto; Jennifer Santoso; David Moeljadi; et al. (CoRR, 2022)

NusaCrowd: Open Source Initiative for Indonesian NLP Resources. - Samuel Cahyawijaya; Holy Lovenia; Alham Fikri Aji; Genta Indra Winata; Bryan Wilie; Fajri Koto; Rahmad Mahendra; Christian Wibisono; Ade Romadhony; Karissa Vincentio; Jennifer Santoso; David Moeljadi; et al. (ACL (Findings), 2023)

Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features. - Ester Hlavnova; Sebastian Ruder (ACL (1), 2023)

Evaluating the Diversity, Equity, and Inclusion of NLP Technology: A Case Study for Indian Languages. - Simran Khanuja; Sebastian Ruder; Partha Talukdar (EACL (Findings), 2023)

TaTA: A Multilingual Table-to-Text Dataset for African Languages. - Sebastian Gehrmann; Sebastian Ruder; Vitaly Nikolaev; Jan A. Botha; Michael Chavinda; Ankur P. Parikh; Clara Rivera (EMNLP (Findings), 2023)

AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages. - Shamsuddeen Hassan Muhammad; Idris Abdulmumin; Abinew Ali Ayele; Nedjma Ousidhoum; David Ifeoluwa Adelani; Seid Muhie Yimam; Ibrahim Said Ahmad; Meriem Beloucif; Saif M. Mohammad; Sebastian Ruder; Oumaima Hourrane; Alípio Jorge; et al. (EMNLP, 2023)

Evaluating and Modeling Attribution for Cross-Lingual Question Answering. - Benjamin Muller; John Wieting; Jonathan H. Clark; Tom Kwiatkowski; Sebastian Ruder; Livio Soares; Roee Aharoni; Jonathan Herzig; Xinyi Wang 001 (EMNLP, 2023)

Cross-lingual Open-Retrieval Question Answering for African Languages. - Odunayo Ogundepo; Tajuddeen Gwadabe; Clara Rivera; Jonathan H. Clark; Sebastian Ruder; David Ifeoluwa Adelani; Bonaventure Dossou; Abdou Aziz Diop; Claytone Sikasote; Gilles Hacheme; Happy Buzaaba; Ignatius Ezeani; et al. (EMNLP (Findings), 2023)

mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations. - Jonas Pfeiffer; Francesco Piccinno; Massimo Nicosia; Xinyi Wang 001; Machel Reid; Sebastian Ruder (EMNLP (Findings), 2023)

Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning. - Clifton Poth; Hannah Sterz; Indraneil Paul; Sukannya Purkayastha; Leon Engländer; Timo Imhof; Ivan Vulic; Sebastian Ruder; Iryna Gurevych; Jonas Pfeiffer (EMNLP (Demos), 2023)

Romanization-based Large-scale Adaptation of Multilingual Language Models. - Sukannya Purkayastha; Sebastian Ruder; Jonas Pfeiffer; Iryna Gurevych; Ivan Vulic (EMNLP (Findings), 2023)

XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. - Sebastian Ruder; Jonathan H. Clark; Alexander Gutkin; Mihir Kale; Min Ma; Massimo Nicosia; Shruti Rijhwani; Parker Riley; Jean Michel A. Sarr; Xinyi Wang 001; John Wieting; Nitish Gupta; et al. (EMNLP (Findings), 2023)

Language models are multilingual chain-of-thought reasoners. - Freda Shi; Mirac Suzgun; Markus Freitag; Xuezhi Wang 002; Suraj Srivats; Soroush Vosoughi; Hyung Won Chung; Yi Tay; Sebastian Ruder; Denny Zhou; Dipanjan Das 001; Jason Wei (ICLR, 2023)

SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval). - Shamsuddeen Hassan Muhammad; Idris Abdulmumin; Seid Muhie Yimam; David Ifeoluwa Adelani; Ibrahim Said Ahmad; Nedjma Ousidhoum; Abinew Ali Ayele; Saif M. Mohammad; Meriem Beloucif; Sebastian Ruder (SemEval@ACL, 2023)

AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages. - Shamsuddeen Hassan Muhammad; Idris Abdulmumin; Abinew Ali Ayele; Nedjma Ousidhoum; David Ifeoluwa Adelani; Seid Muhie Yimam; Ibrahim Said Ahmad; Meriem Beloucif; Saif M. Mohammad; Sebastian Ruder; Oumaima Hourrane; Pavel Brazdil; et al. (CoRR, 2023)

AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages. - Odunayo Ogundepo; Tajuddeen R. Gwadabe; Clara E. Rivera; Jonathan H. Clark; Sebastian Ruder; David Ifeoluwa Adelani; Bonaventure F. P. Dossou; Abdou Aziz Diop; Claytone Sikasote; Gilles Hacheme; Happy Buzaaba; Ignatius Ezeani; et al. (CoRR, 2023)

PaLM 2 Technical Report. - Rohan Anil; Andrew M. Dai; Orhan Firat; Melvin Johnson; Dmitry Lepikhin; Alexandre Passos; Siamak Shakeri; Emanuel Taropa; Paige Bailey; Zhifeng Chen; Eric Chu; Jonathan H. Clark; et al. (CoRR, 2023)

Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization. - Alexandra Chronopoulou; Jonas Pfeiffer; Joshua Maynez; Xinyi Wang 001; Sebastian Ruder; Priyanka Agrawal (CoRR, 2023)

QAmeleon: Multilingual QA with Only 5 Examples. - Priyanka Agrawal; Chris Alberti; Fantine Huot; Joshua Maynez; Ji Ma 004; Sebastian Ruder; Kuzman Ganchev; Dipanjan Das 001; Mirella Lapata (Trans. Assoc. Comput. Linguistics, 2023)

Modular Deep Learning. - Jonas Pfeiffer; Sebastian Ruder; Ivan Vulic; Edoardo M. Ponti (Trans. Mach. Learn. Res., 2023)

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. - Shivalika Singh; Freddie Vargus; Daniel D'souza; Börje Karlsson 001; Abinaya Mahendiran; Wei-Yin Ko; Herumb Shandilya; Jay Patel; Deividas Mataciunas; Laura O'Mahony; Mike Zhang; Ramith Hettiarachchi; et al. (ACL (1), 2024)

Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages. - Daan van Esch; Sandy Ritchie; Sebastian Ruder; Julia Kreutzer; Clara Rivera; Ishank Saxena; Isaac Caswell (LREC/COLING, 2024)

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages. - Holy Lovenia; Rahmad Mahendra; Salsabil Maulana Akbar; Lester James V. Miranda; Jennifer Santoso; Elyanah Aco; Akhdan Fadhilah; Jonibek Mansurov; Joseph Marvin Imperial; Onno Kampman; Joel Ruben Antony Moniz; Muhammad Ravi Shulthan Habibi; et al. (EMNLP, 2024)

How Does Quantization Affect Multilingual LLMs? - Kelly Marchisio; Saurabh Dash; Hongyu Chen 008; Dennis Aumiller; Ahmet Üstün; Sara Hooker; Sebastian Ruder (EMNLP (Findings), 2024)

Understanding and Mitigating Language Confusion in LLMs. - Kelly Marchisio; Wei-Yin Ko; Alexandre Berard; Théo Dehaze; Sebastian Ruder (EMNLP, 2024)

LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives. - Luísa Shimabucoro; Sebastian Ruder; Julia Kreutzer; Marzieh Fadaee; Sara Hooker (EMNLP, 2024)

BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer. - Akari Asai; Sneha Kudugunta; Xinyan Yu 001; Terra Blevins; Hila Gonen; Machel Reid; Yulia Tsvetkov; Sebastian Ruder; Hannaneh Hajishirzi (NAACL-HLT, 2024)

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts. - Qizhen (Irene) Zhang; Nikolas Gritsch; Dwaraknath Gnaneshwar; Simon Guo 003; David Cairuz; Bharat Venkitesh; Jakob N. Foerster; Phil Blunsom; Sebastian Ruder; Ahmet Üstün; Acyr Locatelli (NeurIPS, 2024)

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. - Shivalika Singh; Freddie Vargus; Daniel D'souza; Börje F. Karlsson; Abinaya Mahendiran; Wei-Yin Ko; Herumb Shandilya; Jay Patel; Deividas Mataciunas; Laura O'Mahony; Mike Zhang; Ramith Hettiarachchi; et al. (CoRR, 2024)

Aya 23: Open Weight Releases to Further Multilingual Progress. - Viraat Aryabumi; John Dang; Dwarak Talupuru; Saurabh Dash; David Cairuz; Hangyu Lin; Bharat Venkitesh; Madeline Smith; Jon Ander Campos; Yi Chern Tan; Kelly Marchisio; Max Bartolo; et al. (CoRR, 2024)

SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages. - Holy Lovenia; Rahmad Mahendra; Salsabil Maulana Akbar; Lester James V. Miranda; Jennifer Santoso; Elyanah Aco; Akhdan Fadhilah; Jonibek Mansurov; Joseph Marvin Imperial; Onno Pepijn Kampman; Joel Ruben Antony Moniz; Muhammad Ravi Shulthan Habibi; et al. (CoRR, 2024)

LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives. - Luísa Shimabucoro; Sebastian Ruder; Julia Kreutzer; Marzieh Fadaee; Sara Hooker (CoRR, 2024)

M-RewardBench: Evaluating Reward Models in Multilingual Settings. - Srishti Gureja; Lester James Validad Miranda; Shayekh Bin Islam; Rishabh Maheshwary; Drishti Sharma; Gusti Triandi Winata; Nathan Lambert 001; Sebastian Ruder; Sara Hooker; Marzieh Fadaee (ACL (1), 2025)

Arbiters of Ambivalence: Challenges of using LLMs in No-Consensus tasks. - Bhaktipriya Radharapu; Manon Revel; Megan Ung; Sebastian Ruder; Adina Williams (ACL (Findings), 2025)

AL-QASIDA: Analyzing LLM Quality and Accuracy Systematically in Dialectal Arabic. - Nathaniel Romney Robinson; Shahd Abdelmoneim; Kelly Marchisio; Sebastian Ruder (ACL (Findings), 2025)

Global MMLU: Understanding and Addressing Cultural and Linguistic Biases in Multilingual Evaluation. - Shivalika Singh; Angelika Romanou; Clémentine Fourrier; David Ifeoluwa Adelani; Jian Gang Ngui; Daniel Vila-Suero; Peerat Limkonchotiwat; Kelly Marchisio; Wei Qi Leong; Yosephine Susanto; Raymond Ng; Shayne Longpre; et al. (ACL (1), 2025)

A Post-trainer's Guide to Multilingual Training Data: Uncovering Cross-lingual Transfer Dynamics. - Luísa Shimabucoro; Ahmet Üstün; Marzieh Fadaee; Sebastian Ruder (CoRR, 2025)

The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs. - Piotr Nawrot; Robert Li; Renjie Huang; Sebastian Ruder; Kelly Marchisio; Edoardo M. Ponti (CoRR, 2025)