Turkish PoS Tagging by Reducing Sparsity with Morpheme Tags in Small Datasets. - Burcu Can; Ahmet Üstün; Murathan Kurfali (CICLing (1), 2016)

Unsupervised Morphological Segmentation Using Neural Word Embeddings. - Ahmet Üstün; Burcu Can (SLSP, 2016)

A Trie-structured Bayesian Model for Unsupervised Morphological Segmentation. - Murathan Kurfali; Ahmet Üstün; Burcu Can (CICLing (1), 2017)

Characters or Morphemes: How to Represent Words? - Ahmet Üstün; Murathan Kurfali; Burcu Can (Rep4NLP@ACL, 2018)

There and Back Again: Cross-Lingual Transfer Learning for Event Detection. - Tommaso Caselli; Ahmet Üstün (CLiC-it, 2019)

Cross-Lingual Word Embeddings for Morphologically Rich Languages. - Ahmet Üstün; Gosse Bouma; Gertjan van Noord (RANLP, 2019)

UDapter: Language Adaptation for Truly Universal Dependency Parsing. - Ahmet Üstün; Arianna Bisazza; Gosse Bouma; Gertjan van Noord (EMNLP (1), 2020)

FiSSA at SemEval-2020 Task 9: Fine-tuned for Feelings. - Bertelt Braaksma; Richard Scholtens; Stan van Suijlekom; Remy Wang; Ahmet Üstün (SemEval@COLING, 2020)

Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP. - Rob van der Goot; Ahmet Üstün; Alan Ramponi; Barbara Plank (CoRR, 2020)

Massive Choice, Ample Tasks (MaChAmp): A Toolkit for Multi-task Learning in NLP. - Rob van der Goot; Ahmet Üstün; Alan Ramponi; Ibrahim Sharaf; Barbara Plank (EACL (System Demonstrations), 2021)

Multilingual Unsupervised Neural Machine Translation with Denoising Adapters. - Ahmet Üstün; Alexandre Berard; Laurent Besacier; Matthias Gallé (EMNLP (1), 2021)

Automatic Judgement Forecasting for Pending Applications of the European Court of Human Rights. - Masha Medvedeva; Ahmet Üstün; Xiao Xu; Michel Vols; Martijn Wieling 001 (ASAIL/LegalAIIA@ICAIL, 2021)

From Masked Language Modeling to Translation: Non-English Auxiliary Tasks Improve Zero-shot Spoken Language Understanding. - Rob van der Goot; Ibrahim Sharaf; Aizhan Imankulova; Ahmet Üstün; Marija Stepanovic; Alan Ramponi; Siti Oryza Khairunnisa; Mamoru Komachi; Barbara Plank (NAACL-HLT, 2021)

Unsupervised Translation of German-Lower Sorbian: Exploring Training and Novel Transfer Methods on a Low-Resource Language. - Lukas Edman; Ahmet Üstün; Antonio Toral; Gertjan van Noord (WMT@EMNLP, 2021)

On the Effectiveness of Dataset Embeddings in Mono-lingual, Multi-lingual and Zero-shot Conditions. - Rob van der Goot; Ahmet Üstün; Barbara Plank (CoRR, 2021)

Incorporating word embeddings in unsupervised morphological segmentation. - Ahmet Üstün; Burcu Can (Nat. Lang. Eng., 2021)

On the Difficulty of Translating Free-Order Case-Marking Languages. - Arianna Bisazza; Ahmet Üstün; Stephan Sportel (Trans. Assoc. Comput. Linguistics, 2021)

Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. - Ahmet Üstün; Arianna Bisazza; Gosse Bouma; Gertjan van Noord; Sebastian Ruder (EMNLP, 2022)

When does Parameter-Efficient Transfer Learning Work for Machine Translation? - Ahmet Üstün; Asa Cooper Stickland (EMNLP, 2022)

UDapter: Typology-based Language Adapters for Multilingual Dependency Parsing and Sequence Labeling. - Ahmet Üstün; Arianna Bisazza; Gosse Bouma; Gertjan van Noord (Comput. Linguistics, 2022)

Intriguing Properties of Quantization at Scale. - Arash Ahmadian; Saurabh Dash; Hongyu Chen 008; Bharat Venkitesh; Stephen Zhen Gou; Phil Blunsom; Ahmet Üstün; Sara Hooker (NeurIPS, 2023)

Intriguing Properties of Quantization at Scale. - Arash Ahmadian; Saurabh Dash; Hongyu Chen 008; Bharat Venkitesh; Stephen Gou; Phil Blunsom; Ahmet Üstün; Sara Hooker (CoRR, 2023)

When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale. - Max Marion; Ahmet Üstün; Luiza Pozzobon; Alex Wang; Marzieh Fadaee; Sara Hooker (CoRR, 2023)

Back to Basics: Revisiting REINFORCE-Style Optimization for Learning from Human Feedback in LLMs. - Arash Ahmadian; Chris Cremer; Matthias Gallé; Marzieh Fadaee; Julia Kreutzer; Olivier Pietquin; Ahmet Üstün; Sara Hooker (ACL (1), 2024)

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. - Shivalika Singh; Freddie Vargus; Daniel D'souza; Börje Karlsson 001; Abinaya Mahendiran; Wei-Yin Ko; Herumb Shandilya; Jay Patel; Deividas Mataciunas; Laura O'Mahony; Mike Zhang; Ramith Hettiarachchi; et al. (ACL (1), 2024)

Aya Model: An Instruction Finetuned Open-Access Multilingual Language Model. - Ahmet Üstün; Viraat Aryabumi; Zheng Xin Yong; Wei-Yin Ko; Daniel D'souza; Gbemileke Onilude; Neel Bhandari; Shivalika Singh; Hui-Lee Ooi; Amr Kayid; Freddie Vargus; Phil Blunsom; et al. (ACL (1), 2024)

RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs. - John Dang; Arash Ahmadian; Kelly Marchisio; Julia Kreutzer; Ahmet Üstün; Sara Hooker (EMNLP, 2024)

How Does Quantization Affect Multilingual LLMs? - Kelly Marchisio; Saurabh Dash; Hongyu Chen 008; Dennis Aumiller; Ahmet Üstün; Sara Hooker; Sebastian Ruder (EMNLP (Findings), 2024)

Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning. - Ted Zadouri; Ahmet Üstün; Arash Ahmadian; Beyza Ermis; Acyr Locatelli; Sara Hooker (ICLR, 2024)

BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts. - Qizhen (Irene) Zhang; Nikolas Gritsch; Dwaraknath Gnaneshwar; Simon Guo 003; David Cairuz; Bharat Venkitesh; Jakob N. Foerster; Phil Blunsom; Sebastian Ruder; Ahmet Üstün; Acyr Locatelli (NeurIPS, 2024)

Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. - Shivalika Singh; Freddie Vargus; Daniel D'souza; Börje F. Karlsson; Abinaya Mahendiran; Wei-Yin Ko; Herumb Shandilya; Jay Patel; Deividas Mataciunas; Laura O'Mahony; Mike Zhang; Ramith Hettiarachchi; et al. (CoRR, 2024)

Aya 23: Open Weight Releases to Further Multilingual Progress. - Viraat Aryabumi; John Dang; Dwarak Talupuru; Saurabh Dash; David Cairuz; Hangyu Lin; Bharat Venkitesh; Madeline Smith; Jon Ander Campos; Yi Chern Tan; Kelly Marchisio; Max Bartolo; et al. (CoRR, 2024)

Nexus: Specialization meets Adaptability for Efficiently Training Mixture of Experts. - Nikolas Gritsch; Qizhen Zhang; Acyr Locatelli; Sara Hooker; Ahmet Üstün (CoRR, 2024)

MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions. - Abdullatif Köksal; Marion Thaler; Ayyoob Imani; Ahmet Üstün; Anna Korhonen; Hinrich Schütze (CoRR, 2024)

If You Can't Use Them, Recycle Them: Optimizing Merging at Scale Mitigates Performance Tradeoffs. - Muhammad Khalifa; Yi Chern Tan; Arash Ahmadian; Tom Hosking; Honglak Lee; Lu Wang 008; Ahmet Üstün; Tom Sherborne; Matthias Gallé (CoRR, 2024)

Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier. - John Dang; Shivalika Singh; Daniel D'souza; Arash Ahmadian; Alejandro Salamanca; Madeline Smith; Aidan Peppin; Sungjin Hong; Manoj Govindassamy; Terrence Zhao; Sandra Kublik; Meor Amer; et al. (CoRR, 2024)

To Code or Not To Code? Exploring Impact of Code in Pre-training. - Viraat Aryabumi; Yixuan Su; Raymond Ma; Adrien Morisot; Ivan Zhang; Acyr Locatelli; Marzieh Fadaee; Ahmet Üstün; Sara Hooker (ICLR, 2025)

When Personalization Meets Reality: A Multi-Faceted Analysis of Personalized Preference Learning. - Yijiang River Dong; Tiancheng Hu; Yinhong Liu; Ahmet Üstün; Nigel Collier (CoRR, 2025)

A Post-trainer's Guide to Multilingual Training Data: Uncovering Cross-lingual Transfer Dynamics. - Luísa Shimabucoro; Ahmet Üstün; Marzieh Fadaee; Sebastian Ruder (CoRR, 2025)

The Leaderboard Illusion. - Shivalika Singh; Yiyang Nan; Alex Wang; Daniel D'souza; Sayash Kapoor; Ahmet Üstün; Sanmi Koyejo; Yuntian Deng; Shayne Longpre; Noah Smith; Beyza Ermis; Marzieh Fadaee; et al. (CoRR, 2025)

Aya Vision: Advancing the Frontier of Multilingual Multimodality. - Saurabh Dash; Yiyang Nan; John Dang; Arash Ahmadian; Shivalika Singh; Madeline Smith; Bharat Venkitesh; Vlad Shmyhlo; Viraat Aryabumi; Walter Beller-Morales; Jeremy Pekmez; Jason Ozuzu; et al. (CoRR, 2025)

The Multilingual Divide and Its Impact on Global AI Safety. - Aidan Peppin; Julia Kreutzer; Alice Schoenauer Sebag; Kelly Marchisio; Beyza Ermis; John Dang; Samuel Cahyawijaya; Shivalika Singh; Seraphina Goldfarb-Tarrant; Viraat Aryabumi; Aakanksha; Wei-Yin Ko; et al. (CoRR, 2025)

One Tokenizer To Rule Them All: Emergent Language Plasticity via Multilingual Tokenizers. - Diana Abagyan; Alejandro Salamanca; Felipe Cruz-Salinas; Kris Cao; Hangyu Lin; Acyr Locatelli; Marzieh Fadaee; Ahmet Üstün; Sara Hooker (CoRR, 2025)

Treasure Hunt: Real-time Targeting of the Long Tail using Training-Time Markers. - Daniel D'souza; Julia Kreutzer; Adrien Morisot; Ahmet Üstün; Sara Hooker (CoRR, 2025)