Mesh learning approach for brain data modeling. - Orhan Firat; Mete Ozay; Itir Önal; Ilke Öztekin; Fatos T. Yarman-Vural (SIU, 2012)

Application of context invariants in airport region of interest detection for multi-spectral satellite imagery. - Orhan Firat; Okan Tarhan Tursun; Fatos T. Yarman-Vural (SIU, 2012)

Conditional Random Fields for Land Use/Land Cover Classification and Complex Region Detection. - Gulcan Can; Orhan Firat; Fatos Tünay Yarman Vural (SSPR/SPR, 2012)

Functional Mesh Learning for pattern analysis of cognitive processes. - Orhan Firat; Mete Ozay; Itir Onal; Ilke Öztekin; Fatos T. Yarman-Vural (ICCI*CC, 2013)

An information theoretic approach to classify cognitive states using fMRI. - Itir Onal; Mete Ozay; Orhan Firat; Ilke Öztekin; Fatos T. Yarman-Vural (BIBE, 2013)

Representation of cognitive processes using the minimum spanning tree of local meshes. - Orhan Firat; Mete Ozay; Itir Onal; Ilke Öztekin; Fatos Tünay Yarman Vural (EMBC, 2013)

Analyzing the information distribution in the fMRI measurements by estimating the degree of locality. - Itir Onal; Mete Ozay; Orhan Firat; Ilke Öztekin; Fatos Tünay Yarman Vural (EMBC, 2013)

Mesh learning for object classification using fMRI measurements. - Omer Ekmekci; Orhan Firat; Mete Ozay; Ilke Öztekin; Fatos T. Yarman-Vural; Uygar Öztekin (ICIP, 2013)

Dry dock detection in satellite images with representation learning. - Ümit Rusen Aktas; Orhan Firat; Fatos T. Yarman-Vural (SIU, 2013)

Contextual object recoğnition with conditional random fields. - Gulcan Can; Orhan Firat; Fatos T. Yarman-Vural (SIU, 2013)

Cognitive process representation with minimum spanning tree of local meshes. - Orhan Firat; Mete Ozay; Itir Önal; Ilke Öztekin; Fatos T. Yarman-Vural (SIU, 2013)

Representation learning with convolutional sparse autoencoders for remote sensing. - Orhan Firat; Fatos T. Yarman-Vural (SIU, 2013)

Information distribution analysis in the fMRI measurements with degree of locality estimation. - Itir Önal; Mete Ozay; Orhan Firat; Ilke Öztekin; Fatos T. Yarman-Vural (SIU, 2013)

Enhancing Local Linear Models Using Functional Connectivity for Brain State Decoding. - Orhan Firat; Mete Özay; Itir Önal; Ilke Öztekin; Fatos T. Yarman-Vural (Int. J. Cogn. Informatics Nat. Intell., 2013)

Functional networks of anatomic brain regions. - Burak Velioglu; Emre Aksan; Itir Onal; Orhan Firat; Mete Ozay; Fatos T. Yarman-Vural (ICCI*CC, 2014)

Deep learning for brain decoding. - Orhan Firat; Like Oztekin; Fatos T. Yarman-Vural (ICIP, 2014)

Representation Learning for Contextual Object and Region Detection in Remote Sensing. - Orhan Firat; Gulcan Can; Fatos T. Yarman-Vural (ICPR, 2014)

Modeling the Brain Connectivity for Pattern Analysis. - Itir Onal; Emre Aksan; Burak Velioglu; Orhan Firat; Mete Ozay; Ilke Öztekin; Fatos T. Yarman-Vural (ICPR, 2014)

Estimating brain connectivity for pattern analysis. - Itir Önal; Emre Aksan; Burak Velioglu; Orhan Firat; Mete Ozay; Like Oztekin; Fatos T. Yarman-Vural (SIU, 2014)

Learning Deep Temporal Representations for fMRI Brain Decoding. - Orhan Firat; Emre Aksan; Ilke Öztekin; Fatos T. Yarman-Vural (MLMMI@ICML, 2015)

Bilişsel durum analizi i in beyin Aği modeli. - Itir Onal; Emre Aksan; Burak Velioglu; Orhan Firat; Mete Ozay; Fatos T. Yarman-Vural (SIU, 2015)

Montreal Neural Machine Translation Systems for WMT'15. - Sébastien Jean; Orhan Firat; Kyunghyun Cho; Roland Memisevic; Yoshua Bengio (WMT@EMNLP, 2015)

On Using Monolingual Corpora in Neural Machine Translation. - Çaglar Gülçehre; Orhan Firat; Kelvin Xu; Kyunghyun Cho; Loïc Barrault; Huei-Chi Lin; Fethi Bougares; Holger Schwenk; Yoshua Bengio (CoRR, 2015)

Zero-Resource Translation with Multi-Lingual Neural Machine Translation. - Orhan Firat; Baskaran Sankaran; Yaser Al-Onaizan; Fatos T. Yarman-Vural; Kyunghyun Cho (EMNLP, 2016)

Multi-Way, Multilingual Neural Machine Translation with a Shared Attention Mechanism. - Orhan Firat; Kyunghyun Cho; Yoshua Bengio (HLT-NAACL, 2016)

Theano: A Python framework for fast computation of mathematical expressions. - Rami Al-Rfou; Guillaume Alain; Amjad Almahairi; Christof Angermüller; Dzmitry Bahdanau; Nicolas Ballas; Frédéric Bastien; Justin Bayer; Anatoly Belikov; Alexander Belopolsky; Yoshua Bengio; Arnaud Bergeron; et al. (CoRR, 2016)

Neural Machine Translation for Cross-Lingual Pronoun Prediction. - Sébastien Jean; Stanislas Lauly; Orhan Firat; Kyunghyun Cho (DiscoMT@EMNLP, 2017)

Nematus: a Toolkit for Neural Machine Translation. - Rico Sennrich; Orhan Firat; Kyunghyun Cho; Alexandra Birch; Barry Haddow; Julian Hitschler; Marcin Junczys-Dowmunt; Samuel Läubli; Antonio Valerio Miceli Barone; Jozef Mokry; Maria Nadejde (EACL (Software Demonstrations), 2017)

Does Neural Machine Translation Benefit from Larger Context? - Sébastien Jean; Stanislas Lauly; Orhan Firat; Kyunghyun Cho (CoRR, 2017)

Learning Joint Multilingual Sentence Representations with Neural Machine Translation. - Holger Schwenk; Ke M. Tran; Orhan Firat; Matthijs Douze (CoRR, 2017)

Multi-way, multilingual neural machine translation. - Orhan Firat; Kyunghyun Cho; Baskaran Sankaran; Fatos T. Yarman-Vural; Yoshua Bengio (Comput. Speech Lang., 2017)

On integrating a language model into neural machine translation. - Çaglar Gülçehre; Orhan Firat; Kelvin Xu; Kyunghyun Cho; Yoshua Bengio (Comput. Speech Lang., 2017)

Connectionist multi-sequence modelling and applications to multilingual neural machine translation ; Bağlantıcı çoklu dizi modelleme ve çok dilli nöral makina çevirisi uygulamaları. - Orhan Firat (2017)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Mike Schuster; Noam Shazeer; Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; et al. (ACL (1), 2018)

Training Deeper Neural Machine Translation Models with Transparent Attention. - Ankur Bapna; Mia Xu Chen; Orhan Firat; Yuan Cao 007; Yonghui Wu (EMNLP, 2018)

Revisiting Character-Based Neural Machine Translation with Capacity and Compression. - Colin Cherry; George F. Foster; Ankur Bapna; Orhan Firat; Wolfgang Macherey (EMNLP, 2018)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Niki Parmar; Mike Schuster; Zhifeng Chen; Yonghui Wu; Macduff Hughes (CoRR, 2018)

Zero-Shot Cross-lingual Classification Using Multilingual Neural Machine Translation. - Akiko Eriguchi; Melvin Johnson; Orhan Firat; Hideto Kazawa; Wolfgang Macherey (CoRR, 2018)

On the Importance of Word Boundaries in Character-level Neural Machine Translation. - Duygu Ataman; Orhan Firat; Mattia Antonino Di Gangi; Marcello Federico; Alexandra Birch (NGT@EMNLP-IJCNLP, 2019)

Simple, Scalable Adaptation for Neural Machine Translation. - Ankur Bapna; Orhan Firat (EMNLP/IJCNLP (1), 2019)

Investigating Multilingual NMT Representations at Scale. - Sneha Reddy Kudugunta; Ankur Bapna; Isaac Caswell; Orhan Firat (EMNLP/IJCNLP (1), 2019)

Massively Multilingual Neural Machine Translation. - Roee Aharoni; Melvin Johnson; Orhan Firat (NAACL-HLT (1), 2019)

Non-Parametric Adaptation for Neural Machine Translation. - Ankur Bapna; Orhan Firat (NAACL-HLT (1), 2019)

GPipe: Efficient Training of Giant Neural Networks using Pipeline Parallelism. - Yanping Huang; Youlong Cheng; Ankur Bapna; Orhan Firat; Dehao Chen; Mia Xu Chen; HyoukJoong Lee; Jiquan Ngiam; Quoc V. Le; Yonghui Wu; Zhifeng Chen (NeurIPS, 2019)

Findings of the First Shared Task on Machine Translation Robustness. - Xian Li 003; Paul Michel; Antonios Anastasopoulos; Yonatan Belinkov; Nadir Durrani; Orhan Firat; Philipp Koehn; Graham Neubig; Juan Miguel Pino; Hassan Sajjad 001 (WMT (2), 2019)

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. - Jonathan Shen; Patrick Nguyen; Yonghui Wu; Zhifeng Chen; Mia Xu Chen; Ye Jia; Anjuli Kannan; Tara N. Sainath; Yuan Cao 007; Chung-Cheng Chiu; Yanzhang He; Jan Chorowski; et al. (CoRR, 2019)

The Missing Ingredient in Zero-Shot Neural Machine Translation. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Roee Aharoni; Melvin Johnson; Wolfgang Macherey (CoRR, 2019)

Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges. - Naveen Arivazhagan; Ankur Bapna; Orhan Firat; Dmitry Lepikhin; Melvin Johnson; Maxim Krikun; Mia Xu Chen; Yuan Cao 007; George F. Foster; Colin Cherry; Wolfgang Macherey; Zhifeng Chen; et al. (CoRR, 2019)

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. - Aditya Siddhant; Melvin Johnson; Henry Tsai; Naveen Arivazhagan; Jason Riesa; Ankur Bapna; Orhan Firat; Karthik Raman 001 (CoRR, 2019)

Investigating Multilingual NMT Representations at Scale. - Sneha Reddy Kudugunta; Ankur Bapna; Isaac Caswell; Naveen Arivazhagan; Orhan Firat (CoRR, 2019)

Adaptive Scheduling for Multi-Task Learning. - Sébastien Jean; Orhan Firat; Melvin Johnson (CoRR, 2019)

Simple, Scalable Adaptation for Neural Machine Translation. - Ankur Bapna; Naveen Arivazhagan; Orhan Firat (CoRR, 2019)

Fill in the Blanks: Imputing Missing Sentences for Larger-Context Neural Machine Translation. - Sébastien Jean; Ankur Bapna; Orhan Firat (CoRR, 2019)

Evaluating the Cross-Lingual Effectiveness of Massively Multilingual Neural Machine Translation. - Aditya Siddhant; Melvin Johnson; Henry Tsai; Naveen Ari; Jason Riesa; Ankur Bapna; Orhan Firat; Karthik Raman 001 (AAAI, 2020)

On the Discrepancy between Density Estimation and Sequence Generation. - Jason Lee 002; Dustin Tran; Orhan Firat; Kyunghyun Cho (SPNLP@EMNLP, 2020)

Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation. - Aditya Siddhant; Ankur Bapna; Yuan Cao 007; Orhan Firat; Mia Xu Chen; Sneha Reddy Kudugunta; Naveen Arivazhagan; Yonghui Wu (ACL, 2020)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. - Junjie Hu 001; Sebastian Ruder; Aditya Siddhant; Graham Neubig; Orhan Firat; Melvin Johnson (ICML, 2020)

Complete Multilingual Neural Machine Translation. - Markus Freitag; Orhan Firat (WMT@EMNLP, 2020)

Controlling Computation versus Quality for Neural Sequence Models. - Ankur Bapna; Naveen Arivazhagan; Orhan Firat (CoRR, 2020)

XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization. - Junjie Hu 001; Sebastian Ruder; Aditya Siddhant; Graham Neubig; Orhan Firat; Melvin Johnson (CoRR, 2020)

Towards End-to-End In-Image Neural Machine Translation. - Elman Mansimov; Mitchell Stern; Mia Xu Chen; Orhan Firat; Jakob Uszkoreit; Puneet Jain (CoRR, 2020)

Rapid Domain Adaptation for Machine Translation with Monolingual Data. - Mahdis Mahdieh; Mia Xu Chen; Yuan Cao 007; Orhan Firat (CoRR, 2020)

Beyond Distillation: Task-level Mixture-of-Experts for Efficient Inference. - Sneha Kudugunta; Yanping Huang; Ankur Bapna; Maxim Krikun; Dmitry Lepikhin; Minh-Thang Luong; Orhan Firat (EMNLP (Findings), 2021)

A Large-Scale Study of Machine Translation in Turkic Languages. - Jamshidbek Mirzakhalov; Anoop Babu; Duygu Ataman; Sherzod Kariev; Francis M. Tyers; Otabek Abduraufov; Mammad Hajili; Sardana Ivanova; Abror Khaytbaev; Antonio Laverghetta Jr.; Behzodbek Moydinboyev; Esra Onal; et al. (EMNLP (1), 2021)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. - Sebastian Ruder; Noah Constant; Jan A. Botha; Aditya Siddhant; Orhan Firat; Jinlan Fu; Pengfei Liu 003; Junjie Hu 001; Dan Garrette; Graham Neubig; Melvin Johnson (EMNLP (1), 2021)

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding. - Dmitry Lepikhin; HyoukJoong Lee; Yuanzhong Xu; Dehao Chen; Orhan Firat; Yanping Huang; Maxim Krikun; Noam Shazeer; Zhifeng Chen (ICLR, 2021)

Gradient Vaccine: Investigating and Improving Multi-task Optimization in Massively Multilingual Models. - Zirui Wang; Yulia Tsvetkov; Orhan Firat; Yuan Cao 007 (ICLR, 2021)

Share or Not? Learning to Schedule Language-Specific Capacity for Multilingual Translation. - Biao Zhang 006; Ankur Bapna; Rico Sennrich; Orhan Firat (ICLR, 2021)

Towards Continual Learning for Multilingual Machine Translation via Vocabulary Substitution. - Xavier Garcia; Noah Constant; Ankur P. Parikh; Orhan Firat (NAACL-HLT, 2021)

Harnessing Multilinguality in Unsupervised Machine Translation for Rare Languages. - Xavier Garcia; Aditya Siddhant; Orhan Firat; Ankur P. Parikh (NAACL-HLT, 2021)

Explicit Alignment Objectives for Multilingual Bidirectional Encoders. - Junjie Hu 001; Melvin Johnson; Orhan Firat; Aditya Siddhant; Graham Neubig (NAACL-HLT, 2021)

Evaluating Multiway Multilingual NMT in the Turkic Languages. - Jamshidbek Mirzakhalov; Anoop Babu; Aigiz Kunafin; Ahsan Wahab; Behzodbek Moydinboyev; Sardana Ivanova; Mokhiyakhon Uzokova; Shaxnoza Pulatova; Duygu Ataman; Julia Kreutzer; Francis M. Tyers; Orhan Firat; et al. (WMT@EMNLP, 2021)

Gradient-guided Loss Masking for Neural Machine Translation. - Xinyi Wang 001; Ankur Bapna; Melvin Johnson; Orhan Firat (CoRR, 2021)

XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. - Sebastian Ruder; Noah Constant; Jan A. Botha; Aditya Siddhant; Orhan Firat; Jinlan Fu; Pengfei Liu 003; Junjie Hu 001; Graham Neubig; Melvin Johnson (CoRR, 2021)

Towards Universality in Multilingual Text Rewriting. - Xavier Garcia; Noah Constant; Mandy Guo; Orhan Firat (CoRR, 2021)

Evaluating Multiway Multilingual NMT in the Turkic Languages. - Jamshidbek Mirzakhalov; Anoop Babu; Aigiz Kunafin; Ahsan Wahab; Behzod Moydinboyev; Sardana Ivanova; Mokhiyakhon Uzokova; Shaxnoza Pulatova; Duygu Ataman; Julia Kreutzer; Francis M. Tyers; Orhan Firat; et al. (CoRR, 2021)

Towards Zero-Label Language Learning. - Zirui Wang; Adams Wei Yu; Orhan Firat; Yuan Cao 007 (CoRR, 2021)

A Loss Curvature Perspective on Training Instability in Deep Learning. - Justin Gilmer; Behrooz Ghorbani; Ankush Garg; Sneha Kudugunta; Behnam Neyshabur; David Cardoze; George E. Dahl; Zachary Nado; Orhan Firat (CoRR, 2021)

Multilingual Mix: Example Interpolation Improves Multilingual Neural Machine Translation. - Yong Cheng; Ankur Bapna; Orhan Firat; Yuan Cao 007; Pidong Wang; Wolfgang Macherey (ACL (1), 2022)

Multilingual Document-Level Translation Enables Zero-Shot Transfer From Sentences to Documents. - Biao Zhang 006; Ankur Bapna; Melvin Johnson; Ali Dabirmoghaddam; Naveen Arivazhagan; Orhan Firat (ACL (1), 2022)

Scaling Laws for Neural Machine Translation. - Behrooz Ghorbani; Orhan Firat; Markus Freitag; Ankur Bapna; Maxim Krikun; Xavier Garcia; Ciprian Chelba; Colin Cherry (ICLR, 2022)

A Loss Curvature Perspective on Training Instabilities of Deep Learning Models. - Justin Gilmer; Behrooz Ghorbani; Ankush Garg; Sneha Kudugunta; Behnam Neyshabur; David Cardoze; George Edward Dahl; Zachary Nado; Orhan Firat (ICLR, 2022)

Data Scaling Laws in NMT: The Effect of Noise and Architecture. - Yamini Bansal; Behrooz Ghorbani; Ankush Garg; Biao Zhang 006; Colin Cherry; Behnam Neyshabur; Orhan Firat (ICML, 2022)

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. - Nan Du 002; Yanping Huang; Andrew M. Dai; Simon Tong; Dmitry Lepikhin; Yuanzhong Xu; Maxim Krikun; Yanqi Zhou; Adams Wei Yu; Orhan Firat; Barret Zoph; Liam Fedus; et al. (ICML, 2022)

Examining Scaling and Transfer of Language Model Architectures for Machine Translation. - Biao Zhang 006; Behrooz Ghorbani; Ankur Bapna; Yong Cheng; Xavier Garcia; Jonathan Shen; Orhan Firat (ICML, 2022)

XTREME-S: Evaluating Cross-lingual Speech Representations. - Alexis Conneau; Ankur Bapna; Yu Zhang 033; Min Ma; Patrick von Platen; Anton Lozhkov; Colin Cherry; Ye Jia; Clara Rivera; Mihir Kale; Daan van Esch; Vera Axelrod; et al. (INTERSPEECH, 2022)

Do Current Multi-Task Optimization Methods in Deep Learning Even Help? - Derrick Xin; Behrooz Ghorbani; Justin Gilmer; Ankush Garg; Orhan Firat (NeurIPS, 2022)

Towards the Next 1000 Languages in Multilingual Machine Translation: Exploring the Synergy Between Supervised and Self-Supervised Learning. - Aditya Siddhant; Ankur Bapna; Orhan Firat; Yuan Cao 007; Mia Xu Chen; Isaac Caswell; Xavier Garcia (CoRR, 2022)

Data Scaling Laws in NMT: The Effect of Noise and Architecture. - Yamini Bansal; Behrooz Ghorbani; Ankush Garg; Biao Zhang 006; Maxim Krikun; Colin Cherry; Behnam Neyshabur; Orhan Firat (CoRR, 2022)

Using natural language prompts for machine translation. - Xavier Garcia; Orhan Firat (CoRR, 2022)

Building Machine Translation Systems for the Next Thousand Languages. - Ankur Bapna; Isaac Caswell; Julia Kreutzer; Orhan Firat; Daan van Esch; Aditya Siddhant; Mengmeng Niu; Pallavi Baljekar; Xavier Garcia; Wolfgang Macherey; Theresa Breiner; Vera Axelrod; et al. (CoRR, 2022)

Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets. - Julia Kreutzer; Isaac Caswell; Lisa Wang; Ahsan Wahab; Daan van Esch; Nasanbayar Ulzii-Orshikh; Allahsera Tapo; Nishant Subramani; Artem Sokolov; Claytone Sikasote; Monang Setyawan; Supheakmungkol Sarin; et al. (Trans. Assoc. Comput. Linguistics, 2022)

GATITOS: Using a New Multilingual Lexicon for Low-resource Machine Translation. - Alexander Jones; Isaac Caswell; Orhan Firat; Ishank Saxena (EMNLP, 2023)

UniMax: Fairer and More Effective Language Sampling for Large-Scale Multilingual Pretraining. - Hyung Won Chung; Xavier Garcia; Adam Roberts; Yi Tay; Orhan Firat; Sharan Narang; Noah Constant (ICLR, 2023)

Scaling Laws for Multilingual Neural Machine Translation. - Patrick Fernandes; Behrooz Ghorbani; Xavier Garcia; Markus Freitag; Orhan Firat (ICML, 2023)

The Unreasonable Effectiveness of Few-shot Learning for Machine Translation. - Xavier Garcia; Yamini Bansal; Colin Cherry; George F. Foster; Maxim Krikun; Melvin Johnson; Orhan Firat (ICML, 2023)

Interactive-Chain-Prompting: Ambiguity Resolution for Crosslingual Conditional Generation with Interaction. - Jonathan Pilault; Xavier Garcia; Arthur Brazinskas; Orhan Firat (IJCNLP (1), 2023)

Binarized Neural Machine Translation. - Yichi Zhang 006; Ankush Garg; Yuan Cao; Lukasz Lew; Behrooz Ghorbani; Zhiru Zhang; Orhan Firat (NeurIPS, 2023)

Order Matters in the Presence of Dataset Imbalance for Multilingual Learning. - Dami Choi; Derrick Xin; Hamid Dadkhahi; Justin Gilmer; Ankush Garg; Orhan Firat; Chih-Kuan Yeh; Andrew M. Dai; Behrooz Ghorbani (NeurIPS, 2023)

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset. - Sneha Kudugunta; Isaac Caswell; Biao Zhang 006; Xavier Garcia; Derrick Xin; Aditya Kusupati; Romi Stella; Ankur Bapna; Orhan Firat (NeurIPS, 2023)

Block-State Transformers. - Jonathan Pilault; Mahan Fathi; Orhan Firat; Chris Pal; Pierre-Luc Bacon; Ross Goroshin (NeurIPS, 2023)

The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. - Patrick Fernandes; Daniel Deutsch; Mara Finkelstein; Parker Riley; André F. T. Martins; Graham Neubig; Ankush Garg; Jonathan H. Clark; Markus Freitag; Orhan Firat (WMT, 2023)

The unreasonable effectiveness of few-shot learning for machine translation. - Xavier Garcia; Yamini Bansal; Colin Cherry; George F. Foster; Maxim Krikun; Fangxiaoyu Feng; Melvin Johnson; Orhan Firat (CoRR, 2023)

Bilex Rx: Lexical Data Augmentation for Massively Multilingual Machine Translation. - Alexander Jones; Isaac Caswell; Ishank Saxena; Orhan Firat (CoRR, 2023)

PaLM 2 Technical Report. - Rohan Anil; Andrew M. Dai; Orhan Firat; Melvin Johnson; Dmitry Lepikhin; Alexandre Passos; Siamak Shakeri; Emanuel Taropa; Paige Bailey; Zhifeng Chen; Eric Chu; Jonathan H. Clark; et al. (CoRR, 2023)

Cross-Lingual Supervision improves Large Language Models Pre-training. - Andrea Schioppa; Xavier Garcia; Orhan Firat (CoRR, 2023)

Block-State Transformer. - Mahan Fathi; Jonathan Pilault; Pierre-Luc Bacon; Christopher Pal; Orhan Firat; Ross Goroshin (CoRR, 2023)

Reinforced Self-Training (ReST) for Language Modeling. - Çaglar Gülçehre; Tom Le Paine; Srivatsan Srinivasan; Ksenia Konyushkova; Lotte Weerts; Abhishek Sharma 015; Aditya Siddhant; Alex Ahern; Miaosen Wang; Chenjie Gu; Wolfgang Macherey; Arnaud Doucet; et al. (CoRR, 2023)

MADLAD-400: A Multilingual And Document-Level Large Audited Dataset. - Sneha Kudugunta; Isaac Caswell; Biao Zhang 006; Xavier Garcia; Christopher A. Choquette-Choo; Katherine Lee; Derrick Xin; Aditya Kusupati; Romi Stella; Ankur Bapna; Orhan Firat (CoRR, 2023)

Gemini: A Family of Highly Capable Multimodal Models. - Rohan Anil; Sebastian Borgeaud; Yonghui Wu; Jean-Baptiste Alayrac; Jiahui Yu; Radu Soricut; Johan Schalkwyk; Andrew M. Dai; Anja Hauth; Katie Millican; David Silver; Slav Petrov; et al. (CoRR, 2023)

PaLM: Scaling Language Modeling with Pathways. - Aakanksha Chowdhery; Sharan Narang; Jacob Devlin; Maarten Bosma; Gaurav Mishra; Adam Roberts; Paul Barham 001; Hyung Won Chung; Charles Sutton; Sebastian Gehrmann; Parker Schuh; Kensen Shi; et al. (J. Mach. Learn. Res., 2023)

FRMT: A Benchmark for Few-Shot Region-Aware Machine Translation. - Parker Riley; Timothy Dozat; Jan A. Botha; Xavier Garcia; Dan Garrette; Jason Riesa; Orhan Firat; Noah Constant (Trans. Assoc. Comput. Linguistics, 2023)

When Scaling Meets LLM Finetuning: The Effect of Data, Model and Finetuning Method. - Biao Zhang 006; Zhongtao Liu; Colin Cherry; Orhan Firat (ICLR, 2024)

Scaling Sign Language Translation. - Biao Zhang 006; Garrett Tanzer; Orhan Firat (NeurIPS, 2024)

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. - Machel Reid; Nikolay Savinov; Denis Teplyashin; Dmitry Lepikhin; Timothy P. Lillicrap; Jean-Baptiste Alayrac; Radu Soricut; Angeliki Lazaridou; Orhan Firat; Julian Schrittwieser; Ioannis Antonoglou; Rohan Anil; et al. (CoRR, 2024)

Long-Span Question-Answering: Automatic Question Generation and QA-System Ranking via Side-by-Side Evaluation. - Bernd Bohnet; Kevin Swersky; Rosanne Liu; Pranjal Awasthi; Azade Nova; Javier Snaider; Hanie Sedghi; Aaron T. Parisi; Michael Collins 001; Angeliki Lazaridou; Orhan Firat; Noah Fiedel (CoRR, 2024)

Michelangelo: Long Context Evaluations Beyond Haystacks via Latent Structure Queries. - Kiran Vodrahalli; Santiago Ontanon; Nilesh Tripuraneni; Kelvin Xu; Sanil Jain; Rakesh Shivanna; Jeffrey Hui; Nishanth Dikkala; Mehran Kazemi; Bahare Fatemi; Rohan Anil; Ethan Dyer; et al. (CoRR, 2024)

BIG-Bench Extra Hard. - Mehran Kazemi; Bahare Fatemi; Hritik Bansal; John Palowitch; Chrysovalantis Anastasiou; Sanket Vaibhav Mehta; Lalit K. Jain; Virginia Aglietti; Disha Jindal; Peter Chen; Nishanth Dikkala; Gladys Tyen; et al. (ACL (1), 2025)

BIG-Bench Extra Hard. - Mehran Kazemi; Bahare Fatemi; Hritik Bansal; John Palowitch; Chrysovalantis Anastasiou; Sanket Vaibhav Mehta; Kshitij Jain 001; Virginia Aglietti; Disha Jindal; Peter Chen; Nishanth Dikkala; Gladys Tyen; et al. (CoRR, 2025)

Encoder-Decoder Gemma: Improving the Quality-Efficiency Trade-Off via Adaptation. - Biao Zhang; Fedor Moiseev; Joshua Ainslie; Paul Suganthan; Min Ma; Surya Bhupatiraju; Federico Lebrón; Orhan Firat; Armand Joulin; Zhe Dong (CoRR, 2025)