Ricardo Rei

According to our database, Ricardo Rei authored at least 65 papers between 2006 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Can Vision Language Models Judge Action Quality? An Empirical Evaluation.

Miguel Monte e Freitas, Rui Henriques, Ricardo Rei, Pedro Henrique Martins

CoRR, April, 2026

Self-Preference Bias in Rubric-Based Evaluation of Large Language Models.

José Pombal, Ricardo Rei, André F. T. Martins

CoRR, April, 2026

EuroLLM-22B: Technical Report.

Miguel Moura Ramos, Duarte M. Alves, Hippolyte Gisserot-Boukhlef, João Alves, Pedro Henrique Martins, Patrick Fernandes, José Pombal, Nuno Miguel Guerreiro, Ricardo Rei, Nicolas Boizard, M. Amin Farajian, Mateusz Klimaszewski, José G. C. de Souza, Barry Haddow, François Yvon, Pierre Colombo, Alexandra Birch, André F. T. Martins

CoRR, February, 2026

MindGuard: Guardrail Classifiers for Multi-Turn Mental Health Support.

António Farinhas, Nuno Miguel Guerreiro, José Pombal, Pedro Henrique Martins, Laura Melton, Alex Conway, Cara Dochat, Maya D'Eon, Ricardo Rei

CoRR, February, 2026

TOWER+: Bridging Generality and Translation Specialization in Multilingual LLMs.

Ricardo Rei, Nuno Miguel Guerreiro, José Pombal, João Alves, M. Amin Farajian, Pedro Teixeirinha, André F. T. Martins

Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2026

2025

MindEval: Benchmarking Language Models on Multi-turn Mental Health Support.

José Pombal, Maya D'Eon, Nuno Miguel Guerreiro, Pedro Henrique Martins, António Farinhas, Ricardo Rei

CoRR, November, 2025

EuroLLM-9B: Technical Report.

Pedro Henrique Martins, João Alves, Patrick Fernandes, Nuno Miguel Guerreiro, Ricardo Rei, M. Amin Farajian, Mateusz Klimaszewski, Duarte M. Alves, José Pombal, Nicolas Boizard, Manuel Faysse, Pierre Colombo, François Yvon, Barry Haddow, José G. C. de Souza, Alexandra Birch, André F. T. Martins

CoRR, June, 2025

M-Prometheus: A Suite of Open Multilingual LLM Judges.

José Pombal, Dongkeun Yoon, Patrick Fernandes, Ian Wu, Seungone Kim, Ricardo Rei, Graham Neubig, André F. T. Martins

CoRR, April, 2025

Zero-shot Benchmarking: A Framework for Flexible and Scalable Automatic Evaluation of Language Models.

José Pombal, Nuno Miguel Guerreiro, Ricardo Rei, André F. T. Martins

CoRR, April, 2025

XL-Instruct: Synthetic Data for Cross-Lingual Open-Ended Generation.

Vivek Iyer, Ricardo Rei, Pinzhen Chen, Alexandra Birch

CoRR, March, 2025

EuroBERT: Scaling Multilingual Encoders for European Languages.

Nicolas Boizard, Hippolyte Gisserot-Boukhlef, Duarte M. Alves, André F. T. Martins, Ayoub Hammal, Caio Corro, Céline Hudelot, Emmanuel Malherbe, Etienne Malaboeuf, Fanny Jourdan, Gabriel Hautreux, João Alves, Kevin El Haddad, Manuel Faysse, Maxime Peyrard, Nuno Miguel Guerreiro, Patrick Fernandes, Ricardo Rei, Pierre Colombo

CoRR, March, 2025

CroissantLLM: A Truly Bilingual French-English Language Model.

Manuel Faysse, Patrick Fernandes, Nuno Miguel Guerreiro, António Loison, Duarte M. Alves, Caio Corro, Nicolas Boizard, João Alves, Ricardo Rei, Pedro Henrique Martins, Antoni Bigata Casademunt, François Yvon, André F. T. Martins, Gautier Viaud, Céline Hudelot, Pierre Colombo

Trans. Mach. Learn. Res., 2025

Adding Chocolate to Mint : Mitigating Metric Interference in Machine Translation.

José Pombal, Nuno Miguel Guerreiro, Ricardo Rei, André F. T. Martins

Trans. Assoc. Comput. Linguistics, 2025

Robust, interpretable and efficient MT evaluation with fine-tuned metrics.

Ricardo Rei

Proceedings of Machine Translation Summit XX: MTSummit 2025, 2025

XL-Suite: Cross-Lingual Synthetic Training and Evaluation Data for Open-Ended Generation.

Vivek Iyer, Pinzhen Chen, Ricardo Rei, Alexandra Birch

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2025, 2025

Translate Smart, not Hard: Cascaded Translation Systems with Quality-Aware Deferral.

António Farinhas, Nuno Miguel Guerreiro, Sweta Agrawal, Ricardo Rei, André F. T. Martins

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects.

Daniel Deutsch, Eleftheria Briakou, Isaac Rayburn Caswell, Mara Finkelstein, Rebecca Galor, Juraj Juraska, Geza Kovacs, Alison Lui, Ricardo Rei, Jason Riesa, Shruti Rijhwani, Parker Riley, Elizabeth Salesky, Firas Trabelsi, Stephanie Winkler, Biao Zhang, Markus Freitag

Proceedings of the Findings of the Association for Computational Linguistics, 2025

2024

xcomet : Transparent Machine Translation Evaluation through Fine-grained Error Detection.

Nuno Miguel Guerreiro, Ricardo Rei, Daan van Stigt, Luísa Coheur, Pierre Colombo, André F. T. Martins

Trans. Assoc. Comput. Linguistics, 2024

Assessing the Role of Context in Chat Translation Evaluation: Is Context Helpful and Under What Conditions?

Sweta Agrawal, M. Amin Farajian, Patrick Fernandes, Ricardo Rei, André F. T. Martins

Trans. Assoc. Comput. Linguistics, 2024

EuroLLM: Multilingual Language Models for Europe.

Pedro Henrique Martins, Patrick Fernandes, João Alves, Nuno Miguel Guerreiro, Ricardo Rei, Duarte M. Alves, José Pombal, M. Amin Farajian, Manuel Faysse, Mateusz Klimaszewski, Pierre Colombo, Barry Haddow, José G. C. de Souza, Alexandra Birch, André F. T. Martins

CoRR, 2024

Is Context Helpful for Chat Translation Evaluation?

Sweta Agrawal, M. Amin Farajian, Patrick Fernandes, Ricardo Rei, André F. T. Martins

CoRR, 2024

Tower: An Open Multilingual Large Language Model for Translation-Related Tasks.

Duarte M. Alves, José Pombal, Nuno Miguel Guerreiro, Pedro Henrique Martins, João Alves, M. Amin Farajian, Ben Peters, Ricardo Rei, Patrick Fernandes, Sweta Agrawal, Pierre Colombo, José G. C. de Souza, André F. T. Martins

CoRR, 2024

Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE?

Chrysoula Zerva, Frédéric Blain, José Guilherme Camargo de Souza, Diptesh Kanojia, Sourabh Dattatray Deoghare, Nuno Miguel Guerreiro, Giuseppe Attanasio, Ricardo Rei, Constantin Orasan, Matteo Negri, Marco Turchi, Rajen Chatterjee, Pushpak Bhattacharyya, Markus Freitag, André F. T. Martins

Proceedings of the Ninth Conference on Machine Translation, 2024

Tower v2: Unbabel-IST 2024 Submission for the General MT Shared Task.

Ricardo Rei, José Pombal, Nuno Miguel Guerreiro, João Alves, Pedro Henrique Martins, Patrick Fernandes, Helena Wu, Tânia Vaz, Duarte M. Alves, M. Amin Farajian, Sweta Agrawal, António Farinhas, José Guilherme Camargo de Souza, André F. T. Martins

Proceedings of the Ninth Conference on Machine Translation, 2024

Is Preference Alignment Always the Best Option to Enhance LLM-Based Translation? An Empirical Analysis.

Hippolyte Gisserot-Boukhlef, Ricardo Rei, Emmanuel Malherbe, Céline Hudelot, Pierre Colombo, Nuno Miguel Guerreiro

Proceedings of the Ninth Conference on Machine Translation, 2024

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task.

Markus Freitag, Nitika Mathur, Daniel Deutsch, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Frédéric Blain, Tom Kocmi, Jiayi Wang, David Ifeoluwa Adelani, Marianna Buchicchio, Chrysoula Zerva, Alon Lavie

Proceedings of the Ninth Conference on Machine Translation, 2024

QUEST: Quality-Aware Metropolis-Hastings Sampling for Machine Translation.

Gonçalo Rui Alves Faria, Sweta Agrawal, António Farinhas, Ricardo Rei, José Guilherme Camargo de Souza, André F. T. Martins

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

AfriMTE and AfriCOMET: Enhancing COMET to Embrace Under-resourced African Languages.

Jiayi Wang, David Ifeoluwa Adelani, Sweta Agrawal, Marek Masiak, Ricardo Rei, Eleftheria Briakou, Marine Carpuat, Xuanli He, Sofia Bourhim, Andiswa Bukula, Muhidin Mohamed, Temitayo Olatoye, Tosin P. Adewumi, Hamam Mokayed, Christine Mwase, Wangui Kimotho, Foutse Yuehgoh, Anuoluwapo Aremu, Jessica Ojo, Shamsuddeen Hassan Muhammad, Salomey Osei, Abdul-Hakeem Omotayo, Chiamaka Chukwuneke, Perez Ogayo, Oumaima Hourrane, Salma El Anigri, Lolwethu Ndolela, Thabiso Mangwana, Shafie Abdi Mohamed, Ayinde Hassan, Oluwabusayo Olufunke Awoyomi, Lama Alkhaled, Sana Sabah Al-Azzawi, Naome A. Etori, Millicent Ochieng, Clemencia Siro, Njoroge Kiragu, Eric Muchiri, Wangari Kimotho, Sakayo Toadoum Sari, Lyse Naomi Wamba Momo, Daud Abolade, Simbiat Ajao, Iyanuoluwa Shode, Ricky Macharm, Ruqayya Nasir Iro, Saheed S. Abdullahi, Stephen E. Moore, Bernard Opoku, Zainab Akinjobi, Afolabi Abeeb, Nnaemeka C. Obiefuna, Onyekachi Raphael Ogbu, Sam Ochieng', Verrah Otiende, Chinedu E. Mbonu, Yao Lu, Pontus Stenetorp

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

xTower: A Multilingual LLM for Explaining and Correcting Translation Errors.

Marcos V. Treviso, Nuno Miguel Guerreiro, Sweta Agrawal, Ricardo Rei, José Pombal, Tânia Vaz, Helena Wu, Beatriz Silva, Daan van Stigt, André F. T. Martins

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Modeling User Preferences with Automatic Metrics: Creating a High-Quality Preference Dataset for Machine Translation.

Sweta Agrawal, José Guilherme Camargo de Souza, Ricardo Rei, António Farinhas, Gonçalo Rui Alves Faria, Patrick Fernandes, Nuno Miguel Guerreiro, André F. T. Martins

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

Can Automatic Metrics Assess High-Quality Translations?

Sweta Agrawal, António Farinhas, Ricardo Rei, André F. T. Martins

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

Onception: Active Learning with Expert Advice for Real World Machine Translation.

Vânia Mendonça, Ricardo Rei, Luísa Coheur, Alberto Sardinha

Comput. Linguistics, June, 2023

AfriMTE and AfriCOMET: Empowering COMET to Embrace Under-resourced African Languages.

Jiayi Wang, David Ifeoluwa Adelani, Sweta Agrawal, Ricardo Rei, Eleftheria Briakou, Marine Carpuat, Marek Masiak, Xuanli He, Sofia Bourhim, Andiswa Bukula, Muhidin Mohamed, Temitayo Olatoye, Hamam Mokayed, Christine Mwase, Wangui Kimotho, Foutse Yuehgoh, Aremu Anuoluwapo, Jessica Ojo, Shamsuddeen Hassan Muhammad, Salomey Osei, Abdul-Hakeem Omotayo, Chiamaka Chukwuneke, Perez Ogayo, Oumaima Hourrane, Salma El Anigri, Lolwethu Ndolela, Thabiso Mangwana, Shafie Abdi Mohamed, Ayinde Hassan, Oluwabusayo Olufunke Awoyomi, Lama Alkhaled, Sana Sabah Al-Azzawi, Naome A. Etori, Millicent Ochieng, Clemencia Siro, Samuel Njoroge, Eric Muchiri, Wangari Kimotho, Lyse Naomi Wamba Momo, Daud Abolade, Simbiat Ajao, Tosin P. Adewumi, Iyanuoluwa Shode, Ricky Macharm, Ruqayya Nasir Iro, Saheed S. Abdullahi, Stephen E. Moore, Bernard Opoku, Zainab Akinjobi, Afolabi Abeeb, Nnaemeka C. Obiefuna, Onyekachi Raphael Ogbu, Sam Brian, Verrah Akinyi Otiende, Chinedu Emmanuel Mbonu, Sakayo Toadoum Sari, Pontus Stenetorp

CoRR, 2023

Scaling up CometKiwi: Unbabel-IST 2023 Submission for the Quality Estimation Shared Task.

Ricardo Rei, Nuno Miguel Guerreiro, José Pombal, Daan van Stigt, Marcos V. Treviso, Luísa Coheur, José G. C. de Souza, André F. T. Martins

Proceedings of the Eighth Conference on Machine Translation, 2023

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent.

Markus Freitag, Nitika Mathur, Chi-kiu Lo, Eleftherios Avramidis, Ricardo Rei, Brian Thompson, Tom Kocmi, Frédéric Blain, Daniel Deutsch, Craig Stewart, Chrysoula Zerva, Sheila Castilho, Alon Lavie, George F. Foster

Proceedings of the Eighth Conference on Machine Translation, 2023

Steering Large Language Models for Machine Translation with Finetuning and In-Context Learning.

Duarte M. Alves, Nuno Miguel Guerreiro, João Alves, José Pombal, Ricardo Rei, José Guilherme Camargo de Souza, Pierre Colombo, André F. T. Martins

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

The Inside Story: Towards Better Understanding of Machine Translation Neural Evaluation Metrics.

Ricardo Rei, Nuno Miguel Guerreiro, Marcos V. Treviso, Luísa Coheur, Alon Lavie, André F. T. Martins

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

2022

Better Uncertainty Quantification for Machine Translation Evaluation.

Chrysoula Zerva, Taisiya Glushkova, Ricardo Rei, André F. T. Martins

CoRR, 2022

Findings of the WMT 2022 Shared Task on Quality Estimation.

Chrysoula Zerva, Frédéric Blain, Ricardo Rei, Piyawat Lertvittayakumjorn, José G. C. de Souza, Steffen Eger, Diptesh Kanojia, Duarte M. Alves, Constantin Orasan, Marina Fomicheva, André F. T. Martins, Lucia Specia

Proceedings of the Seventh Conference on Machine Translation, 2022

CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task.

Ricardo Rei, Marcos V. Treviso, Nuno Miguel Guerreiro, Chrysoula Zerva, Ana C. Farinha, Christine Maroti, José G. C. de Souza, Taisiya Glushkova, Duarte M. Alves, Luísa Coheur, Alon Lavie, André F. T. Martins

Proceedings of the Seventh Conference on Machine Translation, 2022

COMET-22: Unbabel-IST 2022 Submission for the Metrics Shared Task.

Ricardo Rei, José G. C. de Souza, Duarte M. Alves, Chrysoula Zerva, Ana C. Farinha, Taisiya Glushkova, Alon Lavie, Luísa Coheur, André F. T. Martins

Proceedings of the Seventh Conference on Machine Translation, 2022

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust.

Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, Eleftherios Avramidis, Tom Kocmi, George F. Foster, Alon Lavie, André F. T. Martins

Proceedings of the Seventh Conference on Machine Translation, 2022

Robust MT Evaluation with Sentence-level Multilingual Augmentation.

Duarte M. Alves, Ricardo Rei, Ana C. Farinha, José G. C. de Souza, André F. T. Martins

Proceedings of the Seventh Conference on Machine Translation, 2022

Quality-Aware Decoding for Neural Machine Translation.

Patrick Fernandes, António Farinhas, Ricardo Rei, José Guilherme Camargo de Souza, Perez Ogayo, Graham Neubig, André F. T. Martins

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

Towards a sentiment-aware conversational agent.

Isabel Dias, Ricardo Rei, Patrícia Pereira, Luísa Coheur

Proceedings of the IVA '22: ACM International Conference on Intelligent Virtual Agents, Faro, Portugal, September 6, 2022

Disentangling Uncertainty in Machine Translation Evaluation.

Chrysoula Zerva, Taisiya Glushkova, Ricardo Rei, André F. T. Martins

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

QUARTZ: Quality-Aware Machine Translation.

José G. C. de Souza, Ricardo Rei, Ana C. Farinha, Helena Moniz, André F. T. Martins

Proceedings of the 23rd Annual Conference of the European Association for Machine Translation, 2022

Searching for COMETINHO: The Little Metric That Could.

Ricardo Rei, Ana C. Farinha, José G. C. de Souza, Pedro G. Ramos, André F. T. Martins, Luísa Coheur, Alon Lavie

Proceedings of the 23rd Annual Conference of the European Association for Machine Translation, 2022

2021

Towards better subtitles: A multilingual approach for punctuation restoration of speech transcripts.

Nuno Miguel Guerreiro, Ricardo Rei, Fernando Batista

Expert Syst. Appl., 2021

IST-Unbabel 2021 Submission for the Quality Estimation Shared Task.

Chrysoula Zerva, Daan van Stigt, Ricardo Rei, Ana C. Farinha, Pedro G. Ramos, José G. C. de Souza, Taisiya Glushkova, Miguel Vera, Fábio N. Kepler, André F. T. Martins

Proceedings of the Sixth Conference on Machine Translation, 2021

Are References Really Needed? Unbabel-IST 2021 Submission for the Metrics Shared Task.

Ricardo Rei, Ana C. Farinha, Chrysoula Zerva, Daan van Stigt, Craig Stewart, Pedro G. Ramos, Taisiya Glushkova, André F. T. Martins, Alon Lavie

Proceedings of the Sixth Conference on Machine Translation, 2021

Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain.

Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George F. Foster, Alon Lavie, Ondrej Bojar

Proceedings of the Sixth Conference on Machine Translation, 2021

Multilingual Simultaneous Sentence End and Punctuation Prediction (short paper).

Ricardo Rei, Fernando Batista, Nuno Miguel Guerreiro, Luísa Coheur

Proceedings of the Swiss Text Analytics Conference 2021, Winterthur, 2021

IST-Unbabel 2021 Submission for the Explainable Quality Estimation Shared Task.

Marcos V. Treviso, Nuno Miguel Guerreiro, Ricardo Rei, André F. T. Martins

Proceedings of the 2nd Workshop on Evaluation and Comparison of NLP Systems, 2021

Uncertainty-Aware Machine Translation Evaluation.

Taisiya Glushkova, Chrysoula Zerva, Ricardo Rei, André F. T. Martins

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2021, 2021

Multilingual Email Zoning.

Bruno Jardim, Ricardo Rei, Mariana S. C. Almeida

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop, 2021

MT-Telescope: An interactive platform for contrastive evaluation of MT systems.

Ricardo Rei, Ana C. Farinha, Craig Stewart, Luísa Coheur, Alon Lavie

Proceedings of the Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

Online Learning Meets Machine Translation Evaluation: Finding the Best Systems with the Least Human Effort.

Vânia Mendonça, Ricardo Rei, Luísa Coheur, Alberto Sardinha, Ana Lúcia Santos

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Unbabel's Participation in the WMT20 Metrics Shared Task.

Ricardo Rei, Craig Stewart, Catarina Farinha, Alon Lavie

CoRR, 2020

A free web service for fast COVID-19 classification of chest X-Ray images.

Jose David Bermudez Castro, Ricardo Rei, Jose E. Ruiz, Pedro Achanccaray Diaz, Smith W. Arauco Canchumuni, Cristian E. Muñoz Villalobos, Felipe Borges Coelho, Leonardo Forero Mendoza, Marco Aurélio Cavalcanti Pacheco

CoRR, 2020

Unbabel's Participation in the WMT20 Metrics Shared Task.

Ricardo Rei, Craig Stewart, Ana C. Farinha, Alon Lavie

Proceedings of the Fifth Conference on Machine Translation, 2020

Automatic Truecasing of Video Subtitles Using BERT: A Multilingual Adaptable Approach.

Ricardo Rei, Nuno Miguel Guerreiro, Fernando Batista

Proceedings of the Information Processing and Management of Uncertainty in Knowledge-Based Systems, 2020

COMET: A Neural Framework for MT Evaluation.

Ricardo Rei, Craig Stewart, Ana C. Farinha, Alon Lavie

Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, 2020

COMET - Deploying a New State-of-the-art MT Evaluation Metric in Production.

Craig Stewart, Ricardo Rei, Catarina Farinha, Alon Lavie

Proceedings of the 14th Conference of the Association for Machine Translation in the Americas, 2020

2006

Urban Cellular Planning Optimisation of Multi-service Enhanced UMTS Based in Economic Issues.

Orlando Cabral, Fernando J. Velez, Cátia Franco, Ricardo Rei

Proceedings of the Wired/Wireless Internet Communications, 4th International Conference, 2006