Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level. - Daniel Deutsch; Juraj Juraska; Mara Finkelstein; Markus Freitag (WMT, 2023)

The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. - Patrick Fernandes; Daniel Deutsch; Mara Finkelstein; Parker Riley; André F. T. Martins; Graham Neubig; Ankush Garg; Jonathan H. Clark; Markus Freitag; Orhan Firat (WMT, 2023)

MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task. - Juraj Juraska; Mara Finkelstein; Daniel Deutsch; Aditya Siddhant; Mehdi Mirzazadeh; Markus Freitag (WMT, 2023)

There's No Data like Better Data: Using QE Metrics for MT Data Filtering. - Jan-Thorsten Peter; David Vilar; Daniel Deutsch; Mara Finkelstein; Juraj Juraska; Markus Freitag (WMT, 2023)

MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods. - Mara Finkelstein; Subhajit Naskar; Mehdi Mirzazadeh; Apurva Shah; Markus Freitag (CoRR, 2023)

Quality Control at Your Fingertips: Quality-Aware Translation Models. - Christian Tomani; David Vilar; Markus Freitag; Colin Cherry; Subhajit Naskar; Mara Finkelstein; Daniel Cremers (CoRR, 2023)

Pinpoint, Not Criticize: Refining Large Language Models via Fine-Grained Actionable Feedback. - Wenda Xu; Daniel Deutsch; Mara Finkelstein; Juraj Juraska; Biao Zhang; Zhongtao Liu; William Yang Wang; Lei Li 005; Markus Freitag (CoRR, 2023)

Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model. - Christian Tomani; David Vilar; Markus Freitag; Colin Cherry; Subhajit Naskar; Mara Finkelstein; Xavier Garcia; Daniel Cremers (ACL (1), 2024)

MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods. - Mara Finkelstein; Markus Freitag (ICLR, 2024)

LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedback. - Wenda Xu; Daniel Deutsch; Mara Finkelstein; Juraj Juraska; Biao Zhang; Zhongtao Liu; William Yang Wang; Lei Li 005; Markus Freitag (NAACL-HLT (Findings), 2024)

Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms. - Firas Trabelsi; David Vilar; Mara Finkelstein; Markus Freitag (NeurIPS, 2024)

Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data. - Mara Finkelstein; David Vilar; Markus Freitag (WMT, 2024)

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task. - Juraj Juraska; Daniel Deutsch; Mara Finkelstein; Markus Freitag (WMT, 2024)

Learning from others' mistakes: Finetuning machine translation models with span-level error annotations. - Lily H. Zhang; Hamid Dadkhahi; Mara Finkelstein; Firas Trabelsi; Jiaming Luo; Markus Freitag (CoRR, 2024)

From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set. - Mara Finkelstein; Daniel Deutsch; Parker Riley; Juraj Juraska; Geza Kovacs; Markus Freitag (CoRR, 2024)

WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects. - Daniel Deutsch; Eleftheria Briakou; Isaac Rayburn Caswell; Mara Finkelstein; Rebecca Galor; Juraj Juraska; Geza Kovacs; Alison Lui; Ricardo Rei; Jason Riesa; Shruti Rijhwani; Parker Riley; et al. (ACL (Findings), 2025)