Linking open government data: what journalists wish they had known. - Christoph Böhm 001; Felix Naumann; Markus Freitag; Stefan George; Norman Höfler; Martin Köppelmann; Claudia Lehmann; Andrina Mascher; Tobias Schmidt (I-SEMANTICS, 2010)

Advances on spoken language translation in the Quaero program. - Karim Boudahmane; Bianka Buschbeck; Eunah Cho; Josep Maria Crego; Markus Freitag; Thomas Lavergne; Hermann Ney; Jan Niehues; Stephan Peitz; Jean Senellart; Artem Sokolov; Alex Waibel; et al. (IWSLT, 2011)

Modeling punctuation prediction as machine translation. - Stephan Peitz; Markus Freitag; Arne Mauser; Hermann Ney (IWSLT, 2011)

The RWTH Aachen machine translation system for IWSLT 2011. - Joern Wuebker; Matthias Huck; Saab Mansour; Markus Freitag; Minwei Feng; Stephan Peitz; Christoph Schmidt; Hermann Ney (IWSLT, 2011)

The RWTH Aachen System for NTCIR-9 PatentMT. - Minwei Feng; Christoph Schmidt; Joern Wuebker; Stephan Peitz; Markus Freitag; Hermann Ney (NTCIR, 2011)

Joint WMT Submission of the QUAERO Project. - Markus Freitag; Gregor Leusch; Joern Wuebker; Stephan Peitz; Hermann Ney; Teresa Herrmann; Jan Niehues; Alex Waibel; Alexandre Allauzen; Gilles Adda; Josep Maria Crego; Bianka Buschbeck; et al. (WMT@EMNLP, 2011)

The RWTH Aachen Machine Translation System for WMT 2011. - Matthias Huck; Joern Wuebker; Christoph Schmidt; Markus Freitag; Stephan Peitz; Daniel Stein; Arnaud Dagnelies; Saab Mansour; Gregor Leusch; Hermann Ney (WMT@EMNLP, 2011)

The RWTH System Combination System for WMT 2011. - Gregor Leusch; Markus Freitag; Hermann Ney (WMT@EMNLP, 2011)

A Guide to Jane, an Open Source Hierarchical Translation Toolkit. - Daniel Stein; David Vilar; Stephan Peitz; Markus Freitag; Matthias Huck; Hermann Ney (Prague Bull. Math. Linguistics, 2011)

CFD analysis of viscous losses in complex microsystems. - Alexander Sorger; Markus Freitag; Alexey Shaporin; Jan Mehner (SSD, 2012)

Jane 2: Open Source Phrase-based and Hierarchical Statistical Machine Translation. - Joern Wuebker; Matthias Huck; Stephan Peitz; Malte Nuhn; Markus Freitag; Jan-Thorsten Peter; Saab Mansour; Hermann Ney (COLING (Demos), 2012)

Discriminative Reordering Extensions for Hierarchical Phrase-Based Machine Translation. - Matthias Huck; Stephan Peitz; Markus Freitag; Hermann Ney (EAMT, 2012)

The RWTH Aachen speech recognition and machine translation system for IWSLT 2012. - Stephan Peitz; Saab Mansour; Markus Freitag; Minwei Feng; Matthias Huck; Joern Wuebker; Malte Nuhn; Markus Nußbaum-Thom; Hermann Ney (IWSLT, 2012)

Joint WMT 2012 Submission of the QUAERO Project. - Markus Freitag; Stephan Peitz; Matthias Huck; Hermann Ney; Jan Niehues; Teresa Herrmann; Alex Waibel; Hai Son Le; Thomas Lavergne; Alexandre Allauzen; Bianka Buschbeck; Josep Maria Crego; et al. (WMT@NAACL-HLT, 2012)

The RWTH Aachen Machine Translation System for WMT 2012. - Matthias Huck; Stephan Peitz; Markus Freitag; Malte Nuhn; Hermann Ney (WMT@NAACL-HLT, 2012)

Review of Hypothesis Alignment Algorithms for MT System Combination via Confusion Network Decoding. - Antti-Veikko I. Rosti; Xiaodong He 001; Damianos G. Karakos; Gregor Leusch; Yuan Cao 007; Markus Freitag; Spyros Matsoukas; Hermann Ney; Jason Smith 006; Bing Zhang 004 (WMT@NAACL-HLT, 2012)

GovWILD: integrating open government data for transparency. - Christoph Böhm 001; Markus Freitag; Arvid Heise; Claudia Lehmann; Andrina Mascher; Felix Naumann; Vuk Ercegovac; Mauricio A. Hernández; Peter Haase 001; Michael Schmidt 002 (WWW (Companion Volume), 2012)

Hierarchical Phrase-Based Translation with Jane 2. - Matthias Huck; Jan-Thorsten Peter; Markus Freitag; Stephan Peitz; Hermann Ney (Prague Bull. Math. Linguistics, 2012)

EU-BRIDGE MT: text translation of talks in the EU-BRIDGE project. - Markus Freitag; Stephan Peitz; Joern Wuebker; Hermann Ney; Nadir Durrani; Matthias Huck; Philipp Koehn; Thanh-Le Ha; Jan Niehues; Mohammed Mediani; Teresa Herrmann; Alex Waibel; et al. (IWSLT (Evaluation Campaign), 2013)

The RWTH Aachen machine translation systems for IWSLT 2013. - Joern Wuebker; Stephan Peitz; Tamer Alkhouli; Jan-Thorsten Peter; Minwei Feng; Markus Freitag; Hermann Ney (IWSLT (Evaluation Campaign), 2013)

Reverse Word Order Model. - Markus Freitag; Minwei Feng; Matthias Huck; Stephan Peitz; Hermann Ney (MTSummit, 2013)

The System Combination RWTH Aachen: SYSTRAN for the NTCIR-10 PatentMT Evaluation. - Minwei Feng; Markus Freitag; Hermann Ney; Bianka Buschbeck; Jean Senellart; Jin Yang (NTCIR, 2013)

The RWTH Aachen System for NTCIR-10 PatentMT. - Minwei Feng; Christoph Schmidt; Joern Wuebker; Markus Freitag; Hermann Ney (NTCIR, 2013)

A Performance Study of Cube Pruning for Large-Scale Hierarchical Machine Translation. - Matthias Huck; David Vilar; Markus Freitag; Hermann Ney (SSST@NAACL-HLT, 2013)

Joint WMT 2013 Submission of the QUAERO Project. - Stephan Peitz; Saab Mansour; Matthias Huck; Markus Freitag; Hermann Ney; Eunah Cho; Teresa Herrmann; Mohammed Mediani; Jan Niehues; Alex Waibel; Alexandre Allauzen; Quoc-Khanh Do; et al. (WMT@ACL, 2013)

The RWTH Aachen Machine Translation System for WMT 2013. - Stephan Peitz; Saab Mansour; Jan-Thorsten Peter; Christoph Schmidt; Joern Wuebker; Matthias Huck; Markus Freitag; Hermann Ney (WMT@ACL, 2013)

Improved MEMS AE sensors in HARM technology. - R. Sommer; Markus Freitag; Jörg Schaufuss; Alexander Sorger; Jan Mehner (SSD, 2014)

Jane: Open Source Machine Translation System Combination. - Markus Freitag; Matthias Huck; Hermann Ney (EACL, 2014)

Combined spoken language translation. - Markus Freitag; Joern Wuebker; Stephan Peitz; Hermann Ney; Matthias Huck; Alexandra Birch; Nadir Durrani; Philipp Koehn; Mohammed Mediani; Isabel Slawik; Jan Niehues; Eunach Cho; et al. (IWSLT (Evaluation Campaign), 2014)

Better punctuation prediction with hierarchical phrase-based translation. - Stephan Peitz; Markus Freitag; Hermann Ney (IWSLT, 2014)

EU-BRIDGE MT: Combined Machine Translation. - Markus Freitag; Stephan Peitz; Joern Wuebker; Hermann Ney; Matthias Huck; Rico Sennrich; Nadir Durrani; Maria Nadejde; Philip Williams; Philipp Koehn; Teresa Herrmann; Eunah Cho; et al. (WMT@ACL, 2014)

The RWTH Aachen German-English Machine Translation System for WMT 2014. - Stephan Peitz; Joern Wuebker; Markus Freitag; Hermann Ney (WMT@ACL, 2014)

Local System Voting Feature for Machine Translation System Combination. - Markus Freitag; Jan-Thorsten Peter; Stephan Peitz; Minwei Feng; Hermann Ney (WMT@EMNLP, 2015)

Fast Domain Adaptation for Neural Machine Translation. - Markus Freitag; Yaser Al-Onaizan (CoRR, 2016)

Beam Search Strategies for Neural Machine Translation. - Markus Freitag; Yaser Al-Onaizan (NMT@ACL, 2017)

Ensemble Distillation for Neural Machine Translation. - Markus Freitag; Yaser Al-Onaizan; Baskaran Sankaran (CoRR, 2017)

Attention-based Vocabulary Selection for NMT Decoding. - Baskaran Sankaran; Markus Freitag; Yaser Al-Onaizan (CoRR, 2017)

Unsupervised Natural Language Generation with Denoising Autoencoders. - Markus Freitag; Scott Roy (EMNLP, 2018)

APE at Scale and Its Implications on MT Evaluation Biases. - Markus Freitag; Isaac Caswell; Scott Roy (WMT (1), 2019)

Text Repair Model for Neural Machine Translation. - Markus Freitag; Isaac Caswell; Scott Roy (CoRR, 2019)

Translationese as a Language in "Multilingual" NMT. - Parker Riley; Isaac Caswell; Markus Freitag; David Grangier (ACL, 2020)

BLEU might be Guilty but References are not Innocent. - Markus Freitag; David Grangier; Isaac Caswell (EMNLP (1), 2020)

KoBE: Knowledge-Based Machine Translation Evaluation. - Zorik Gekhman; Roee Aharoni; Genady Beryozkin; Markus Freitag; Wolfgang Macherey (EMNLP (Findings), 2020)

Findings of the WMT 2020 Shared Task on Automatic Post-Editing. - Rajen Chatterjee; Markus Freitag; Matteo Negri; Marco Turchi (WMT@EMNLP, 2020)

Complete Multilingual Neural Machine Translation. - Markus Freitag; Orhan Firat (WMT@EMNLP, 2020)

Human-Paraphrased References Improve Neural Machine Translation. - Markus Freitag; George F. Foster; David Grangier; Colin Cherry (WMT@EMNLP, 2020)

Results of the WMT20 Metrics Shared Task. - Nitika Mathur; Johnny Wei; Markus Freitag; Qingsong Ma; Ondrej Bojar (WMT@EMNLP, 2020)

Learning to Evaluate Translation Beyond English: BLEURT Submissions to the WMT Metrics 2020 Shared Task. - Thibault Sellam; Amy Pu; Hyung Won Chung; Sebastian Gehrmann; Qijun Tan; Markus Freitag; Dipanjan Das 001; Ankur P. Parikh (WMT@EMNLP, 2020)

Assessing Reference-Free Peer Evaluation for Machine Translation. - Sweta Agrawal; George F. Foster; Markus Freitag; Colin Cherry (NAACL-HLT, 2021)

Findings of the 2021 Conference on Machine Translation (WMT21). - Farhad Akhbardeh; Arkady Arkhangorodsky; Magdalena Biesialska; Ondrej Bojar; Rajen Chatterjee; Vishrav Chaudhary; Marta R. Costa-jussà; Cristina España-Bonet; Angela Fan; Christian Federmann; Markus Freitag; Yvette Graham; et al. (WMT@EMNLP, 2021)

Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain. - Markus Freitag; Ricardo Rei; Nitika Mathur; Chi-kiu Lo; Craig Stewart; George F. Foster; Alon Lavie; Ondrej Bojar (WMT@EMNLP, 2021)

What Can Unsupervised Machine Translation Contribute to High-Resource Language Pairs? - Kelly Marchisio; Markus Freitag; David Grangier (CoRR, 2021)

Using Machine Translation to Localize Task Oriented NLG Output. - Scott Roy; Cliff Brunk; Kyu-Young Kim; Justin Zhao; Markus Freitag; Mihir Kale; Gagan Bansal; Sidharth Mudgal; Chris Varano (CoRR, 2021)

Minimum Bayes Risk Decoding with Neural Metrics of Translation Quality. - Markus Freitag; David Grangier; Qijun Tan; Bowen Liang (CoRR, 2021)

Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation. - Markus Freitag; George F. Foster; David Grangier; Viresh Ratnakar; Qijun Tan; Wolfgang Macherey (Trans. Assoc. Comput. Linguistics, 2021)

A Natural Diet: Towards Improving Naturalness of Machine Translation Output. - Markus Freitag; David Vilar; David Grangier; Colin Cherry; George F. Foster (ACL (Findings), 2022)

Scaling Laws for Neural Machine Translation. - Behrooz Ghorbani; Orhan Firat; Markus Freitag; Ankur Bapna; Maxim Krikun; Xavier Garcia; Ciprian Chelba; Colin Cherry (ICLR, 2022)

On Systematic Style Differences between Unsupervised and Supervised MT and an Application for High-Resource Machine Translation. - Kelly Marchisio; Markus Freitag; David Grangier (NAACL-HLT, 2022)

Original or Translated? A Causal Analysis of the Impact of Translationese on Machine Translation Performance. - Jingwei Ni; Zhijing Jin 001; Markus Freitag; Mrinmaya Sachan; Bernhard Schölkopf (NAACL-HLT, 2022)

Findings of the WMT 2022 Shared Task on Automatic Post-Editing. - Pushpak Bhattacharyya; Rajen Chatterjee; Markus Freitag; Diptesh Kanojia; Matteo Negri; Marco Turchi (WMT, 2022)

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. - Markus Freitag; Ricardo Rei; Nitika Mathur; Chi-kiu Lo; Craig Stewart; Eleftherios Avramidis; Tom Kocmi; George F. Foster; Alon Lavie; André F. T. Martins (WMT, 2022)

Toward More Effective Human Evaluation for Machine Translation. - Belén Saldías; George F. Foster; Markus Freitag; Qijun Tan (CoRR, 2022)

High Quality Rather than High Model Probability: Minimum Bayes Risk Decoding with Neural Metrics. - Markus Freitag; David Grangier; Qijun Tan; Bowen Liang (Trans. Assoc. Comput. Linguistics, 2022)

Prompting PaLM for Translation: Assessing Strategies and Performance. - David Vilar; Markus Freitag; Colin Cherry; Jiaming Luo; Viresh Ratnakar; George F. Foster (ACL (1), 2023)

Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration. - Daniel Deutsch; George F. Foster; Markus Freitag (EMNLP, 2023)

Epsilon Sampling Rocks: Investigating Sampling Strategies for Minimum Bayes Risk Decoding for Machine Translation. - Markus Freitag; Behrooz Ghorbani; Patrick Fernandes (EMNLP (Findings), 2023)

INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback. - Wenda Xu; Danqing Wang; Liangming Pan; Zhenqiao Song; Markus Freitag; William Wang 001; Lei Li 005 (EMNLP, 2023)

Language models are multilingual chain-of-thought reasoners. - Freda Shi; Mirac Suzgun; Markus Freitag; Xuezhi Wang 002; Suraj Srivats; Soroush Vosoughi; Hyung Won Chung; Yi Tay; Sebastian Ruder; Denny Zhou; Dipanjan Das 001; Jason Wei (ICLR, 2023)

Scaling Laws for Multilingual Neural Machine Translation. - Patrick Fernandes; Behrooz Ghorbani; Xavier Garcia; Markus Freitag; Orhan Firat (ICML, 2023)

Findings of the WMT 2023 Shared Task on Automatic Post-Editing. - Pushpak Bhattacharyya; Rajen Chatterjee; Markus Freitag; Diptesh Kanojia; Matteo Negri; Marco Turchi (WMT, 2023)

Training and Meta-Evaluating Machine Translation Evaluation Metrics at the Paragraph Level. - Daniel Deutsch; Juraj Juraska; Mara Finkelstein; Markus Freitag (WMT, 2023)

The Devil Is in the Errors: Leveraging Large Language Models for Fine-grained Machine Translation Evaluation. - Patrick Fernandes; Daniel Deutsch; Mara Finkelstein; Parker Riley; André F. T. Martins; Graham Neubig; Ankush Garg; Jonathan H. Clark; Markus Freitag; Orhan Firat (WMT, 2023)

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. - Markus Freitag; Nitika Mathur; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Tom Kocmi; Frédéric Blain; Daniel Deutsch; Craig Stewart; Chrysoula Zerva; Sheila Castilho; et al. (WMT, 2023)

MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task. - Juraj Juraska; Mara Finkelstein; Daniel Deutsch; Aditya Siddhant; Mehdi Mirzazadeh; Markus Freitag (WMT, 2023)

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Philipp Koehn; et al. (WMT, 2023)

Quality Estimation Using Minimum Bayes Risk. - Subhajit Naskar; Daniel Deutsch; Markus Freitag (WMT, 2023)

There's No Data like Better Data: Using QE Metrics for MT Data Filtering. - Jan-Thorsten Peter; David Vilar; Daniel Deutsch; Mara Finkelstein; Juraj Juraska; Markus Freitag (WMT, 2023)

PaLM 2 Technical Report. - Rohan Anil; Andrew M. Dai; Orhan Firat; Melvin Johnson; Dmitry Lepikhin; Alexandre Passos; Siamak Shakeri; Emanuel Taropa; Paige Bailey; Zhifeng Chen; Eric Chu; Jonathan H. Clark; et al. (CoRR, 2023)

Ties Matter: Modifying Kendall's Tau for Modern Metric Meta-Evaluation. - Daniel Deutsch; George F. Foster; Markus Freitag (CoRR, 2023)

MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods. - Mara Finkelstein; Subhajit Naskar; Mehdi Mirzazadeh; Apurva Shah; Markus Freitag (CoRR, 2023)

Quality Control at Your Fingertips: Quality-Aware Translation Models. - Christian Tomani; David Vilar; Markus Freitag; Colin Cherry; Subhajit Naskar; Mara Finkelstein; Daniel Cremers (CoRR, 2023)

Pinpoint, Not Criticize: Refining Large Language Models via Fine-Grained Actionable Feedback. - Wenda Xu; Daniel Deutsch; Mara Finkelstein; Juraj Juraska; Biao Zhang; Zhongtao Liu; William Yang Wang; Lei Li 005; Markus Freitag (CoRR, 2023)

Quality-Aware Translation Models: Efficient Generation and Quality Estimation in a Single Model. - Christian Tomani; David Vilar; Markus Freitag; Colin Cherry; Subhajit Naskar; Mara Finkelstein; Xavier Garcia; Daniel Cremers (ACL (1), 2024)

MBR and QE Finetuning: Training-time Distillation of the Best and Most Expensive Decoding Methods. - Mara Finkelstein; Markus Freitag (ICLR, 2024)

Finding Replicable Human Evaluations via Stable Ranking Probability. - Parker Riley; Daniel Deutsch; George F. Foster; Viresh Ratnakar; Ali Dabirmoghaddam; Markus Freitag (NAACL-HLT, 2024)

LLMRefine: Pinpointing and Refining Large Language Models via Fine-Grained Actionable Feedback. - Wenda Xu; Daniel Deutsch; Mara Finkelstein; Juraj Juraska; Biao Zhang; Zhongtao Liu; William Yang Wang; Lei Li 005; Markus Freitag (NAACL-HLT (Findings), 2024)

Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms. - Firas Trabelsi; David Vilar; Mara Finkelstein; Markus Freitag (NeurIPS, 2024)

Translating Step-by-Step: Decomposing the Translation Process for Improved Translation Quality of Long-Form Texts. - Eleftheria Briakou; Jiaming Luo; Colin Cherry; Markus Freitag (WMT, 2024)

Introducing the NewsPaLM MBR and QE Dataset: LLM-Generated High-Quality Parallel Data Outperforms Traditional Web-Crawled Data. - Mara Finkelstein; David Vilar; Markus Freitag (WMT, 2024)

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. - Markus Freitag; Nitika Mathur; Daniel Deutsch; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Frédéric Blain; Tom Kocmi; Jiayi Wang; David Ifeoluwa Adelani; Marianna Buchicchio; et al. (WMT, 2024)

MetricX-24: The Google Submission to the WMT 2024 Metrics Shared Task. - Juraj Juraska; Daniel Deutsch; Mara Finkelstein; Markus Freitag (WMT, 2024)

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (WMT, 2024)

Mitigating Metric Bias in Minimum Bayes Risk Decoding. - Geza Kovacs; Daniel Deutsch; Markus Freitag (WMT, 2024)

Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data. - Zhongtao Liu; Parker Riley; Daniel Deutsch; Alison Lui; Mengmeng Niu; Apurva Shah; Markus Freitag (WMT, 2024)

Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE? - Chrysoula Zerva; Frédéric Blain; José Guilherme Camargo de Souza; Diptesh Kanojia; Sourabh Dattatray Deoghare; Nuno Miguel Guerreiro; Giuseppe Attanasio; Ricardo Rei; Constantin Orasan; Matteo Negri; Marco Turchi; Rajen Chatterjee; et al. (WMT, 2024)

Preliminary WMT24 Ranking of General MT Systems and LLMs. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (CoRR, 2024)

On the Implications of Verbose LLM Outputs: A Case Study in Translation Evaluation. - Eleftheria Briakou; Zhongtao Liu; Colin Cherry; Markus Freitag (CoRR, 2024)

Beyond Human-Only: Evaluating Human-Machine Collaboration for Collecting High-Quality Translation Data. - Zhongtao Liu; Parker Riley; Daniel Deutsch; Alison Lui; Mengmeng Niu; Apu Shah; Markus Freitag (CoRR, 2024)

Learning from others' mistakes: Finetuning machine translation models with span-level error annotations. - Lily H. Zhang; Hamid Dadkhahi; Mara Finkelstein; Firas Trabelsi; Jiaming Luo; Markus Freitag (CoRR, 2024)

From Jack of All Trades to Master of One: Specializing LLM-based Autoraters to a Test Set. - Mara Finkelstein; Daniel Deutsch; Parker Riley; Juraj Juraska; Geza Kovacs; Markus Freitag (CoRR, 2024)

WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects. - Daniel Deutsch; Eleftheria Briakou; Isaac Rayburn Caswell; Mara Finkelstein; Rebecca Galor; Juraj Juraska; Geza Kovacs; Alison Lui; Ricardo Rei; Jason Riesa; Shruti Rijhwani; Parker Riley; et al. (ACL (Findings), 2025)

Enhancing Human Evaluation in Machine Translation with Comparative Judgement. - Yixiao Song; Parker Riley; Daniel Deutsch; Markus Freitag (ACL (1), 2025)

Overestimation in LLM Evaluation: A Controlled Large-Scale Study on Data Contamination's Impact on Machine Translation. - Muhammed Yusuf Kocyigit; Eleftheria Briakou; Daniel Deutsch; Jiaming Luo; Colin Cherry; Markus Freitag (CoRR, 2025)

Enhancing Human Evaluation in Machine Translation with Comparative Judgment. - Yixiao Song; Parker Riley; Daniel Deutsch; Markus Freitag (CoRR, 2025)

You Cannot Feed Two Birds with One Score: the Accuracy-Naturalness Tradeoff in Translation. - Gergely Flamich; David Vilar; Jan-Thorsten Peter; Markus Freitag (CoRR, 2025)

Preliminary Ranking of WMT25 General Machine Translation Systems. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Konstantin Dranch; Anton Dvorkovich; Sergey Dukanov; Natalia Fedorova; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; et al. (CoRR, 2025)