Measuring the Impact of Spelling Errors on the Quality of Machine Translation. - Irina Galinskaya; Valentin Gusev; Elena Mescheryakova; Mariya Shmatova (LREC, 2014)

YSDA Participation in the WMT'16 Quality Estimation Shared Task. - Anna Kozlova; Mariya Shmatova; Anton Frolov 001 (WMT, 2016)

Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks. - Andrey Malinin; Neil Band; Yarin Gal; Mark J. F. Gales; Alexander Ganshin; German Chesnokov; Alexey Noskov; Andrey Ploskonosov; Liudmila Prokhorenkova; Ivan Provilkov; Vatsal Raina; Vyas Raina; et al. (NeurIPS Datasets and Benchmarks, 2021)

Shifts: A Dataset of Real Distributional Shift Across Multiple Large-Scale Tasks. - Andrey Malinin; Neil Band; Alexander Ganshin; German Chesnokov; Yarin Gal; Mark J. F. Gales; Alexey Noskov; Andrey Ploskonosov; Liudmila Prokhorenkova; Ivan Provilkov; Vatsal Raina; Vyas Raina; et al. (CoRR, 2021)

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Philipp Koehn; et al. (WMT, 2023)

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (WMT, 2024)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. - Tom Kocmi; Vilém Zouhar; Eleftherios Avramidis; Roman Grundkiewicz; Marzena Karpinska; Maja Popovic; Mrinmaya Sachan; Mariya Shmatova (WMT, 2024)

Preliminary WMT24 Ranking of General MT Systems and LLMs. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (CoRR, 2024)

Preliminary Ranking of WMT25 General Machine Translation Systems. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Konstantin Dranch; Anton Dvorkovich; Sergey Dukanov; Natalia Fedorova; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; et al. (CoRR, 2025)