UFAL Submissions to the IWSLT 2016 MT Track. - Ondrej Bojar; Ondrej Cífka; Jindrich Helcl; Tom Kocmi; Roman Sudarikov (IWSLT, 2016)

CzEng 1.6: Enlarged Czech-English Parallel Corpus with Processing Tools Dockered. - Ondrej Bojar; Ondrej Dusek; Tom Kocmi; Jindrich Libovický; Michal Novák; Martin Popel; Roman Sudarikov; Dusan Varis (TSD, 2016)

SubGram: Extending Skip-Gram Word Representation with Substrings. - Tom Kocmi; Ondrej Bojar (TSD, 2016)

CUNI NMT System for WAT 2017 Translation Tasks. - Tom Kocmi; Dusan Varis; Ondrej Bojar (WAT@IJCNLP, 2017)

LanideNN: Multilingual Language Identification on Text Stream. - Tom Kocmi; Ondrej Bojar (EACL (1), 2017)

An Exploration of Word Embedding Initialization in Deep-Learning Tasks. - Tom Kocmi; Ondrej Bojar (ICON, 2017)

Curriculum Learning and Minibatch Bucketing in Neural Machine Translation. - Tom Kocmi; Ondrej Bojar (RANLP, 2017)

Results of the WMT17 Neural MT Training Task. - Ondrej Bojar; Jindrich Helcl; Tom Kocmi; Jindrich Libovický; Tomás Musil (WMT, 2017)

CUNI submission in WMT17: Chimera goes neural. - Roman Sudarikov; David Marecek; Tom Kocmi; Dusan Varis; Ondrej Bojar (WMT, 2017)

LanideNN: Multilingual Language Identification on Character Window. - Tom Kocmi; Ondrej Bojar (CoRR, 2017)

CUNI NMT System for WAT 2018 Translation Tasks. - Tom Kocmi; Shantipriya Parida; Ondrej Bojar (WAT@PACLIC, 2018)

Neural Monkey: The Current State and Beyond. - Jindrich Helcl; Jindrich Libovický; Tom Kocmi; Tomás Musil; Ondrej Cífka; Dusan Varis; Ondrej Bojar (AMTA (1), 2018)

CUNI Basque-to-English Submission in IWSLT18. - Tom Kocmi; Dusan Varis; Ondrej Bojar (IWSLT, 2018)

SumeCzech: Large Czech News-Based Summarization Dataset. - Milan Straka; Nikita Mediankin; Tom Kocmi; Zdenek Zabokrtský; Vojtech Hudecek; Jan Hajic (LREC, 2018)

Trivial Transfer Learning for Low-Resource Neural Machine Translation. - Tom Kocmi; Ondrej Bojar (WMT, 2018)

CUNI Submissions in WMT18. - Tom Kocmi; Roman Sudarikov; Ondrej Bojar (WMT (shared task), 2018)

CUNI Submission for Low-Resource Languages in WMT News 2019. - Tom Kocmi; Ondrej Bojar (WMT (2), 2019)

Transfer Learning across Languages from Someone Else's NMT Model. - Tom Kocmi; Ondrej Bojar (CoRR, 2019)

Efficiently Reusing Old Models Across Languages via Transfer Learning. - Tom Kocmi; Ondrej Bojar (EAMT, 2020)

THEaiTRE: Artificial Intelligence to Write a Theatre Play. - Rudolf Rosa; Ondrej Dusek; Tom Kocmi; David Marecek; Tomás Musil; Patrícia Schmidtová; Dominik Jurko; Ondrej Bojar; Daniel Hrbek; David Kosták; Martina Kinská; Josef Dolezal; et al. (AI4Narratives@IJCAI, 2020)

Findings of the 2020 Conference on Machine Translation (WMT20). - Loïc Barrault; Magdalena Biesialska; Ondrej Bojar; Marta R. Costa-jussà; Christian Federmann; Yvette Graham; Roman Grundkiewicz; Barry Haddow; Matthias Huck; Eric Joanis; Tom Kocmi; Philipp Koehn; et al. (WMT@EMNLP, 2020)

CUNI Submission for the Inuktitut Language in WMT News 2020. - Tom Kocmi (WMT@EMNLP, 2020)

Gender Coreference and Bias Evaluation at WMT 2020. - Tom Kocmi; Tomasz Limisiewicz; Gabriel Stanovsky (WMT@EMNLP, 2020)

CUNI Systems for the Unsupervised and Very Low Resource Translation Task in WMT20. - Ivana Kvapilíková; Tom Kocmi; Ondrej Bojar (WMT@EMNLP, 2020)

Exploring Benefits of Transfer Learning in Neural Machine Translation. - Tom Kocmi (CoRR, 2020)

Announcing CzEng 2.0 Parallel Corpus with over 2 Gigawords. - Tom Kocmi; Martin Popel; Ondrej Bojar (CoRR, 2020)

THEaiTRE 1.0: Interactive Generation of Theatre Play Scripts. - Rudolf Rosa; Tomás Musil; Ondrej Dusek; Dominik Jurko; Patrícia Schmidtová; David Marecek; Ondrej Bojar; Tom Kocmi; Daniel Hrbek; David Kosták; Martina Kinská; Marie Nováková; et al. (Text2Story@ECIR, 2021)

When a Robot Writes a Play: Automatically Generating a Theatre Play Script. - Rudolf Rosa; Tomás Musil; Ondrej Dusek; Dominik Jurko; Patrícia Schmidtová; David Marecek; Ondrej Bojar; Tom Kocmi; Daniel Hrbek; David Kosták; Martina Kinská; Marie Nováková; et al. (ALIFE, 2021)

Findings of the 2021 Conference on Machine Translation (WMT21). - Farhad Akhbardeh; Arkady Arkhangorodsky; Magdalena Biesialska; Ondrej Bojar; Rajen Chatterjee; Vishrav Chaudhary; Marta R. Costa-jussà; Cristina España-Bonet; Angela Fan; Christian Federmann; Markus Freitag; Yvette Graham; et al. (WMT@EMNLP, 2021)

To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translation. - Tom Kocmi; Christian Federmann; Roman Grundkiewicz; Marcin Junczys-Dowmunt; Hitokazu Matsushita; Arul Menezes (WMT@EMNLP, 2021)

On User Interfaces for Large-Scale Document-Level Human Evaluation of Machine Translation Outputs. - Roman Grundkiewicz; Marcin Junczys-Dowmunt; Christian Federmann; Tom Kocmi (CoRR, 2021)

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. - Markus Freitag; Ricardo Rei; Nitika Mathur; Chi-kiu Lo; Craig Stewart; Eleftherios Avramidis; Tom Kocmi; George F. Foster; Alon Lavie; André F. T. Martins (WMT, 2022)

Findings of the 2022 Conference on Machine Translation (WMT22). - Tom Kocmi; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Thamme Gowda; Yvette Graham; Roman Grundkiewicz; Barry Haddow; Rebecca Knowles; Philipp Koehn; et al. (WMT, 2022)

MS-COMET: More and Better Human Judgements Improve Metric Performance. - Tom Kocmi; Hitokazu Matsushita; Christian Federmann (WMT, 2022)

Searching for a Higher Power in the Human Evaluation of MT. - Johnny Tian-Zheng Wei; Tom Kocmi; Christian Federmann (WMT, 2022)

The Reality of Multi-Lingual Machine Translation. - Tom Kocmi; Dominik Machácek; Ondrej Bojar (CoRR, 2022)

Poor Man's Quality Estimation: Predicting Reference-Based MT Metrics Without the Reference. - Vilém Zouhar; Shehzaad Dhuliawala; Wangchunshu Zhou; Nico Daheim; Tom Kocmi; Yuchen Eleanor Jiang; Mrinmaya Sachan (EACL, 2023)

Large Language Models Are State-of-the-Art Evaluators of Translation Quality. - Tom Kocmi; Christian Federmann (EAMT, 2023)

Overview of the Second Shared Task on Automatic Minuting (AutoMin) at INLG 2023. - Tirthankar Ghosal; Ondrej Bojar; Marie Hledíková; Tom Kocmi; Anna Nedoluzhko (INLG (Generation Challenges), 2023)

eBLEU: Unexpectedly Good Machine Translation Evaluation Using Simple Word Embeddings. - Muhammad N. ElNokrashy; Tom Kocmi (WMT, 2023)

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. - Markus Freitag; Nitika Mathur; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Tom Kocmi; Frédéric Blain; Daniel Deutsch; Craig Stewart; Chrysoula Zerva; Sheila Castilho; et al. (WMT, 2023)

Cometoid: Distilling Strong Reference-based Machine Translation Metrics into Even Stronger Quality Estimation Metrics. - Thamme Gowda; Tom Kocmi; Marcin Junczys-Dowmunt (WMT, 2023)

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Philipp Koehn; et al. (WMT, 2023)

GEMBA-MQM: Detecting Translation Quality Error Spans with GPT-4. - Tom Kocmi; Christian Federmann (WMT, 2023)

Evaluating Metrics for Document-context Evaluation in Machine Translation. - Vikas Raunak; Tom Kocmi; Matt Post (WMT, 2023)

Findings of the WMT 2023 Shared Task on Machine Translation with Terminologies. - Kirill Semenov; Vilém Zouhar; Tom Kocmi; Dongdong Zhang 001; Wangchunshu Zhou; Yuchen Eleanor Jiang (WMT, 2023)

Navigating the Metrics Maze: Reconciling Score Magnitudes and Accuracies. - Tom Kocmi; Vilém Zouhar; Christian Federmann; Matt Post (ACL (1), 2024)

Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models. - Qingyu Lu; Baopu Qiu; Liang Ding 006; Kanjian Zhang; Tom Kocmi; Dacheng Tao (ACL (Findings), 2024)

SLIDE: Reference-free Evaluation for Machine Translation using a Sliding Document Window. - Vikas Raunak; Tom Kocmi; Matt Post (NAACL (Short Papers), 2024)

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References. - Tianyi Tang; Hongyuan Lu; Yuchen Jiang; Haoyang Huang; Dongdong Zhang 001; Wayne Xin Zhao; Tom Kocmi; Furu Wei (NAACL-HLT, 2024)

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. - Markus Freitag; Nitika Mathur; Daniel Deutsch; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Frédéric Blain; Tom Kocmi; Jiayi Wang; David Ifeoluwa Adelani; Marianna Buchicchio; et al. (WMT, 2024)

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (WMT, 2024)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. - Tom Kocmi; Vilém Zouhar; Eleftherios Avramidis; Roman Grundkiewicz; Marzena Karpinska; Maja Popovic; Mrinmaya Sachan; Mariya Shmatova (WMT, 2024)

Preliminary WMT24 Ranking of General MT Systems and LLMs. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (CoRR, 2024)

Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontier. - John Dang; Shivalika Singh; Daniel D'souza; Arash Ahmadian; Alejandro Salamanca; Madeline Smith; Aidan Peppin; Sungjin Hong; Manoj Govindassamy; Terrence Zhao; Sandra Kublik; Meor Amer; et al. (CoRR, 2024)

AI-Assisted Human Evaluation of Machine Translation. - Vilém Zouhar; Tom Kocmi; Mrinmaya Sachan (NAACL (Long Papers), 2025)

Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets. - Nikita Moghe; Arnisa Fazla; Chantal Amrhein; Tom Kocmi; Mark Steedman; Alexandra Birch; Rico Sennrich; Liane Guillou (Comput. Linguistics, 2025)

Estimating Machine Translation Difficulty. - Lorenzo Proietti 002; Stefano Perrella; Vilém Zouhar; Roberto Navigli; Tom Kocmi (CoRR, 2025)

Preliminary Ranking of WMT25 General Machine Translation Systems. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Konstantin Dranch; Anton Dvorkovich; Sergey Dukanov; Natalia Fedorova; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; et al. (CoRR, 2025)