Randomized Significance Tests in Machine Translation. - Yvette Graham; Nitika Mathur; Timothy Baldwin (WMT@ACL, 2014)

The Impact of Multiword Expression Compositionality on Machine Translation Evaluation. - Bahar Salehi; Nitika Mathur; Paul Cook; Timothy Baldwin (MWE@NAACL-HLT, 2015)

Accurate Evaluation of Segment-level Machine Translation Metrics. - Yvette Graham; Timothy Baldwin; Nitika Mathur (HLT-NAACL, 2015)

Sequence Effects in Crowdsourced Annotations. - Nitika Mathur; Timothy Baldwin; Trevor Cohn (EMNLP, 2017)

Towards Efficient Machine Translation Evaluation by Modelling Annotators. - Nitika Mathur; Timothy Baldwin; Trevor Cohn (ALTA, 2018)

Putting Evaluation in Context: Contextual Embeddings Improve Machine Translation Evaluation. - Nitika Mathur; Timothy Baldwin; Trevor Cohn (ACL (1), 2019)

Tangled up in BLEU: Reevaluating the Evaluation of Automatic Machine Translation Evaluation Metrics. - Nitika Mathur; Timothy Baldwin; Trevor Cohn (ACL, 2020)

Results of the WMT20 Metrics Shared Task. - Nitika Mathur; Johnny Wei; Markus Freitag; Qingsong Ma; Ondrej Bojar (WMT@EMNLP, 2020)

Results of the WMT21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain. - Markus Freitag; Ricardo Rei; Nitika Mathur; Chi-kiu Lo; Craig Stewart; George F. Foster; Alon Lavie; Ondrej Bojar (WMT@EMNLP, 2021)

Robustness in Machine Translation Evaluation. - Nitika Mathur (2021)

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. - Markus Freitag; Ricardo Rei; Nitika Mathur; Chi-kiu Lo; Craig Stewart; Eleftherios Avramidis; Tom Kocmi; George F. Foster; Alon Lavie; André F. T. Martins (WMT, 2022)

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. - Markus Freitag; Nitika Mathur; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Tom Kocmi; Frédéric Blain; Daniel Deutsch; Craig Stewart; Chrysoula Zerva; Sheila Castilho; et al. (WMT, 2023)

Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy. - Brian Thompson 001; Nitika Mathur; Daniel Deutsch; Huda Khayrallah (WMT, 2024)

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. - Markus Freitag; Nitika Mathur; Daniel Deutsch; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Frédéric Blain; Tom Kocmi; Jiayi Wang; David Ifeoluwa Adelani; Marianna Buchicchio; et al. (WMT, 2024)