Enriching Morphologically Poor Languages for Statistical Machine Translation. - Eleftherios Avramidis; Philipp Koehn (ACL, 2008)

DFKI's SC and MT submissions to IWSLT 2011. - David Vilar; Eleftherios Avramidis; Maja Popovic; Sabine Hunsicker (IWSLT, 2011)

Evaluate with Confidence Estimation: Machine ranking of translation outputs using grammatical features. - Eleftherios Avramidis; Maja Popovic; David Vilar; Aljoscha Burchardt (WMT@EMNLP, 2011)

Evaluation without references: IBM1 scores as evaluation metrics. - Maja Popovic; David Vilar; Eleftherios Avramidis; Aljoscha Burchardt (WMT@EMNLP, 2011)

Comparative Quality Estimation: Automatic Sentence-Level Ranking of Multiple Machine Translation Outputs. - Eleftherios Avramidis (COLING, 2012)

Involving Language Professionals in the Evaluation of Machine Translation. - Eleftherios Avramidis; Aljoscha Burchardt; Christian Federmann; Maja Popovic; Cindy Tscherwinka; David Vilar (LREC, 2012)

A Richly Annotated, Multilingual Parallel Corpus for Hybrid Machine Translation. - Eleftherios Avramidis; Marta R. Costa-jussà; Christian Federmann; Josef van Genabith; Maite Melero; Pavel Pecina (LREC, 2012)

The ML4HMT Workshop on Optimising the Division of Labour in Hybrid Machine Translation. - Christian Federmann; Eleftherios Avramidis; Marta R. Costa-jussà; Josef van Genabith; Maite Melero; Pavel Pecina (LREC, 2012)

Quality estimation for Machine Translation output using linguistic analysis and decoding features. - Eleftherios Avramidis (WMT@NAACL-HLT, 2012)

A CCG-based Quality Estimation Metric for Statistical Machine Translation Learning from Human Judgments of Machine Translation Output. - Maja Popovic; Eleftherios Avramidis; Aljoscha Burchardt; Sabine Hunsicker; Sven Schmeier; Cindy Tscherwinka; David Vilar (MTSummit (Posters), 2013)

Learning from Human Judgments of Machine Translation Output. - Maja Popovic; Eleftherios Avramidis; Aljoscha Burchardt; Sabine Hunsicker; Sven Schmeier; Cindy Tscherwinka; David Vilar (MTSummit (Posters), 2013)

What can we learn about the selection mechanism for post-editing? - Maja Popovic; Eleftherios Avramidis; Aljoscha Burchardt; David Vilar; Hans Uszkoreit (WPTP@MTSummit, 2013)

Selecting Feature Sets for Comparative and Time-Oriented Quality Estimation of Machine Translation Output. - Eleftherios Avramidis; Maja Popovic (WMT@ACL, 2013)

Sentence-level ranking with quality estimation. - Eleftherios Avramidis (Mach. Transl., 2013)

RankEval: Open Tool for Evaluation of Machine-Learned Ranking. - Eleftherios Avramidis (Prague Bull. Math. Linguistics, 2013)

QuEst - Design, Implementation and Extensions of a Framework for Machine Translation Quality Estimation. - Kashif Shah; Eleftherios Avramidis; Ergun Biçici; Lucia Specia (Prague Bull. Math. Linguistics, 2013)

Machine Translation at Work. - Aljoscha Burchardt; Cindy Tscherwinka; Eleftherios Avramidis; Hans Uszkoreit (Computational Linguistics - Applications, 2013)

Using a new analytic measure for the annotation and analysis of MT errors on real data. - Arle Lommel; Aljoscha Burchardt; Maja Popovic; Kim Harris; Eleftherios Avramidis; Hans Uszkoreit (EAMT, 2014)

Relations between different types of post-editing operations, cognitive effort and temporal effort. - Maja Popovic; Arle Lommel; Aljoscha Burchardt; Eleftherios Avramidis; Hans Uszkoreit (EAMT, 2014)

Correlating decoding events with errors in Statistical Machine Translation. - Eleftherios Avramidis; Maja Popovic (ICON, 2014)

The taraXÜ corpus of human-annotated machine translations. - Eleftherios Avramidis; Aljoscha Burchardt; Sabine Hunsicker; Maja Popovic; Cindy Tscherwinka; David Vilar; Hans Uszkoreit (LREC, 2014)

Efforts on Machine Learning over Human-mediated Translation Edit Rate. - Eleftherios Avramidis (WMT@ACL, 2014)

Involving language professionals in the evaluation of machine translation. - Maja Popovic; Eleftherios Avramidis; Aljoscha Burchardt; Sabine Hunsicker; Sven Schmeier; Cindy Tscherwinka; David Vilar; Hans Uszkoreit (Lang. Resour. Evaluation, 2014)

Qualitative: Open source Python tool for Quality Estimation over multiple Machine Translation outputs. - Eleftherios Avramidis; Lukas Poustka; Sven Schmeier (Prague Bull. Math. Linguistics, 2014)

Towards Deeper MT - A Hybrid System for German. - Eleftherios Avramidis; Aljoscha Burchardt; Maja Popovic; Hans Uszkoreit (DMTW, 2015)

Poor man's lemmatisation for automatic error classification. - Maja Popovic; Mihael Arcan; Eleftherios Avramidis; Aljoscha Burchardt; Arle Lommel (EAMT, 2015)

DFKI's experimental hybrid MT system for WMT 2015. - Eleftherios Avramidis; Maja Popovic; Aljoscha Burchardt (WMT@EMNLP, 2015)

MT-ComparEval: Graphical evaluation interface for Machine Translation development. - Ondrej Klejch; Eleftherios Avramidis; Aljoscha Burchardt; Martin Popel (Prague Bull. Math. Linguistics, 2015)

Deeper Machine Translation and Evaluation for German. - Eleftherios Avramidis; Vivien Macketanz; Aljoscha Burchardt; Jindrich Helcl; Hans Uszkoreit (DMTW, 2016)

Tools and Guidelines for Principled Machine Translation Development. - Nora Aranberri; Eleftherios Avramidis; Aljoscha Burchardt; Ondrej Klejch; Martin Popel; Maja Popovic (LREC, 2016)

DFKI's system for WMT16 IT-domain task, including analysis of systematic errors. - Eleftherios Avramidis (WMT, 2016)

Qualitative: Python Tool for MT Quality Estimation Supporting Server Mode and Hybrid MT. - Eleftherios Avramidis (Prague Bull. Math. Linguistics, 2016)

Sentence-level quality estimation by predicting HTER as a multi-component metric. - Eleftherios Avramidis (WMT, 2017)

Optimisation of an exemplar oculomotor model using multi-objective genetic algorithms executed on a GPU-CPU combination. - Eleftherios Avramidis; Ozgur E. Akman (BMC Syst. Biol., 2017)

Comparative Quality Estimation for Machine Translation Observations on Machine Learning and Features. - Eleftherios Avramidis (Prague Bull. Math. Linguistics, 2017)

QE: : GUI - A Graphical User Interface for Quality Estimation. - Eleftherios Avramidis (Prague Bull. Math. Linguistics, 2017)

Fine-grained evaluation of Quality Estimation for Machine translation based on a linguistically motivated Test Suite. - Eleftherios Avramidis; Vivien Macketanz; Arle Lommel; Hans Uszkoreit (PostEditing@AMTA, 2018)

Fine-grained evaluation of German-English Machine Translation based on a Test Suite. - Vivien Macketanz; Eleftherios Avramidis; Aljoscha Burchardt; Hans Uszkoreit (WMT (shared task), 2018)

Workshop on Wearables and Machine Learning: Applications of Artificial Intelligence, Approaches on Textile Technology. - Friederike Fröbel; Eleftherios Avramidis; Gesche Joost (CHIuXiD, 2019)

Train, Sort, Explain: Learning to Diagnose Translation Models. - Robert Schwarzenberg; David Harbecke; Vivien Macketanz; Eleftherios Avramidis; Sebastian Möller 001 (NAACL-HLT (Demonstrations), 2019)

Linguistic Evaluation of German-English Machine Translation Using a Test Suite. - Eleftherios Avramidis; Vivien Macketanz; Ursula Strohriegel; Hans Uszkoreit (WMT (2), 2019)

Comparative Quality Estimation for Machine Translation. An Application of Artificial Intelligence on Language Technology using Machine Learning of Human Preferences. - Eleftherios Avramidis (2019)

Fine-grained linguistic evaluation for state-of-the-art Machine Translation. - Eleftherios Avramidis; Vivien Macketanz; Ursula Strohriegel; Aljoscha Burchardt; Sebastian Möller 001 (WMT@EMNLP, 2020)

SODECL: An Open-Source Library for Calculating Multiple Orbits of a System of Stochastic Differential Equations in Parallel. - Eleftherios Avramidis; Marta Lalik; Ozgur E. Akman (ACM Trans. Math. Softw., 2020)

Observing the Learning Curve of NMT Systems With Regard to Linguistic Phenomena. - Patrick Stadler; Vivien Macketanz; Eleftherios Avramidis (ACL (student), 2021)

A Data Augmentation Approach for Sign-Language-To-Text Translation In-The-Wild. - Fabrizio Nunnari; Cristina España-Bonet; Eleftherios Avramidis (LDK, 2021)

Automatic generation of a 3D sign language avatar on AR glasses given 2D videos of human signers. - Lan Thao Nguyen; Florian Schicktanz; Aeneas Stankowski; Eleftherios Avramidis (AT4SSL@MTSummit, 2021)

Evaluating the translation of speech to virtually-performed sign language on AR glasses. - Lan Thao Nguyen; Florian Schicktanz; Aeneas Stankowski; Eleftherios Avramidis (QoMEX, 2021)

Linguistic Evaluation for the 2021 State-of-the-art Machine Translation Systems for German to English and English to German. - Vivien Macketanz; Eleftherios Avramidis; Shushen Manakhimova; Sebastian Möller 001 (WMT@EMNLP, 2021)

Using Neural Machine Translation Methods for Sign Language Translation. - Galina Angelova; Eleftherios Avramidis; Sebastian Möller 001 (ACL (student), 2022)

A Linguistically Motivated Test Suite to Semi-Automatically Evaluate German-English Machine Translation Output. - Vivien Macketanz; Eleftherios Avramidis; Aljoscha Burchardt; He Wang; Renlong Ai; Shushen Manakhimova; Ursula Strohriegel; Sebastian Möller 001; Hans Uszkoreit (LREC, 2022)

A Test Suite for the Evaluation of Portuguese-English Machine Translation. - Mariana Avelino; Vivien Macketanz; Eleftherios Avramidis; Sebastian Möller 001 (PROPOR, 2022)

Linguistically Motivated Evaluation of Machine Translation Metrics Based on a Challenge Set. - Eleftherios Avramidis; Vivien Macketanz (WMT, 2022)

Results of WMT22 Metrics Shared Task: Stop Using BLEU - Neural Metrics Are Better and More Robust. - Markus Freitag; Ricardo Rei; Nitika Mathur; Chi-kiu Lo; Craig Stewart; Eleftherios Avramidis; Tom Kocmi; George F. Foster; Alon Lavie; André F. T. Martins (WMT, 2022)

Experimental Machine Translation of the Swiss German Sign Language via 3D Augmentation of Body Keypoints. - Lorenz Hufe; Eleftherios Avramidis (WMT, 2022)

Linguistically Motivated Evaluation of the 2022 State-of-the-art Machine Translation Systems for Three Language Directions. - Vivien Macketanz; Shushen Manakhimova; Eleftherios Avramidis; Ekaterina Lapshinova-Koltunski; Sergei Bagdasarov; Sebastian Möller 001 (WMT, 2022)

Findings of the First WMT Shared Task on Sign Language Translation (WMT-SLT22). - Mathias Müller 002; Sarah Ebling; Eleftherios Avramidis; Alessia Battisti; Michèle Berger; Richard Bowden; Annelies Braffort; Necati Cihan Camgöz; Cristina España-Bonet; Roman Grundkiewicz; Zifan Jiang; Oscar Koller; et al. (WMT, 2022)

Neural Machine Translation Methods for Translating Text to Sign Language Glosses. - Dele Zhu; Vera Czehmann; Eleftherios Avramidis (ACL (1), 2023)

Textile Game Controller: Smart knee pads for Therapeutic Exercising. - Esther Friederike Zahn; Hannah Friederike Fischer; Clara Elisabeth Gleiß; Eleftherios Avramidis; Gesche Joost (CHI Extended Abstracts, 2023)

First WMT Shared Task on Sign Language Translation (WMT-SLT22). - Mathias Müller 002; Sarah Ebling; Eleftherios Avramidis; Alessia Battisti; Michèle Berger; Richard Bowden; Annelies Braffort; Necati Cihan Camgöz; Cristina España-Bonet; Roman Grundkiewicz; Zifan Jiang; Oscar Koller; et al. (EAMT, 2023)

Disambiguating Signs: Deep Learning-based Gloss-level Classification for German Sign Language by Utilizing Mouth Actions. - Dinh Nam Pham; Vera Czehmann; Eleftherios Avramidis (ESANN, 2023)

Towards Incorporating 3D Space-Awareness Into an Augmented Reality Sign Language Interpreter. - Fabrizio Nunnari; Eleftherios Avramidis; Vemburaj Yadav; Alain Pagani; Yasser Hamidullah; Sepideh Mollanorozy; Cristina España-Bonet; Emil Woop; Patrick Gebhard (ICASSP Workshops, 2023)

Findings of the Second WMT Shared Task on Sign Language Translation (WMT-SLT23). - Mathias Müller 002; Malihe Alikhani; Eleftherios Avramidis; Richard Bowden; Annelies Braffort; Necati Cihan Camgöz; Sarah Ebling; Cristina España-Bonet; Anne Göhring; Roman Grundkiewicz; Mert Inan; Zifan Jiang; et al. (WMT, 2023)

Challenging the State-of-the-art Machine Translation Metrics from a Linguistic Perspective. - Eleftherios Avramidis; Shushen Manakhimova; Vivien Macketanz; Sebastian Möller 001 (WMT, 2023)

Results of WMT23 Metrics Shared Task: Metrics Might Be Guilty but References Are Not Innocent. - Markus Freitag; Nitika Mathur; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Tom Kocmi; Frédéric Blain; Daniel Deutsch; Craig Stewart; Chrysoula Zerva; Sheila Castilho; et al. (WMT, 2023)

Findings of the 2023 Conference on Machine Translation (WMT23): LLMs Are Here but Not Quite There Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Philipp Koehn; et al. (WMT, 2023)

Linguistically Motivated Evaluation of the 2023 State-of-the-art Machine Translation: Can ChatGPT Outperform NMT? - Shushen Manakhimova; Eleftherios Avramidis; Vivien Macketanz; Ekaterina Lapshinova-Koltunski; Sergei Bagdasarov; Sebastian Möller 001 (WMT, 2023)

DGS-Fabeln-1: A Multi-Angle Parallel Corpus of Fairy Tales between German Sign Language and German Text. - Fabrizio Nunnari; Eleftherios Avramidis; Cristina España-Bonet; Marco González; Anna Hennes; Patrick Gebhard (LREC/COLING, 2024)

Occiglot at WMT24: European Open-source Large Language Models Evaluated on Translation. - Eleftherios Avramidis; Annika Grützner-Zahn; Manuel Brack; Patrick Schramowski; Pedro Ortiz Suarez; Malte Ostendorff; Fabio Barth; Shushen Manakhimova; Vivien Macketanz; Georg Rehm; Kristian Kersting (WMT, 2024)

Machine Translation Metrics Are Better in Evaluating Linguistic Errors on LLMs than on Encoder-Decoder Systems. - Eleftherios Avramidis; Shushen Manakhimova; Vivien Macketanz; Sebastian Möller 001 (WMT, 2024)

Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task. - Markus Freitag; Nitika Mathur; Daniel Deutsch; Chi-kiu Lo; Eleftherios Avramidis; Ricardo Rei; Brian Thompson 001; Frédéric Blain; Tom Kocmi; Jiayi Wang; David Ifeoluwa Adelani; Marianna Buchicchio; et al. (WMT, 2024)

Findings of the WMT24 General Machine Translation Shared Task: The LLM Era Is Here but MT Is Not Solved Yet. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (WMT, 2024)

Error Span Annotation: A Balanced Approach for Human Evaluation of Machine Translation. - Tom Kocmi; Vilém Zouhar; Eleftherios Avramidis; Roman Grundkiewicz; Marzena Karpinska; Maja Popovic; Mrinmaya Sachan; Mariya Shmatova (WMT, 2024)

Investigating the Linguistic Performance of Large Language Models in Machine Translation. - Shushen Manakhimova; Vivien Macketanz; Eleftherios Avramidis; Ekaterina Lapshinova-Koltunski; Sergei Bagdasarov; Sebastian Möller 001 (WMT, 2024)

Preliminary WMT24 Ranking of General MT Systems and LLMs. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Anton Dvorkovich; Christian Federmann; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; Barry Haddow; Marzena Karpinska; et al. (CoRR, 2024)

Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language. - Dinh Nam Pham; Eleftherios Avramidis (CoRR, 2025)

The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face? - Dinh Nam Pham; Eleftherios Avramidis (CoRR, 2025)

Evaluation of a Sign Language Avatar on Comprehensibility, User Experience & Acceptability. - Fenya Wasserroth; Eleftherios Avramidis; Vera Czehmann; Tanja Kojic; Fabrizio Nunnari; Sebastian Möller 001 (CoRR, 2025)

The TUB Sign Language Corpus Collection. - Eleftherios Avramidis; Vera Czehmann; Fabian Deckert; Lorenz Hufe; Aljoscha Lipski; Yuni Amaloa Quintero Villalobos; Tae Kwon Rhee; Mengqian Shi; Lennart Stölting; Fabrizio Nunnari; Sebastian Möller 001 (CoRR, 2025)

Preliminary Ranking of WMT25 General Machine Translation Systems. - Tom Kocmi; Eleftherios Avramidis; Rachel Bawden; Ondrej Bojar; Konstantin Dranch; Anton Dvorkovich; Sergey Dukanov; Natalia Fedorova; Mark Fishel; Markus Freitag; Thamme Gowda; Roman Grundkiewicz; et al. (CoRR, 2025)