Emiel van Miltenburg

According to our database, Emiel van Miltenburg authored at least 31 papers between 2015 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisations.

Anouck Braggaar, Christine Liebrecht, Emiel van Miltenburg, Emiel J. Krahmer

CoRR, 2023

Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP.

Anya Belz, Craig Thomson, Ehud Reiter, Gavin Abercrombie, Jose Maria Alonso-Moral, Mohammad Arvan, Jackie Chi Kit Cheung, Mark Cieliebak, Elizabeth Clark, Kees van Deemter, Tanvi Dinkar, Ondrej Dusek, Steffen Eger, Qixiang Fang, Albert Gatt, Dimitra Gkatzia, Javier González-Corbelle, Dirk Hovy, Manuela Hürlimann, Takumi Ito, John D. Kelleher, Filip Klubicka, Huiyuan Lai, Chris van der Lee, Emiel van Miltenburg, Yiru Li, Saad Mahamood, Margot Mieskes, Malvina Nissim, Natalie Parde, Ondrej Plátek, Verena Rieser, Pablo Mosteiro Romero, Joel R. Tetreault, Antonio Toral, Xiaojun Wan, Leo Wanner, Lewis Watson, Diyi Yang

CoRR, 2023

Evaluating NLG systems: A brief introduction.

Emiel van Miltenburg

CoRR, 2023

2022

Implicit causality in GPT-2: a case study.

Hien Huynh, Tomas O. Lentz, Emiel van Miltenburg

CoRR, 2022

2021

Human evaluation of automatically generated text: Current trends and best practice guidelines.

Chris van der Lee, Albert Gatt, Emiel van Miltenburg, Emiel Krahmer

Comput. Speech Lang., 2021

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics.

Sebastian Gehrmann, Tosin P. Adewumi, Karmanya Aggarwal, Pawan Sasanka Ammanamanchi, Aremu Anuoluwapo, Antoine Bosselut, Khyathi Raghavi Chandu, Miruna-Adriana Clinciu, Dipanjan Das, Kaustubh D. Dhole, Wanyu Du, Esin Durmus, Ondrej Dusek, Chris Emezue, Varun Gangal, Cristina Garbacea, Tatsunori Hashimoto, Yufang Hou, Yacine Jernite, Harsh Jhamtani, Yangfeng Ji, Shailza Jolly, Dhruv Kumar, Faisal Ladhak, Aman Madaan, Mounica Maddela, Khyati Mahajan, Saad Mahamood, Bodhisattwa Prasad Majumder, Pedro Henrique Martins, Angelina McMillan-Major, Simon Mille, Emiel van Miltenburg, Moin Nadeem, Shashi Narayan, Vitaly Nikolaev, Rubungo Andre Niyongabo, Salomey Osei, Ankur P. Parikh, Laura Perez-Beltrachini, Niranjan Ramesh Rao, Vikas Raunak, Juan Diego Rodriguez, Sashank Santhanam, João Sedoc, Thibault Sellam, Samira Shaikh, Anastasia Shimorina, Marco Antonio Sobrevilla Cabezudo, Hendrik Strobelt, Nishant Subramani, Wei Xu, Diyi Yang, Akhila Yerukola, Jiawei Zhou

CoRR, 2021

Automatic Construction of Evaluation Suites for Natural Language Generation Datasets.

Simon Mille, Kaustubh D. Dhole, Saad Mahamood, Laura Perez-Beltrachini, Varun Gangal, Mihir Sanjay Kale, Emiel van Miltenburg, Sebastian Gehrmann

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

Preregistering NLP research.

Emiel van Miltenburg, Chris van der Lee, Emiel Krahmer

Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2021

Underreporting of errors in NLG output, and what to do about it.

Emiel van Miltenburg, Miruna-Adriana Clinciu, Ondrej Dusek, Dimitra Gkatzia, Stephanie Inglis, Leo Leppänen, Saad Mahamood, Emma Manning, Stephanie Schoch, Craig Thomson, Luou Wen

Proceedings of the 14th International Conference on Natural Language Generation, 2021

2020

On the use of human reference data for evaluating automatic image descriptions.

Emiel van Miltenburg

CoRR, 2020

Gradations of Error Severity in Automatic Image Descriptions.

Emiel van Miltenburg, Wei-Ting Lu, Emiel Krahmer, Albert Gatt, Guanyi Chen, Lin Li, Kees van Deemter

Proceedings of the 13th International Conference on Natural Language Generation, 2020

Twenty Years of Confusion in Human Evaluation: NLG Needs Evaluation Sheets and Standardised Definitions.

David M. Howcroft, Anya Belz, Miruna-Adriana Clinciu, Dimitra Gkatzia, Sadid A Hasan, Saad Mahamood, Simon Mille, Emiel van Miltenburg, Sashank Santhanam, Verena Rieser

Proceedings of the 13th International Conference on Natural Language Generation, 2020

2019

Interactive Exploration of Journalistic Video Footage through Multimodal Semantic Matching.

Sarah Ibrahimi, Shuo Chen, Devanshu Arya, Arthur Câmara, Yunlu Chen, Tanja Crijns, Maurits van der Goes, Thomas Mensink, Emiel van Miltenburg, Daan Odijk, William Thong, Jiaojiao Zhao, Pascal Mettes

Proceedings of the 27th ACM International Conference on Multimedia, 2019

On task effects in NLG corpus elicitation: a replication study using mixed effects modeling.

Emiel van Miltenburg, Merel van de Kerkhof, Ruud Koolen, Martijn Goudbeek, Emiel Krahmer

Proceedings of the 12th International Conference on Natural Language Generation, 2019

Best practices for the human evaluation of automatically generated text.

Chris van der Lee, Albert Gatt, Emiel van Miltenburg, Sander Wubben, Emiel Krahmer

Proceedings of the 12th International Conference on Natural Language Generation, 2019

Neural data-to-text generation: A comparison between pipeline and end-to-end architectures.

Thiago Castro Ferreira, Chris van der Lee, Emiel van Miltenburg, Emiel Krahmer

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2018

Varying image description tasks: spoken versus written descriptions.

Emiel van Miltenburg, Ruud Koolen, Emiel Krahmer

Proceedings of the Fifth Workshop on NLP for Similar Languages, Varieties and Dialects, 2018

Talking about other people: an endless range of possibilities.

Emiel van Miltenburg, Desmond Elliott, Piek Vossen

Proceedings of the 11th International Conference on Natural Language Generation, 2018

DIDEC: The Dutch Image Description and Eye-tracking Corpus.

Emiel van Miltenburg, Ákos Kádár, Ruud Koolen, Emiel Krahmer

Proceedings of the 27th International Conference on Computational Linguistics, 2018

Measuring the Diversity of Automatic Image Descriptions.

Emiel van Miltenburg, Desmond Elliott, Piek Vossen

Proceedings of the 27th International Conference on Computational Linguistics, 2018

2017

Room for improvement in automatic image description: an error analysis.

Emiel van Miltenburg, Desmond Elliott

CoRR, 2017

Cross-linguistic differences and similarities in image descriptions.

Emiel van Miltenburg, Desmond Elliott, Piek Vossen

Proceedings of the 10th International Conference on Natural Language Generation, 2017

Pragmatic descriptions of perceptual stimuli.

Emiel van Miltenburg

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

2016

Scalar Diversity.

Bob van Tiel, Emiel van Miltenburg, Natalia Zevakhina, Bart Geurts

J. Semant., 2016

Stereotyping and Bias in the Flickr30K Dataset.

Emiel van Miltenburg

CoRR, 2016

Open Dutch WordNet.

Marten Postma, Emiel van Miltenburg, Roxane Segers, Anneleen Schoen, Piek Vossen

Proceedings of the 8th Global WordNet Conference, 2016

WordNet-based similarity metrics for adjectives.

Emiel van Miltenburg

Proceedings of the 8th Global WordNet Conference, 2016

The VU Sound Corpus: Adding More Fine-grained Annotations to the Freesound Database.

Emiel van Miltenburg, Benjamin Timmermans, Lora Aroyo

Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, 2016

Pragmatic Factors in Image Description: The Case of Negations.

Emiel van Miltenburg, Roser Morante, Desmond Elliott

Proceedings of the 5th Workshop on Vision and Language, 2016

2015

Detecting and ordering adjectival scalemates.

Emiel van Miltenburg

CoRR, 2015

Sound-based distributional models.

Alessandro Lopopolo, Emiel van Miltenburg

Proceedings of the 11th International Conference on Computational Semantics, 2015