Agents to Make Your Information Meaningful and Visible: An Agent-Based Visual Information Management System. - Lora Aroyo; Italo De Diana; Darina Dicheva (WebNet, 1998)

SMILE Maker: A Web-Based Tool for Problem Solving. - Svetoslav Stoyanov; Lora Aroyo; Piet Kommers; Ivan Kurtev (WebNet, 1999)

Adaptive Authoring of Adaptive Educational Hypermedia. - Alexandra I. Cristea; Lora Aroyo (AH, 2002)

A Layered Approach towards Domain Authoring support. - Lora Aroyo; Alexandra I. Cristea; Darina Dicheva (IC-AI, 2002)

Courseware Authoring Tasks Ontology. - Lora Aroyo; Darina Dicheva (ICCE, 2002)

Concepts and Ontologies in Web-Based Educational Systems. - Lora Aroyo; Darina Dicheva (ICCE, 2002)

Ontological Support for Web Courseware Authoring. - Lora Aroyo; Darina Dicheva; Alexandra I. Cristea (Intelligent Tutoring Systems, 2002)

Agent-Oriented Knowledge Management in Learning Environments: A Peer-to-Peer Helpdesk Case Study. - Renata S. S. Guizzardi; Lora Aroyo; Gerd Wagner 001 (AMKM, 2003)

Process-aware Authoring of Web-based Educational Systems. - Lora Aroyo; Riichiro Mizoguchi (CAiSE Workshops, 2003)

Preparing SCORM for the Semantic Web. - Lora Aroyo; Stanislav Pokraev; Rogier Brussee (OTM, 2003)

Adaptive Web-Based Educational Hypermedia. - Paul De Bra; Lora Aroyo; Alexandra I. Cristea (Web Dynamics, 2004)

Workshop on Applications of Semantic Web Technologies for E-learning p. - Lora Aroyo; Darina Dicheva; Peter Brusilovsky; Paloma Díaz 001; Vania Dimitrova; Erik Duval; Jim E. Greer; Tsukasa Hirashima; Heinz Ulrich Hoppe; Geert-Jan Houben; Mitsuru Ikeda; Judy Kay; et al. (Intelligent Tutoring Systems, 2004)

EASE: Evolutional Authoring Support Environment. - Lora Aroyo; Akiko Inaba; Larisa N. Soldatova; Riichiro Mizoguchi (Intelligent Tutoring Systems, 2004)

Ontology-driven User Modeling for Modular User Adaptive Systems. - Vadim I. Chepegin; Lora Aroyo; Paul De Bra (LWA, 2004)

Semantic Web-based Adaptive Hypermedia. - Lora Aroyo; Paul De Bra; Vadim I. Chepegin (WWW Workshop on Application Design, Development and Implementation Issues in the Semantic Web, 2004)

The New Challenges for E-learning: The Educational Semantic Web. - Lora Aroyo; Darina Dicheva (J. Educ. Technol. Soc., 2004)

The Next Big Thing: Adaptive Web-Based Systems. - Paul De Bra; Lora Aroyo; Vadim I. Chepegin (J. Digit. Inf., 2004)

Embedding information retrieval in adaptive hypermedia: IR meets AHA! - Lora Aroyo; Paul De Bra; Geert-Jan Houben; Richard Vdovjak (New Rev. Hypermedia Multim., 2004)

International Workshop on Applications of Semantic Web Technologies for E-Learning (SW-EL'05). - Lora Aroyo; Darina Dicheva (AIED, 2005)

Discovery Service for User Models in a Multi-Application Context. - Vadim I. Chepegin; Lora Aroyo; Paul De Bra (ICALT, 2005)

Personalized Presentation and Navigation of Cultural Heritage Content. - Lora Aroyo; Lloyd Rutledge; Rogier Brussee; Paul De Bra; Peter Gorgels; Natalia Stash; Mettina Veenstra (ICME, 2005)

WOSE 2005 PC Co-chairs' Message. - Peter Spyns; Erik Duval; Aldo de Moor; Lora Aroyo (OTM Workshops, 2005)

Integrating Open User Modeling and Learning Content Management for the Semantic Web. - Ronald Denaux; Vania Dimitrova; Lora Aroyo (User Modeling, 2005)

An approach for ontology-based elicitation of user models to enable personalization on the semantic web. - Ronald Denaux; Lora Aroyo; Vania Dimitrova (WWW (Special interest tracks and posters), 2005)

Evaluating a Thesaurus Browser for an Audio-visual Archive. - Véronique Malaisé; Lora Aroyo; Hennie Brugman; Luit Gazendam; Annemieke de Jong; Christian Negru; Guus Schreiber (EKAW, 2006)

Interactive Ontology-Based User Knowledge Acquisition: A Case Study. - Lora Aroyo; Ronald Denaux; Vania Dimitrova; Michael Pye (ESWC, 2006)

Predicting User Experiences through Cross-Context Reasoning. - Shlomo Berkovsky; Tsvi Kuflik; Lora Aroyo; Dominik Heckmann; Alexander Kröner; Francesco Ricci 001; Geert-Jan Houben (LWA, 2006)

Determining user interests about museum collections. - Lloyd Rutledge; Lora Aroyo; Natalia Stash (WWW, 2006)

Interoperability in Personalized Adaptive Learning. - Lora Aroyo; Peter Dolog; Geert-Jan Houben; Milos Kravcik; Ambjörn Naeve; Mikael Nilsson; Fridolin Wild (J. Educ. Technol. Soc., 2006)

SenSee Framework for Personalized Access to TV Content. - Lora Aroyo; Pieter Bellekens; Martin Björkman; Geert-Jan Houben; Paul Akkermans; Annelies Kaptein (EuroITV, 2007)

User Interaction with User-Adaptive Information Filters. - Henriette S. M. Cramer; Vanessa Evers; Maarten van Someren; Bob J. Wielinga; Sam Besselink; Lloyd Rutledge; Natalia Stash; Lora Aroyo (HCI (11), 2007)

Engineering Semantic-Based Interactive Multi-device Web Applications. - Pieter Bellekens; Kees van der Sluijs; Lora Aroyo; Geert-Jan Houben (ICWE, 2007)

Personalized ambient media experience: move.me case study. - Lora Aroyo; Frank Nack; Thecla Schiphorst; Hielke Schut; Michiel Kauw A Tjoe (IUI, 2007)

Pillows as adaptive interfaces in ambient environments. - Frank Nack; Thecla Schiphorst; Zeljko Obrenovic; Michiel Kauw A Tjoe; Simon de Bakker; Angel Perez Rosillio; Lora Aroyo (HCM@MM, 2007)

CHIP Demonstrator: Semantics-driven Recommendations and Museum Tour Generation. - Lora Aroyo; Natalia Stash; Yiwen Wang 001; Peter Gorgels; Lloyd Rutledge (Semantic Web Challenge, 2007)

Semantics-based Framework for Personalized Access to TV Content: the iFanzy Use Case. - Pieter Bellekens; Lora Aroyo; Geert-Jan Houben; Annelies Kaptein; Kees van der Sluijs (Semantic Web Challenge, 2007)

PillowTalk: can we afford intimacy? - Thecla Schiphorst; Frank Nack; Michiel Kauw A Tjoe; Simon de Bakker; Stock; Lora Aroyo; Angel Perez Rosillio; Hielke Schut; Norman Jaffe (TEI, 2007)

A Semantics-Based Dialogue for Interoperability of User-Adaptive Systems in a Ubiquitous Environment. - Federica Cena; Lora Aroyo (User Modeling, 2007)

Interactive User Modeling for Personalized Access to Museum Collections: The Rijksmuseum Case Study. - Yiwen Wang 001; Lora Aroyo; Natalia Stash; Lloyd Rutledge (User Modeling, 2007)

Guest Editors' Introduction: Intelligent Educational Systems of the Present and Future. - Lora Aroyo; Arthur C. Graesser; W. Lewis Johnson (IEEE Intell. Syst., 2007)

Principles for Knowledge Engineering on the Web. - Guus Schreiber; Lora Aroyo (AAAI Spring Symposium: Symbiotic Relationships between Semantic Web and Knowledge Engineering, 2008)

Convergence of Web and TV Broadcast Data for Adaptive Content Access and Navigation. - Pieter Bellekens; Kees van der Sluijs; Lora Aroyo; Geert-Jan Houben (AH, 2008)

Accuracy in Rating and Recommending Item Features. - Lloyd Rutledge; Natalia Stash; Yiwen Wang 001; Lora Aroyo (AH, 2008)

RSS-Based Interoperability for User Adaptive Systems. - Yiwen Wang 001; Federica Cena; Francesca Carmagnola; Omar Cortassa; Cristina Gena; Natalia Stash; Lora Aroyo (AH, 2008)

Tag interoperability in cultural web-based applications. - Federica Cena; Francesca Carmagnola; Omar Cortassa; Cristina Gena; Yiwen Wang 001; Natalia Stash; Lora Aroyo (Hypertext, 2008)

On-the-fly Data Integration for Personalized Television Recommender Systems. - Pieter Bellekens; Kees van der Sluijs; Geert-Jan Houben; Lora Aroyo (ICWE, 2008)

Distributed Personalization: Bridging Digital Islands in Museum and Interactive TV. - Lora Aroyo (ERCIM News, 2008)

Semantic-based framework for personalised ambient media. - Lora Aroyo; Pieter Bellekens; Martin Björkman; Geert-Jan Houben (Multim. Tools Appl., 2008)

The effects of transparency on trust in and acceptance of a content-based art recommender. - Henriette S. M. Cramer; Vanessa Evers; Satyan Ramlal; Maarten van Someren; Lloyd Rutledge; Natalia Stash; Lora Aroyo; Bob J. Wielinga (User Model. User Adapt. Interact., 2008)

Semantic annotation and search of cultural-heritage collections: The MultimediaN E-Culture demonstrator. - Guus Schreiber; Alia K. Amin; Lora Aroyo; Mark van Assem; Viktor de Boer; Lynda Hardman; Michiel Hildebrand; Borys Omelayenko; Jacco van Ossenbruggen; Anna Tordai; Jan Wielemaker; Bob J. Wielinga (J. Web Semant., 2008)

Recommendations based on semantically enriched museum collections. - Yiwen Wang 001; Natalia Stash; Lora Aroyo; Peter Gorgels; Lloyd Rutledge; Guus Schreiber (J. Web Semant., 2008)

Semantic-Based Framework for Integration and Personalization of Television Related Media. - Pieter Bellekens; Lora Aroyo; Geert-Jan Houben (Handbook of Multimedia for Digital Entertainment and Arts, 2009)

A personalized walk through the museum: the CHIP interactive tour guide. - Ivo Roes; Natalia Stash; Yiwen Wang 001; Lora Aroyo (CHI Extended Abstracts, 2009)

User model elicitation and enrichment for context-sensitive personalization in a multiplatform tv environment. - Pieter Bellekens; Geert-Jan Houben; Lora Aroyo; Krijn Schaap; Annelies Kaptein (EuroITV, 2009)

A Model-Based Approach Providing Context-Sensitive Television Interaction. - Pieter Bellekens; Lora Aroyo; Geert-Jan Houben; Annelies Kaptein (ICWE, 2009)

Semantic relations for content-based recommendations. - Yiwen Wang 001; Natalia Stash; Lora Aroyo; Laura Hollink; Guus Schreiber (K-CAP, 2009)

Using Semantic Relations for Content-based Recommender Systems in Cultural Heritage. - Yiwen Wang 001; Natalia Stash; Lora Aroyo; Laura Hollink; Guus Schreiber (WOP, 2009)

Personalized Semantic News: Combining Semantics and Television. - Roberto Borgotallo; Roberto Del Pero; Alberto Messina; Fulvio Negro; Luca Vignaroli; Lora Aroyo; Chris J. van Aart; Alex Conconi (UCMedia, 2009)

Evaluating Interface Variants on Personality Acquisition for Recommender Systems. - Greg Dunn; Jurgen Wiersema; Jaap Ham; Lora Aroyo (UMAP, 2009)

Using AI to Access and Experience Cultural Heritage. - Lynda Hardman; Lora Aroyo; Jacco van Ossenbruggen; Eero Hyvönen (IEEE Intell. Syst., 2009)

Knowledge-Based Linguistic Annotation of Digital Cultural Heritage Collections. - Tuukka Ruotsalo; Lora Aroyo; Guus Schreiber (IEEE Intell. Syst., 2009)

Enhancing Content-Based Recommendation with the Task Model of Classification. - Yiwen Wang 001; Shenghui Wang 001; Natalia Stash; Lora Aroyo; Guus Schreiber (EKAW, 2010)

Finding Your Way through the Rijksmuseum with an Adaptive Mobile Museum Guide. - Willem Robert van Hage; Natalia Stash; Yiwen Wang 001; Lora Aroyo (ESWC (1), 2010)

Future television: integrating the social and semantic web. - Lyndon J. B. Nixon; Lora Aroyo; Dan Brickley; Libby Miller (EuroITV, 2010)

Visual interfaces to the social and semantic web (VISSW 2010). - Siegfried Handschuh; Tom Heath; VinhTuan Thai; Ian Dickinson; Lora Aroyo; Valentina Presutti (IUI, 2010)

User modeling and adaptive Semantic Web. - Lora Aroyo; Geert-Jan Houben (Semantic Web, 2010)

Crowdsourcing in the cultural heritage domain: opportunities and challenges. - Johan Oomen; Lora Aroyo (C&T, 2011)

Personalized access to cultural heritage (PATCH 2011). - Lora Aroyo; Fabian Bohnert; Tsvi Kuflik; Johan Oomen (IUI, 2011)

Visual interfaces to the social and semantic web (VISSW 2011). - Siegfried Handschuh; Lora Aroyo; VinhTuan Thai (IUI, 2011)

On the role of user-generated metadata in audio visual collections. - Riste Gligorov; Michiel Hildebrand; Jacco van Ossenbruggen; Guus Schreiber; Lora Aroyo (K-CAP, 2011)

A knowledge pattern-based method for linked data analysis. - Valentina Presutti; Lora Aroyo; Aldo Gangemi; Alessandro Adamou; Balthasar A. C. Schopman; Guus Schreiber (K-CAP, 2011)

Hacking history via event extraction. - Roxane Segers; Marieke van Erp; Lourens van der Meij; Lora Aroyo; Jacco van Ossenbruggen; Guus Schreiber; Bob J. Wielinga; Johan Oomen; Geertje Jacobs (K-CAP, 2011)

Extracting Core Knowledge from Linked Data. - Valentina Presutti; Lora Aroyo; Alessandro Adamou; Balthasar A. C. Schopman; Aldo Gangemi; Guus Schreiber (COLD, 2011)

Hacking History: Automatic Historical Event Extraction for Enriching Cultural Heritage Multimedia Collections. - Roxane Segers; Marieke van Erp; Lourens van der Meij; Lora Aroyo; Guus Schreiber; Bob J. Wielinga; Jacco van Ossenbruggen; Johan Oomen; Geertje Jacobs (DeRiVE@ISWC, 2011)

Digital hermeneutics: Agora and the online understanding of cultural heritage. - Chiel van den Akker; Susan Legêne; Marieke van Erp; Lora Aroyo; Roxane Segers; Lourens van der Meij; Jacco van Ossenbruggen; Guus Schreiber; Bob J. Wielinga; Johan Oomen; Geertje Jacobs (WebSci, 2011)

Interactive curating of user tags for audiovisual archives. - Yi-Ling Lin; Lora Aroyo (AVI, 2012)

Nichesourcing: Harnessing the Power of Crowds of Experts. - Victor de Boer; Michiel Hildebrand; Lora Aroyo; Pieter De Leenheer; Chris Dijkshoorn; Binyam Tesfa; Guus Schreiber (EKAW, 2012)

Personalized access to cultural heritage: multimedia by the crowd, for the crowd. - Johan Oomen; Lora Aroyo; Stéphane Marchand-Maillet; Jeremy Douglass (ACM Multimedia, 2012)

Making Sense of the Arab Revolution and Occupy: Visual Analytics to Understand Events. - Thomas Ploeger; Bibiana Armenta; Lora Aroyo; Frank de Bakker; Iina Hellsten (DeRiVE@ISWC, 2012)

Harnessing Disagreement for Event Semantics. - Chris Welty; Lora Aroyo (DeRiVE@ISWC, 2012)

Query Driven Hypothesis Generation for Answering Queries over NLP Graphs. - Chris Welty; Ken Barker 002; Lora Aroyo; Shilpa Arora (ISWC (2), 2012)

Personalization in crowd-driven annotation for cultural heritage collections. - Chris Dijkshoorn; Jasper Oosterman; Lora Aroyo; Geert-Jan Houben (UMAP Workshops, 2012)

Measuring Crowd Truth for Medical Relation Extraction. - Lora Aroyo; Chris Welty (AAAI Fall Symposia, 2013)

An Evaluation of Labelling-Game Data for Video Retrieval. - Riste Gligorov; Michiel Hildebrand; Jacco van Ossenbruggen; Lora Aroyo; Guus Schreiber (ECIR, 2013)

LDtogo: A Data Querying and Mapping Frameworkfor Linked Data Applications. - Niels Ockeloen; Victor de Boer; Lora Aroyo (ESWC (Satellite Events), 2013)

"Dr. Detective": combining gamification techniques and crowdsourcing to create a gold standard in medical text. - Anca Dumitrache; Lora Aroyo; Chris Welty; Robert-Jan Sips; Anthony Levas (CrowdSem, 2013)

Domain-Independent Quality Measures for Crowd Truth Disagreement. - Oana Inel; Lora Aroyo; Chris Welty; Robert-Jan Sips (DeRiVE@ISWC, 2013)

Extractivism: Extracting Activists Events from News Articles Using Existing NLP Tools and Services. - Thomas Ploeger; Maxine Kruijt; Lora Aroyo; Frank de Bakker; Iina Hellsten; Antske Fokkens; Jesper Hoeksema; Serge ter Braake (DeRiVE@ISWC, 2013)

Content and Behaviour Based Metrics for Crowd Truth. - Guillermo Soberon; Lora Aroyo; Chris Welty; Oana Inel; Manfred Overmeen; Hui Lin (CrowdSem, 2013)

Personalized Nichesourcing: Acquisition of Qualitative Annotations from Niche Communities. - Chris Dijkshoorn; Mieke H. R. Leyssen; Archana Nottamkandath; Jasper Oosterman; Myriam C. Traub; Lora Aroyo; Alessandro Bozzon; Wan J. Fokkink; Geert-Jan Houben; Henrike Hovelmann; Lizzy Jongma; Jacco van Ossenbruggen; et al. (UMAP Workshops, 2013)

Crowdsourced Evaluation of Semantic Patterns for Recommendation. - Valentina Maccatrozzo; Lora Aroyo; Willem Robert van Hage (UMAP Workshops, 2013)

From information delivery to interpretation support: evaluating cultural heritage access on the web. - Chiel van den Akker; Ardjan van Nuland; Lourens van der Meij; Marieke van Erp; Susan Legêne; Lora Aroyo; Guus Schreiber (WebSci, 2013)

Analyzing user behavior across social sharing environments. - Pasquale De Meo; Emilio Ferrara; Fabian Abel; Lora Aroyo; Geert-Jan Houben (ACM Trans. Intell. Syst. Technol., 2013)

First International Workshop on User Interfaces for Crowdsourcing and Human Computation. - Alessandro Bozzon; Lora Aroyo; Paolo Cremonesi (AVI, 2014)

Using Linked Data to Diversify Search Results a Case Study in Cultural Heritage. - Chris Dijkshoorn; Lora Aroyo; Guus Schreiber; Jan Wielemaker; Lizzy Jongma (EKAW, 2014)

A Semantic Pattern-Based Recommender. - Valentina Maccatrozzo; Davide Ceolin; Lora Aroyo; Paul Groth (SemWebEval@ESWC, 2014)

Personalized access to cultural heritage (PATCH2014): the future of experiencing cultural heritage. - Johan Oomen; Lora Aroyo; Cristina Gena; Alan J. Wecker (IUI Companion, 2014)

INVENiT: Exploring Cultural Heritage Collections While Adding Annotations. - Chris Dijkshoorn; Jacco van Ossenbruggen; Lora Aroyo; Guus Schreiber (IESD@ISWC, 2014)

CrowdTruth: Machine-Human Computation Framework for Harnessing Disagreement in Gathering Annotated Data. - Oana Inel; Khalid Khamkham; Tatiana Cristea; Anca Dumitrache; Arne Rutjes; Jelle van der Ploeg; Lukasz Romaszko; Lora Aroyo; Robert-Jan Sips (ISWC (2), 2014)

Crowdsourcing knowledge-intensive tasks in cultural heritage. - Jasper Oosterman; Archana Nottamkandath; Chris Dijkshoorn; Alessandro Bozzon; Geert-Jan Houben; Lora Aroyo (WebSci, 2014)

Crowd vs. experts: nichesourcing for knowledge intensive tasks in cultural heritage. - Jasper Oosterman; Alessandro Bozzon; Geert-Jan Houben; Archana Nottamkandath; Chris Dijkshoorn; Lora Aroyo; Mieke H. R. Leyssen; Myriam C. Traub (WWW (Companion Volume), 2014)

The Three Sides of CrowdTruth. - Lora Aroyo; Chris Welty (Hum. Comput., 2014)

Provenance-driven Representation of Crowdsourcing Data for Efficient Data Analysis. - Carlos Martinez-Ortiz; Lora Aroyo; Oana Inel; Stavros Champilomatis; Anca Dumitrache; Benjamin Timmermans (e-Science, 2015)

PATCH 2015: Personalized Access to Cultural Heritage. - Liliana Ardissono; Cristina Gena; Lora Aroyo; Tsvika Kuflik; Alan J. Wecker; Johan Oomen; Oliviero Stock (IUI, 2015)

Achieving Expert-Level Annotation Quality with CrowdTruth: The Case of Medical Relation Extraction. - Anca Dumitrache; Lora Aroyo; Chris Welty (BDM2I@ISWC, 2015)

CrowdTruth Measures for Language Ambiguity: The Case of Medical Relation Extraction. - Anca Dumitrache; Lora Aroyo; Chris Welty (LD4IE@ISWC, 2015)

Crowdsourcing ground truth for Question Answering using CrowdTruth. - Benjamin Timmermans; Lora Aroyo; Chris Welty (WebSci, 2015)

Truth Is a Lie: Crowd Truth and the Seven Myths of Human Annotation. - Lora Aroyo; Chris Welty (AI Mag., 2015)

On the impact of knowledge extraction and aggregation on crowdsourced annotation of visual artworks. - Jasper Oosterman; Jie Yang 028; Alessandro Bozzon; Lora Aroyo; Geert-Jan Houben (Comput. Networks, 2015)

DIVE into the event-based browsing of linked historical media. - Victor de Boer; Johan Oomen; Oana Inel; Lora Aroyo; Elco van Staveren; Werner Helmich; Dennis de Beurs (J. Web Semant., 2015)

Unshared Task at the 3rd Workshop on Argument Mining: Perspective Based Local Agreement and Disagreement in Online Debate. - Chantal van Son; Tommaso Caselli; Antske Fokkens; Isa Maks; Roser Morante; Lora Aroyo; Piek Vossen (ArgMining@ACL, 2016)

Time-aware Multi-Viewpoint Summarization of Multilingual Social Text Streams. - Zhaochun Ren; Oana Inel; Lora Aroyo; Maarten de Rijke (CIKM, 2016)

Capturing the Ineffable: Collecting, Analysing, and Automating Web Document Quality Assessments. - Davide Ceolin; Julia Noordegraaf; Lora Aroyo (EKAW, 2016)

Crowdsourcing Salient Information from News and Tweets. - Oana Inel; Tommaso Caselli; Lora Aroyo (LREC, 2016)

The VU Sound Corpus: Adding More Fine-grained Annotations to the Freesound Database. - Emiel van Miltenburg; Benjamin Timmermans; Lora Aroyo (LREC, 2016)

GRaSP: A Multilayered Annotation Scheme for Perspectives. - Chantal van Son; Tommaso Caselli; Antske Fokkens; Isa Maks; Roser Morante; Lora Aroyo; Piek Vossen (LREC, 2016)

Identifying and Classifying Uncertainty Layers in Web Document Quality Assessment. - Davide Ceolin; Lora Aroyo; Julia Noordegraaf (URSW@ISWC, 2016)

Towards web documents quality assessment for digital humanities scholars. - Davide Ceolin; Julia Noordegraaf; Lora Aroyo; Chantal van Son (WebSci, 2016)

Medical Relation Extraction Gold Standard with CrowdTruth. - Anca Dumitrache; Lora Aroyo; Chris Welty (Zenodo, 2016)

False Positive and Cross-relation Signals in Distant Supervision Data. - Anca Dumitrache; Lora Aroyo; Chris Welty (AKBC@NIPS, 2017)

Harnessing Diversity in Crowds and Machines for Better NER Performance. - Oana Inel; Lora Aroyo (ESWC (1), 2017)

Linking Dutch World War II Cultural Heritage Collections with Events Extracted by Machines and Crowds. - Jessie Both; Didi de Hooge; Ramses IJff; Oana Inel; Victor de Boer; Lora Aroyo (SEMANTiCS (Workshops), 2017)

Event Extraction From Radio News Bulletins. - Kim van Putten; Oana Inel; Victor de Boer; Lora Aroyo (SEMANTiCS (Workshops), 2017)

Optimizing Explorative Search for the Needs of Media Professionals: The DIVE+ Use Case. - Justin Verhulst; Oana Inel; Victor de Boer; Lora Aroyo (SEMANTiCS (Workshops), 2017)

SIRUP: Serendipity In Recommendations via User Perceptions. - Valentina Maccatrozzo; Manon Terstall; Lora Aroyo; Guus Schreiber (IUI, 2017)

Enriching Media Collections for Event-Based Exploration. - Victor de Boer; Liliana Melgar; Oana Inel; Carlos Martinez-Ortiz; Lora Aroyo; Johan Oomen (MTSR, 2017)

Computational Controversy. - Benjamin Timmermans; Tobias Kuhn; Kaspar Beelen; Lora Aroyo (SocInfo (2), 2017)

Everybody, More or Less, likes Serendipity. - Valentina Maccatrozzo; Eveline van Everdingen; Lora Aroyo; Guus Schreiber (UMAP (Adjunct Publication), 2017)

Topical Video Search: Analysing Video Concept Annotation through Crowdsourcing Games. - Riste Gligorov; Michiel Hildebrand; Jacco van Ossenbruggen; Lora Aroyo; Guus Schreiber (Hum. Comput., 2017)

Using Centrality Measures to Predict Helpfulness-Based Reputation in Trust Networks. - Pasquale De Meo; Katarzyna Musial-Gabrys; Domenico Rosaci; Giuseppe M. L. Sarnè; Lora Aroyo (ACM Trans. Internet Techn., 2017)

Studying Topical Relevance with Evidence-based Crowdsourcing. - Oana Inel; Giannis Haralabopoulos; Dan Li 015; Christophe Van Gysel; Zoltán Szlávik; Elena Simperl; Evangelos Kanoulas; Lora Aroyo (CIKM, 2018)

Scoring and Classifying Implicit Positive Interpretations: A Challenge of Class Imbalance. - Chantal van Son; Roser Morante; Lora Aroyo; Piek Vossen (COLING, 2018)

Challenges in Enabling Mixed Media Scholarly Research with Multi-media Data in a Sustainable Infrastructure. - Roeland Ordelman; Carlos Martinez-Ortiz; Liliana M. Melgar Estrada; Marijn Koolen; Jaap Blom; Willem Melder; Jasmijn van Gorp; Victor de Boer; Themistoklis Karavellas; Lora Aroyo; Thomas Poell; Norah Karrouche; et al. (DH, 2018)

Assessing and Visualising Online Information Quality. - Davide Ceolin; Jacco van Ossenbruggen; Lora Aroyo; Ozkan Sener; Robin Sharma; Lesia Tkacz; Julia Noordegraaf (eScience, 2018)

Crowdsourcing Semantic Label Propagation in Relation Classification. - Anca Dumitrache; Lora Aroyo; Chris Welty (FEVER@EMNLP, 2018)

Capturing Ambiguity in Crowdsourcing Frame Disambiguation. - Anca Dumitrache; Lora Aroyo; Chris Welty (HCOMP, 2018)

CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement (short paper). - Anca Dumitrache; Oana Inel; Lora Aroyo; Benjamin Timmermans; Chris Welty (SAD/CrowdBias@HCOMP, 2018)

A Study of Narrative Creation by Means of Crowds and Niches. - Oana Inel; Sabrina Sauer; Lora Aroyo (HCOMP (WIP&Demo), 2018)

CaptureBias: Supporting Media Scholars with Ambiguity-Aware Bias Representation for News Videos (short paper). - Markus de Jong; Panagiotis Mavridis; Lora Aroyo; Alessandro Bozzon; Jesse de Vos; Johan Oomen; Antoaneta Dimitrova; Alec Badenoch (SAD/CrowdBias@HCOMP, 2018)

A Human in the Loop Approach to Capture Bias and Support Media Scientists in News Video Analysis (short paper). - Panagiotis Mavridis; Markus de Jong; Lora Aroyo; Alessandro Bozzon; Jesse de Vos; Johan Oomen; Antoaneta Dimitrova; Alec Badenoch (SAD/CrowdBias@HCOMP, 2018)

Resource Interoperability for Sustainable Benchmarking: The Case of Events. - Chantal van Son; Oana Inel; Roser Morante; Lora Aroyo; Piek Vossen (LREC, 2018)

Homonym Detection For Humor Recognition In Short Text. - Sven van den Beukel; Lora Aroyo (WASSA@EMNLP, 2018)

Augmenting Intelligence with Humans-in-the-Loop (HumL@WWW2018) Chairs' Welcome & Organization. - Lora Aroyo; Gianluca Demartini; Anna Lisa Gentile; Chris Welty (WWW (Companion Volume), 2018)

The Quantum Collective. - Lora Aroyo; Chris Welty (WWW (Companion Volume), 2018)

Reports of the Workshops Held at the Sixth AAAI Conference on Human Computation and Crowdsourcing. - Lora Aroyo; Anca Dumitrache; Jeffrey V. Nickerson; Matthew Lease; Pietro Michelucci (AI Mag., 2018)

Modeling cultural heritage data for online publication. - Chris Dijkshoorn; Lora Aroyo; Jacco van Ossenbruggen; Guus Schreiber (Appl. Ontology, 2018)

CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement. - Anca Dumitrache; Oana Inel; Lora Aroyo; Benjamin Timmermans; Chris Welty (CoRR, 2018)

The Rijksmuseum collection as Linked Data. - Chris Dijkshoorn; Lizzy Jongma; Lora Aroyo; Jacco van Ossenbruggen; Guus Schreiber; Wesley ter Weele; Jan Wielemaker (Semantic Web, 2018)

Semantic Web and Human Computation: The status of an emerging field. - Marta Sabou; Lora Aroyo; Kalina Bontcheva; Alessandro Bozzon; Rehab K. Qarout (Semantic Web, 2018)

Crowdsourcing Ground Truth for Medical Relation Extraction. - Anca Dumitrache; Lora Aroyo; Chris Welty (ACM Trans. Interact. Intell. Syst., 2018)

CrowdTruth Corpus for Open Domain Relation Extraction from Sentences. - Anca Dumitrache; Lora Aroyo; Chris Welty (Zenodo, 2018)

FrameNet Semantic Frame Disambiguation with CrowdTruth. - Anca Dumitrache; Lora Aroyo; Chris Welty (Zenodo, 2018)

Validation Methodology for Expert-Annotated Datasets: Event Annotation Case Study. - Oana Inel; Lora Aroyo (LDK, 2019)

A Crowdsourced Frame Disambiguation Corpus with Ambiguity. - Anca Dumitrache; Lora Aroyo; Chris Welty (NAACL-HLT (1), 2019)

Crowdsourcing Inclusivity: Dealing with Diversity of Opinions, Perspectives and Ambiguity in Annotated Data. - Lora Aroyo; Anca Dumitrache; Oana Inel; Zoltán Szlávik; Benjamin Timmermans; Chris Welty (WWW (Companion Volume), 2019)

Crowdsourcing Subjective Tasks: The Case Study of Understanding Toxicity in Online Discussions. - Lora Aroyo; Lucas Dixon; Nithum Thain; Olivia Redfield; Rachel Rosen (WWW (Companion Volume), 2019)

The AI Bookie The Future of Voice Interfaces to Intelligent Assistants. - Chris Welty; Lora Aroyo; Eric Horvitz (AI Mag., 2019)

Metrology for AI: From Benchmarks to Instruments. - Chris Welty; Praveen K. Paritosh; Lora Aroyo (CoRR, 2019)

Accurator: Nichesourcing for Cultural Heritage. - Chris Dijkshoorn; Victor de Boer; Lora Aroyo; Guus Schreiber (Hum. Comput., 2019)

Eliciting User Preferences for Personalized Explanations for Video Summaries. - Oana Inel; Nava Tintarev; Lora Aroyo (UMAP, 2020)

The AI Bookie - Place Your Bets: Will Machine Learning Outgrow Human Labeling? - Mike Schaekermann; Christopher Homan; Lora Aroyo; Praveen K. Paritosh; Kurt D. Bollacker; Chris Welty (AI Mag., 2020)

Web Semantics for Digital Humanities. - Lora Aroyo; Franciska de Jong; Eero Hyvönen; Sara Tonelli (J. Web Semant., 2020)

Cross-replication Reliability - An Empirical Approach to Interpreting Inter-rater Reliability. - Ka Wong; Praveen K. Paritosh; Lora Aroyo (ACL/IJCNLP (1), 2021)

"Everyone wants to do the model work, not the data work": Data Cascades in High-Stakes AI. - Nithya Sambasivan; Shivani Kapania; Hannah Highfill; Diana Akrong; Praveen K. Paritosh; Lora Aroyo (CHI, 2021)

Rapid Instance-Level Knowledge Acquisition for Google Maps from Class-Level Common Sense. - Chris Welty; Lora Aroyo; Flip Korn; Sara M. McCarthy; Shubin Zhao (HCOMP, 2021)

Empirical methodology for crowdsourcing ground truth. - Anca Dumitrache; Oana Inel; Benjamin Timmermans; Carlos Martinez-Ortiz; Robert-Jan Sips; Lora Aroyo; Chris Welty (Semantic Web, 2021)

Annotator Response Distributions as a Sampling Frame. - Christopher Homan; Tharindu Cyril Weerasooriya; Lora Aroyo; Chris Welty (NLPerspectives@LREC, 2022)

LaMDA: Language Models for Dialog Applications. - Romal Thoppilan; Daniel De Freitas; Jamie Hall; Noam Shazeer; Apoorv Kulshreshtha; Heng-Tze Cheng; Alicia Jin; Taylor Bos; Leslie Baker; Yu Du; YaGuang Li; Hongrae Lee; et al. (CoRR, 2022)

DataPerf: Benchmarks for Data-Centric AI Development. - Mark Mazumder; Colby R. Banbury; Xiaozhe Yao; Bojan Karlas; William Gaviria Rojas; Sudnya Frederick Diamos; Greg Diamos; Lynn He; Douwe Kiela; David Jurado; David Kanter; Rafael Mosquera; et al. (CoRR, 2022)

Addressing Label Sparsity With Class-Level Common Sense for Google Maps. - Chris Welty; Lora Aroyo; Flip Korn; Sara M. McCarthy; Shubin Zhao (Frontiers Artif. Intell., 2022)

Data excellence for AI: why should you care? - Lora Aroyo; Matthew Lease; Praveen K. Paritosh; Mike Schaekermann (Interactions, 2022)

Fine-tuning machine confidence with human relevance for video discovery. - Oana Inel; Lora Aroyo (Interactions, 2022)

Follow the leader(board) with confidence: Estimating p-values from a single test set with item and response variance. - Shira Wein; Christopher Homan; Lora Aroyo; Chris Welty (ACL (Findings), 2023)

Human-Centered Responsible Artificial Intelligence: Current & Future Trends. - Mohammad Tahaei; Marios Constantinides; Daniele Quercia; Sean Kennedy; Michael J. Muller; Simone Stumpf; Q. Vera Liao; Ricardo Baeza-Yates; Lora Aroyo; Jess Holbrook; Ewa Luger; Michael Madaio; et al. (CHI Extended Abstracts, 2023)

AART: AI-Assisted Red-Teaming with Diverse Data Generation for New LLM-powered Applications. - Bhaktipriya Radharapu; Kevin Robinson; Lora Aroyo; Preethi Lahoti (EMNLP (Industry Track), 2023)

DICES Dataset: Diversity in Conversational AI Evaluation for Safety. - Lora Aroyo; Alex S. Taylor; Mark Díaz; Christopher Homan; Alicia Parrish; Gregory Serapio-García; Vinodkumar Prabhakaran; Ding Wang (NeurIPS, 2023)

DataPerf: Benchmarks for Data-Centric AI Development. - Mark Mazumder; Colby R. Banbury; Xiaozhe Yao; Bojan Karlas; William Gaviria Rojas; Sudnya Frederick Diamos; Greg Diamos; Lynn He; Alicia Parrish; Hannah Rose Kirk; Jessica Quaye; Charvi Rastogi; et al. (NeurIPS, 2023)

Measuring Attribution in Natural Language Generation Models. - Hannah Rashkin; Vitaly Nikolaev; Matthew Lamm; Lora Aroyo; Michael Collins 001; Dipanjan Das 001; Slav Petrov; Gaurav Singh Tomar; Iulia Turc; David Reitter (Comput. Linguistics, 2023)

The Reasonable Effectiveness of Diverse Evaluation Data. - Lora Aroyo; Mark Diaz; Christopher Homan; Vinodkumar Prabhakaran; Alex S. Taylor; Ding Wang (CoRR, 2023)

Adversarial Nibbler: A Data-Centric Challenge for Improving the Safety of Text-to-Image Models. - Alicia Parrish; Hannah Rose Kirk; Jessica Quaye; Charvi Rastogi; Max Bartolo; Oana Inel; Juan Ciro; Rafael Mosquera; Addison Howard; Will Cukierski; D. Sculley; Vijay Janapa Reddi; et al. (CoRR, 2023)

Intersectionality in Conversational AI Safety: How Bayesian Multilevel Models Help Understand Diverse Perceptions of Safety. - Christopher M. Homan; Greg Serapio-García; Lora Aroyo; Mark Diaz; Alicia Parrish; Vinodkumar Prabhakaran; Alex S. Taylor; Ding Wang (CoRR, 2023)

"Is a picture of a bird a bird": Policy recommendations for dealing with ambiguity in machine vision models. - Alicia Parrish; Sarah Laszlo; Lora Aroyo (CoRR, 2023)

Collect, Measure, Repeat: Reliability Factors for Responsible AI Data Collection. - Oana Inel; Tim Draws; Lora Aroyo (CoRR, 2023)

A Framework to Assess (Dis)agreement Among Diverse Rater Groups. - Vinodkumar Prabhakaran; Christopher Homan; Lora Aroyo; Alicia Parrish; Alex S. Taylor; Mark Díaz; Ding Wang (CoRR, 2023)

DMLR: Data-centric Machine Learning Research - Past, Present and Future. - Luis Oala; Manil Maskey; Lilith Bat-Leah; Alicia Parrish; Nezihe Merve Gürel; Tzu-Sheng Kuo; Yang Liu 018; Rotem Dror; Danilo Brajovic; Xiaozhe Yao; Max Bartolo; William Gaviria Rojas; et al. (CoRR, 2023)

Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation. - Jessica Quaye; Alicia Parrish; Oana Inel; Charvi Rastogi; Hannah Rose Kirk; Minsuk Kahng; Erin van Liemt; Max Bartolo; Jess Tsang; Justin White; Nathan Clement; Rafael Mosquera; et al. (FAccT, 2024)

GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives. - Vinodkumar Prabhakaran; Christopher Homan; Lora Aroyo; Aida Mostafazadeh Davani; Alicia Parrish; Alex S. Taylor; Mark Diaz; Ding Wang; Gregory Serapio-García (NAACL-HLT, 2024)

Introducing v0.5 of the AI Safety Benchmark from MLCommons. - Bertie Vidgen; Adarsh Agrawal; Ahmed M. Ahmed 004; Victor Akinwande; Namir Al-Nuaimi; Najla Alfaraj; Elie Alhajjar; Lora Aroyo; Trupti Bavalatti; Borhane Blili-Hamelin; Kurt D. Bollacker; Rishi Bomassani; et al. (CoRR, 2024)

A Standardized Machine-readable Dataset Documentation Format for Responsible AI. - Nitisha Jain; Mubashara Akhtar; Joan Giner-Miguelez; Rajat Shinde; Joaquin Vanschoren; Steffen Vogler; Subhra S. Goswami; Yuhan Rao; Tim Santos; Luis Oala; Michalis Karamousadakis; Manil Maskey; et al. (CoRR, 2024)

Imagen 3. - Jason Baldridge; Jakob Bauer; Mukul Bhutani; Nicole Brichtova; Andrew Bunner; Kelvin Chan; Yichang Chen; Sander Dieleman; Yuqing Du; Zach Eaton-Rosen; Hongliang Fei; Nando de Freitas; et al. (CoRR, 2024)

Insights on Disagreement Patterns in Multimodal Safety Perception across Diverse Rater Groups. - Charvi Rastogi; Tian Huey Teh; Pushkar Mishra; Roma Patel; Zoe Ashwood; Aida Mostafazadeh Davani; Mark Diaz; Michela Paganini; Alicia Parrish; Ding Wang; Vinodkumar Prabhakaran; Lora Aroyo; et al. (CoRR, 2024)

Nuanced Safety for Generative AI: How Demographics Shape Responsiveness to Severity. - Pushkar Mishra; Charvi Rastogi; Stephen R. Pfohl; Alicia Parrish; Roma Patel; Mark Diaz; Ding Wang; Michela Paganini; Vinodkumar Prabhakaran; Lora Aroyo; Verena Rieser (CoRR, 2025)

Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models. - Charvi Rastogi; Tian Huey Teh; Pushkar Mishra; Roma Patel; Ding Wang; Mark Díaz; Alicia Parrish; Aida Mostafazadeh Davani; Zoe Ashwood; Michela Paganini; Vinodkumar Prabhakaran; Verena Rieser; et al. (CoRR, 2025)

"Just a strange pic": Evaluating 'safety' in GenAI Image safety annotation tasks from diverse annotators' perspectives. - Ding Wang; Mark Díaz; Charvi Rastogi; Aida Mostafazadeh Davani; Vinodkumar Prabhakaran; Pushkar Mishra; Roma Patel; Alicia Parrish; Zoe Ashwood; Michela Paganini; Tian Huey Teh; Verena Rieser; et al. (CoRR, 2025)

From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models. - Jessica Quaye; Charvi Rastogi; Alicia Parrish; Oana Inel; Minsuk Kahng; Lora Aroyo; Vijay Janapa Reddi (CoRR, 2025)