Guillermo Marco

According to our database, Guillermo Marco authored at least 19 papers between 2020 and 2026.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2026

Discriminative Benchmarking of Spanish Language Models: Findings from the ODESIA Challenge 2024.

Alejandro Benito-Santos, Roser Morante, Adrián Ghajari Espinosa, Iker García-Ferrero, Robiert Sepúlveda-Torres, German Rigau, Rodrigo Agerri, Juan Pablo Consuegra-Ayala, Ernesto Luis Estevanell-Valladares, Fabio Yáñez-Romero, Miquel Canal-Esteve, Yoan Gutiérrez, Rafael Muñoz Guillena, Manuel Palomar, Eva Sánchez-Salido, Guillermo Marco, Andrés Fernández García, Víctor Fresno, Enrique Amigó, Laura Plaza, Jorge Carrillo-de-Albornoz, Miguel Lucas, Julio Gonzalo

Proces. del Leng. Natural, 2026

On the Limits of LLM Reasoning: Evidence From Contamination, Translation, and Answer Modification in Multiple-Choice Benchmarks.

Eva Sánchez-Salido, Julio Gonzalo, Guillermo Marco

IEEE Access, 2026

2025

None of the Others: a General Technique to Distinguish Reasoning from Memorization in Multiple-Choice LLM Evaluation Benchmarks.

Eva Sánchez-Salido, Julio Gonzalo, Guillermo Marco

CoRR, February, 2025

BOE-XSUM: Extreme Summarization in Clear Language of Spanish Legal Decrees and Notifications.

Andrés Fernández García, Javier de la Rosa, Julio Gonzalo, Roser Morante, Enrique Amigó, Alejandro Benito-Santos, Jorge Carrillo-de-Albornoz, Víctor Fresno, Adrián Ghajari Espinosa, Guillermo Marco, Laura Plaza, Eva Sánchez-Salido

Proces. del Leng. Natural, 2025

To What Extent Is LLM Performance on Multiple-Choice Questions Driven by Data Leakage? A Case Study with Contamination-Controlled Spanish Undergraduate Exams.

Eva Sánchez-Salido, Adrián Ghajari Espinosa, Guillermo Marco, Julio Gonzalo, Jesús Abizanda, Roser Morante, Alejandro Benito-Santos, Laura Plaza, Jorge Carrillo-de-Albornoz, Víctor Fresno, Enrique Amigó, Andrés Fernández García

Inteligencia Artif., 2025

Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination.

Eva Sánchez-Salido, Roser Morante, Julio Gonzalo, Guillermo Marco, Jorge Carrillo-de-Albornoz, Laura Plaza, Enrique Amigó, Andrés Fernández García, Alejandro Benito-Santos, Adrián Ghajari Espinosa, Víctor Fresno

Proceedings of the 31st International Conference on Computational Linguistics, 2025

Small Language Models can Outperform Humans in Short Creative Writing: A Study Comparing SLMs with Humans and LLMs.

Guillermo Marco, Luz Rello, Julio Gonzalo

Proceedings of the 31st International Conference on Computational Linguistics, 2025

The Reader is the Metric: How Textual Features and Reader Profiles Explain Conflicting Evaluations of AI Creative Writing.

Guillermo Marco, Julio Gonzalo, Víctor Fresno

Proceedings of the Findings of the Association for Computational Linguistics, 2025

2024

Overview of DIPROMATS 2024: Detection, Characterization and Tracking of Propaganda in Messages from Diplomats and Authorities of World Powers.

Pablo Moral, Jesús M. Fraile, Guillermo Marco, Anselmo Peñas, Julio Gonzalo

Proces. del Leng. Natural, 2024

Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination.

Eva Sánchez-Salido, Roser Morante, Julio Gonzalo, Guillermo Marco, Jorge Carrillo-de-Albornoz, Laura Plaza, Enrique Amigó, Andrés Fernández, Alejandro Benito-Santos, Adrián Ghajari Espinosa, Víctor Fresno

CoRR, 2024

Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?

Guillermo Marco, Julio Gonzalo, Ramón del Castillo, María Teresa Mateo Girona

CoRR, 2024

Pron vs Prompt: Can Large Language Models already Challenge a World-Class Fiction Author at Creative Text Writing?

Guillermo Marco, Julio Gonzalo, María Teresa Mateo Girona, Ramón Santos

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

A Web Portal about the State of the Art of NLP Tasks in Spanish.

Enrique Amigó, Jorge Carrillo-de-Albornoz, Andrés Fernández, Julio Gonzalo, Guillermo Marco, Roser Morante, Laura Plaza, Jacobo Pedrosa

Proceedings of the 2024 Joint International Conference on Computational Linguistics, 2024

2023

Overview of DIPROMATS 2023: automatic detection and characterization of propaganda techniques in messages from diplomats and authorities of world powers.

Pablo Moral, Guillermo Marco, Julio Gonzalo, Jorge Carrillo-de-Albornoz, Iván Gonzalo-Verdugo

Proces. del Leng. Natural, 2023

ODESIA: Space for Observing the Development of Spanish in Artificial Intelligence.

Enrique Amigó, Jorge Carrillo-de-Albornoz, Andrés Fernández, Julio Gonzalo, Miguel Lucas, Guillermo Marco, Roser Morante, Jacobo Pedrosa, Laura Plaza, Ibo Sanz, Beñat San-Sebastián

Proceedings of the Annual Conference of the Spanish Association for Natural Language Processing 2023: Projects and System Demonstrations (SEPLN-PD 2023) co-located with the International Conference of the Spanish Society for Natural Language Processing (SEPLN 2023), 2023

2022

Overview of EXIST 2022: sEXism Identification in Social neTworks.

Francisco J. Rodríguez-Sanchez, Jorge Carrillo-de-Albornoz, Laura Plaza, Adrián Mendieta-Aragón, Guillermo Marco Remón, Maryna Makeienko, María Plaza, Julio Gonzalo, Damiano Spina, Paolo Rosso

Proces. del Leng. Natural, 2022

2021

Escansión automática de poesía española sin silabación.

Guillermo Marco Remón, Julio Gonzalo

Proces. del Leng. Natural, 2021

Automated Metric Analysis of Spanish Poetry: Two Complementary Approaches.

Guillermo Marco, Javier de la Rosa, Julio Gonzalo, Salvador Ros, Elena González-Blanco

IEEE Access, 2021

2020

Automatic Scansion of Spanish Poetry without Syllabification.

Guillermo Marco Remón, Julio Gonzalo

CoRR, 2020