Wout Schellaert

According to our database, Wout Schellaert authored at least 12 papers between 2022 and 2025.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2025

Analysing the Predictability of Language Model Performance.

Wout Schellaert, Fernando Martínez-Plumed, José Hernández-Orallo

ACM Trans. Intell. Syst. Technol., April, 2025

PredictaBoard: Benchmarking LLM Score Predictability.

Lorenzo Pacchiardi, Konstantinos Voudouris, Ben Slater, Fernando Martínez-Plumed, José Hernández-Orallo, Lexin Zhou, Wout Schellaert

Proceedings of the Findings of the Association for Computational Linguistics, 2025

2024

Larger and more instructable language models become less reliable.

Lexin Zhou, Wout Schellaert, Fernando Martínez-Plumed, Yael Moros-Daval, Cèsar Ferri, José Hernández-Orallo

Nat., October, 2024

Larger and more instructable language models become less reliable (code and data).

Lexin Zhou, Wout Schellaert, Fernando Martínez-Plumed, Yael Moros-Daval, Cèsar Ferri, José Hernández-Orallo

Dataset, September, 2024

Larger and more instructable language models become less reliable (code and data).

Lexin Zhou, Wout Schellaert, Fernando Martínez-Plumed, Yael Moros-Daval, Cèsar Ferri, José Hernández-Orallo

Dataset, September, 2024

Larger and More Instructable Language Models Turned Less Reliable (Code and Data).

Lexin Zhou, Wout Schellaert, Fernando Martínez-Plumed, Yael Moros-Daval, Cèsar Ferri, José Hernández-Orallo

Dataset, July, 2024

Your Prompt Is My Command: On Assessing the Human-Centred Generality of Multimodal Models (Abstract Reprint).

Wout Schellaert, Fernando Martínez-Plumed, Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Seán Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo

Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, 2024

2023

Your Prompt is My Command: On Assessing the Human-Centred Generality of Multimodal Models.

Wout Schellaert, Fernando Martínez-Plumed, Karina Vold, John Burden, Pablo A. M. Casares, Bao Sheng Loe, Roi Reichart, Seán Ó hÉigeartaigh, Anna Korhonen, José Hernández-Orallo

J. Artif. Intell. Res., 2023

Animal-AI 3: What's New & Why You Should Care.

Konstantinos Voudouris, Ibrahim Alhas, Wout Schellaert, Matthew Crosby, Joel Holmes, John Burden, Niharika Chaubey, Niall Donnelly, Matishalin Patel, Marta Halina, José Hernández-Orallo, Lucy G. Cheke

CoRR, 2023

Predictable Artificial Intelligence.

Lexin Zhou, Pablo Antonio Moreno Casares, Fernando Martínez-Plumed, John Burden, Ryan Burnell, Lucy Cheke, Cèsar Ferri, Alexandru Marcoci, Behzad Mehrbakhsh, Yael Moros-Daval, Seán Ó hÉigeartaigh, Danaja Rutar, Wout Schellaert, Konstantinos Voudouris, José Hernández-Orallo

CoRR, 2023

2022

Reject Before You Run: Small Assessors Anticipate Big Language Models.

Lexin Zhou, Fernando Martínez-Plumed, José Hernández-Orallo, Cèsar Ferri, Wout Schellaert

Proceedings of the Workshop on AI Evaluation Beyond Metrics co-located with the 31st International Joint Conference on Artificial Intelligence (IJCAI-ECAI 2022), 2022

Training on the Test Set: Mapping the System-Problem Space in AI.

José Hernández-Orallo, Wout Schellaert, Fernando Martínez-Plumed

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022