NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmark. - Oscar Sainz; Jon Ander Campos; Iker García-Ferrero; Julen Etxaniz; Oier Lopez de Lacalle; Eneko Agirre (EMNLP (Findings), 2023)

Latxa: An Open Language Model and Evaluation Suite for Basque. - Julen Etxaniz; Oscar Sainz; Naiara Miguel; Itziar Aldabe; German Rigau; Eneko Agirre; Aitor Ormazabal; Mikel Artetxe; Aitor Soroa (ACL (1), 2024)

GITA4CALAMITA - Evaluating the Physical Commonsense Understanding of Italian LLMs in a Multi-layered Approach: A CALAMITA Challenge. - Giulia Pensa; Ekhi Azurmendi; Julen Etxaniz; Begoña Altuna; Itziar Gonzalez-Dios (CLiC-it, 2024)

Do Multilingual Language Models Think Better in English? - Julen Etxaniz; Gorka Azkune; Aitor Soroa; Oier Lopez de Lacalle; Mikel Artetxe (NAACL (Short Papers), 2024)

XNLIeu: a dataset for cross-lingual NLI in Basque. - Maite Heredia; Julen Etxaniz; Muitze Zulaika; Xabier Saralegi; Jeremy Barnes 001; Aitor Soroa (NAACL-HLT, 2024)

BertaQA: How Much Do Language Models Know About Local Culture? - Julen Etxaniz; Gorka Azkune; Aitor Soroa; Oier Lopez de Lacalle; Mikel Artetxe (NeurIPS, 2024)

IKER-GAITU: Research on Language Technology for Basque and Other Low-Resource Languages. - Eneko Agirre; Itziar Aldabe; Xabier Arregi; Mikel Artetxe; Unai Atutxa; Ekhi Azurmendi; Iker de la Iglesia; Julen Etxaniz; Víctor García Romillo; Inma Hernáez Rioja; Asier Herranz; Mikel Iruskieta; et al. (SEPLN (Projects and Demonstrations), 2024)

Latxa: An Open Language Model and Evaluation Suite for Basque. - Julen Etxaniz; Oscar Sainz; Naiara Pérez; Itziar Aldabe; German Rigau; Eneko Agirre; Aitor Ormazabal; Mikel Artetxe; Aitor Soroa (CoRR, 2024)

Lessons from the Trenches on Reproducible Evaluation of Language Models. - Stella Biderman; Hailey Schoelkopf; Lintang Sutawika; Leo Gao; Jonathan Tow; Baber Abbasi; Alham Fikri Aji; Pawan Sasanka Ammanamanchi; Sidney Black; Jordan Clive; Anthony DiPofi; Julen Etxaniz; et al. (CoRR, 2024)

Truth Knows No Language: Evaluating Truthfulness Beyond English. - Blanca Calvo Figueras; Eneko Sagarzazu; Julen Etxaniz; Jeremy Barnes 001; Pablo Gamallo 001; Iria de-Dios-Flores; Rodrigo Agerri (ACL (1), 2025)

HiTZ at VarDial 2025 NorSID: Overcoming Data Scarcity with Language Transfer and Automatic Data Annotation. - Jaione Bengoetxea; Mikel Zubillaga; Ekhi Azurmendi; Maite Heredia; Julen Etxaniz; Markel Ferro; Jeremy Barnes 001 (COLING Workshops, 2025)

Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basque. - Oscar Sainz; Naiara Pérez; Julen Etxaniz; Joseba Fernandez de Landa; Itziar Aldabe; Iker García-Ferrero; Aimar Zabala; Ekhi Azurmendi; German Rigau; Eneko Agirre; Mikel Artetxe; Aitor Soroa (CoRR, 2025)