SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic Evaluation. - Raoyuan Zhao; Abdullatif Köksal; Yihong Liu 001; Leonie Weissweiler; Anna Korhonen; Hinrich Schütze (EMNLP (Findings), 2024)

SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists. - Raoyuan Zhao; Abdullatif Köksal; Yihong Liu 001; Leonie Weissweiler; Anna Korhonen; Hinrich Schütze (CoRR, 2024)

What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns. - Michael A. Hedderich; Anyi Wang; Raoyuan Zhao; Florian Eichin; Jonas Fischer; Barbara Plank (ACL (1), 2025)

What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns. - Michael A. Hedderich; Anyi Wang; Raoyuan Zhao; Florian Eichin; Barbara Plank (CoRR, 2025)

MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs. - Raoyuan Zhao; Beiduo Chen; Barbara Plank; Michael A. Hedderich (CoRR, 2025)

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing. - Raoyuan Zhao; Abdullatif Köksal; Ali Modarressi; Michael A. Hedderich; Hinrich Schütze (CoRR, 2025)