Raoyuan Zhao

According to our database, Raoyuan Zhao authored at least 6 papers between 2024 and 2025.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2025

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing.

Raoyuan Zhao, Abdullatif Köksal, Ali Modarressi, Michael A. Hedderich, Hinrich Schütze

CoRR, May, 2025

MAKIEval: A Multilingual Automatic WiKidata-based Framework for Cultural Awareness Evaluation for LLMs.

Raoyuan Zhao, Beiduo Chen, Barbara Plank, Michael A. Hedderich

CoRR, May, 2025

What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns.

Michael A. Hedderich, Anyi Wang, Raoyuan Zhao, Florian Eichin, Barbara Plank

CoRR, April, 2025

What's the Difference? Supporting Users in Identifying the Effects of Prompt and Model Changes Through Token Patterns.

Michael A. Hedderich, Anyi Wang, Raoyuan Zhao, Florian Eichin, Jonas Fischer, Barbara Plank

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists.

Raoyuan Zhao, Abdullatif Köksal, Yihong Liu, Leonie Weissweiler, Anna Korhonen, Hinrich Schütze

CoRR, 2024

SynthEval: Hybrid Behavioral Testing of NLP Models with Synthetic Evaluation.

Raoyuan Zhao, Abdullatif Köksal, Yihong Liu, Leonie Weissweiler, Anna Korhonen, Hinrich Schütze

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024