Jan Batzner

According to our database, Jan Batzner authored at least 11 papers between 2024 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

When AI Benchmarks Plateau: A Systematic Study of Benchmark Saturation.

Mubashara Akhtar, Anka Reuel, Prajna Soni, Sanchit Ahuja, Pawan Sasanka Ammanamanchi, Ruchit Rawal, Vilém Zouhar, Srishti Yadav, Chenxi Whitehouse, Dayeon Ki, Jennifer Mickel, Leshem Choshen, Marek Suppa, Jan Batzner, Jenny Chim, Jeba Sania, Yanan Long, Hossein A. Rahmani, Christina Knight, Yiyang Nan, Jyoutir Raj, Yu Fan, Shubham Singh, Subramanyam Sahoo, Eliya Habba, Usman Gohar, Siddhesh Pawar, Robert Scholz, Arjun Subramonian, Jingwei Ni, Mykel J. Kochenderfer, Sanmi Koyejo, Mrinmaya Sachan, Stella Biderman, Zeerak Talat, Avijit Ghosh, Irene Solaiman

CoRR, February, 2026

Agent Benchmarks Fail Public Sector Requirements.

Jonathan Rystrøm, Chris Schmitz, Karolina Korgul, Jan Batzner, Chris Russell

CoRR, January, 2026

One Persona, Many Cues, Different Results: How Sociodemographic Cues Impact LLM Personalization.

Franziska Weeber, Vera Neplenbroek, Jan Batzner, Sebastian Padó

CoRR, January, 2026

2025

Sycophancy Claims about Language Models: The Missing Human-in-the-Loop.

Jan Batzner, Volker Stocker, Stefan Schmid, Gjergji Kasneci

CoRR, December, 2025

Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparency.

Jan Batzner, Volker Stocker, Bingjun Tang, Anusha Natarajan, Qinhao Chen, Stefan Schmid, Gjergji Kasneci

CoRR, December, 2025

Who Evaluates AI's Social Impacts? Mapping Coverage and Gaps in First and Third Party Evaluations.

Anka Reuel, Avijit Ghosh, Jenny Chim, Andrew Tran, Yanan Long, Jennifer Mickel, Usman Gohar, Srishti Yadav, Pawan Sasanka Ammanamanchi, Mowafak Allaham, Hossein A. Rahmani, Mubashara Akhtar, Felix Friedrich, Robert Scholz, Michael Alexander Riegler, Jan Batzner, Eliya Habba, Arushi Saxena, Anastassia Kornilova, Kevin Wei, Prajna Soni, Yohan Mathew, Kevin Klyman, Jeba Sania, Subramanyam Sahoo, Olivia Beyer Bruvik, Pouya Sadeghi, Sujata S. Goswami, Angelina Wang, Yacine Jernite, Zeerak Talat, Stella Biderman, Mykel J. Kochenderfer, Sanmi Koyejo, Irene Solaiman

CoRR, November, 2025

Measuring what Matters: Construct Validity in Large Language Model Benchmarks.

Andrew M. Bean, Ryan Othniel Kearns, Angelika Romanou, Franziska Sofia Hafner, Harry Mayne, Jan Batzner, Negar Foroutan, Chris Schmitz, Karolina Korgul, Hunar Batra, Oishi Deb, Emma Beharry, Cornelius Emde, Thomas Foster, Anna Gausen, María Grandury, Simeng Han, Valentin Hofmann, Lujain Ibrahim, Hazel Kim, Hannah Rose Kirk, Fangru Lin, Gabrielle Kaili-May Liu, Lennart Luettgau, Jabez Magomere, Jonathan Rystrøm, Anna Sotnikova, Yushi Yang, Yilun Zhao, Adel Bibi, Antoine Bosselut, Ronald Clark, Arman Cohan, Jakob N. Foerster, Yarin Gal, Scott A. Hale, Inioluwa Deborah Raji, Christopher Summerfield, Philip H. S. Torr, Cozmin Ududec, Luc Rocher, Adam Mahdi

CoRR, November, 2025

Oversight Structures for Agentic AI in Public-Sector Organizations.

Chris Schmitz, Jonathan Rystrøm, Jan Batzner

CoRR, June, 2025

News on TikTok: An Annotated Dataset of TikTok Videos from German-Speaking News Outlets in 2023.

Anna-Theresa Mayer, Lion Wedel, Jan Batzner, Jonathan Hendrickx, Emma Bremer, Alexander Iwan, Volker Stocker, Jakob Ohme

Proceedings of the Nineteenth International AAAI Conference on Web and Social Media, 2025

2024

GermanPartiesQA: Benchmarking Commercial Large Language Models for Political Bias and Sycophancy.

Jan Batzner, Volker Stocker, Stefan Schmid, Gjergji Kasneci

CoRR, 2024

Immunization against harmful fine-tuning attacks.

Domenic Rosati, Jan Wehner, Kai Williams, Lukasz Bartoszcze, Jan Batzner, Hassan Sajjad, Frank Rudzicz

CoRR, 2024