Annalisa Szymanski

According to our database, Annalisa Szymanski authored at least 15 papers between 2024 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

MultEval: Supporting Collaborative Alignment for LLM-as-a-Judge Evaluation Criteria.

Charles Chiang, Simret Araya Gebreegziabher, Annalisa Szymanski, Yukun Yang, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Toby Jia-Jun Li, Diego Gómez-Zará

CoRR, April, 2026

Automated Benchmark Generation from Domain Guidelines Informed by Bloom's Taxonomy.

Si Chen, Le Huy Khiem, Annalisa Szymanski, Ronald A. Metoyer, Ting Hua, Nitesh V. Chawla

CoRR, January, 2026

Key Considerations for Domain Expert Involvement in LLM Design and Evaluation: An Ethnographic Study.

Annalisa Szymanski, Oghenemaro Anuyah, Toby Jia-Jun Li, Ronald A. Metoyer

Proceedings of the 31st International Conference on Intelligent User Interfaces, 2026

MultEval: Collaboratively Creating Criteria for LLM-as-a-Judge Systems.

Charles Chiang, Simret Araya Gebreegziabher, Annalisa Szymanski, Yukun Yang, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Toby Jia-Jun Li, Diego Gómez-Zará

Proceedings of the Companion Proceedings of the 31st International Conference on Intelligent User Interfaces, 2026

EvalAgent: Interactive Comparative Evaluation of Computer-Using GUI Agents.

Yukun Yang, Simret Araya Gebreegziabher, Hojun Yoo, Charles Chiang, Chaoran Chen, Annalisa Szymanski, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Diego Gómez-Zará, Toby Jia-Jun Li

Proceedings of the Companion Proceedings of the 31st International Conference on Intelligent User Interfaces, 2026

MultEval: Supporting Collaborative Alignment for LLM-as-a-Judge Evaluation Criteria.

Charles Chiang, Simret Araya Gebreegziabher, Annalisa Szymanski, Hyo Jin Do, Zahra Ashktorab, Werner Geyer, Toby Jia-Jun Li, Diego Gómez-Zará

Proceedings of the 5th Annual Symposium on Human-Computer Interaction for Work, 2026

Balancing Goals, Health, and Cost: A Food Information System for Managing Complex Choices and Fostering Sustained Food Agency.

Annalisa Szymanski, Jeongwon Jo, Michelle Sawwan, Heather A. Eicher-Miller, Ann-Marie Conrado, Danielle M. Wood, Tawanna R. Dillahunt, Ronald A. Metoyer

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

Designing Staged Evaluation Workflows for LLMs: Integrating Domain Experts, Lay Users, and Model-Generated Evaluation Criteria.

Annalisa Szymanski, Simret Araya Gebreegziabher, Oghenemaro Anuyah, Ronald A. Metoyer, Toby Jia-Jun Li

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026

2025

Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks.

Annalisa Szymanski, Noah Ziems, Heather A. Eicher-Miller, Toby Jia-Jun Li, Meng Jiang, Ronald A. Metoyer

Proceedings of the 30th International Conference on Intelligent User Interfaces, 2025

Evaluation Workflows for Large Language Models (LLMs) that Integrate Domain Expertise for Complex Knowledge Tasks.

Annalisa Szymanski

Proceedings of the Companion Proceedings of the 30th International Conference on Intelligent User Interfaces, 2025

2024

Corrigendum: A community focused approach toward making healthy and affordable daily diet recommendations.

Joe Germino, Annalisa Szymanski, Heather A. Eicher-Miller, Ronald A. Metoyer, Nitesh V. Chawla

Frontiers Big Data, 2024

A community focused approach toward making healthy and affordable daily diet recommendations.

Joe Germino, Annalisa Szymanski, Heather A. Eicher-Miller, Ronald A. Metoyer, Nitesh V. Chawla

Frontiers Big Data, 2024

Comparing Criteria Development Across Domain Experts, Lay Users, and Models in Large Language Model Evaluation.

Annalisa Szymanski, Simret Araya Gebreegziabher, Oghenemaro Anuyah, Ronald A. Metoyer, Toby Jia-Jun Li

CoRR, 2024

Beyond Static Labels: Unpacking Nutrition Comprehension in the Digital Age.

Brianna L. Wimer, Annalisa Szymanski, Ronald A. Metoyer

Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024

Integrating Expertise in LLMs: Crafting a Customized Nutrition Assistant with Refined Template Instructions.

Annalisa Szymanski, Brianna L. Wimer, Oghenemaro Anuyah, Heather A. Eicher-Miller, Ronald A. Metoyer

Proceedings of the CHI Conference on Human Factors in Computing Systems, 2024