Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models. - Sumuk Shashidhar; Abhinav Chinta; Vaibhav Sahai; Zhenhailong Wang; Heng Ji (EMNLP (Findings), 2023)

Unsupervised Human Preference Learning. - Sumuk Shashidhar; Abhinav Chinta; Vaibhav Sahai; Dilek Hakanni-Tür (EMNLP, 2024)

Unsupervised Human Preference Learning. - Sumuk Shashidhar; Abhinav Chinta; Vaibhav Sahai; Dilek Hakkani-Tür (CoRR, 2024)

YourBench: Easy Custom Evaluation Sets for Everyone. - Sumuk Shashidhar; Clémentine Fourrier; Alina Lozovskia; Thomas Wolf; Gokhan Tur; Dilek Hakkani-Tür (CoRR, 2025)

Spark: A System for Scientifically Creative Idea Generation. - Aishik Sanyal; Samuel Schapiro; Sumuk Shashidhar; Royce Moon; Lav R. Varshney; Dilek Hakkani-Tur (CoRR, 2025)

PIPA: A Unified Evaluation Protocol for Diagnosing Interactive Planning Agents. - Takyoung Kim; Janvijay Singh; Shuhaib Mehri; Emre Can Acikgoz; Sagnik Mukherjee; Nimet Beyza Bozdag; Sumuk Shashidhar; Gokhan Tur; Dilek Hakkani-Tür (CoRR, 2025)

Question Generation for Assessing Early Literacy Reading Comprehension. - Xiaocheng Yang; Sumuk Shashidhar; Dilek Hakkani-Tur (CoRR, 2025)