Holistic Evaluation of Text-to-Image Models. - Tony Lee; Michihiro Yasunaga; Chenlin Meng; Yifan Mai 001; Joon Sung Park; Agrim Gupta; Yunzhi Zhang; Deepak Narayanan; Hannah Teufel; Marco Bellagente; Minguk Kang; Taesung Park; et al. (NeurIPS, 2023)

Holistic Evaluation of Language Models. - Percy Liang; Rishi Bommasani; Tony Lee; Dimitris Tsipras; Dilara Soylu; Michihiro Yasunaga; Yian Zhang; Deepak Narayanan; Yuhuai Wu; Ananya Kumar; Benjamin Newman; Binhang Yuan; et al. (Trans. Mach. Learn. Res., 2023)

Using Benchmarking Infrastructure to Evaluate LLM Performance on CS Concept Inventories: Challenges, Opportunities, and Critiques. - Murtaza Ali; Prerna Rao; Yifan Mai 001; Benjamin Xie (ICER (1), 2024)

VHELM: A Holistic Evaluation of Vision Language Models. - Tony Lee; Haoqin Tu; Chi Heem Wong; Wenhao Zheng; Yiyang Zhou; Yifan Mai 001; Josselin Somerville Roberts; Michihiro Yasunaga; Huaxiu Yao; Cihang Xie; Percy Liang (NeurIPS, 2024)

Image2Struct: Benchmarking Structure Extraction for Vision-Language Models. - Josselin Somerville Roberts; Tony Lee; Chi Heem Wong; Michihiro Yasunaga; Yifan Mai 001; Percy Liang (NeurIPS, 2024)

Introducing v0.5 of the AI Safety Benchmark from MLCommons. - Bertie Vidgen; Adarsh Agrawal; Ahmed M. Ahmed 004; Victor Akinwande; Namir Al-Nuaimi; Najla Alfaraj; Elie Alhajjar; Lora Aroyo; Trupti Bavalatti; Borhane Blili-Hamelin; Kurt D. Bollacker; Rishi Bomassani; et al. (CoRR, 2024)

AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policies. - Yi Zeng 005; Yu Yang 011; Andy Zhou; Jeffrey Ziwei Tan; Yuheng Tu; Yifan Mai 001; Kevin Klyman; Minzhou Pan; Ruoxi Jia 001; Dawn Song; Percy Liang; Bo Li 026 (CoRR, 2024)

Language model developers should report train-test overlap. - Andy K. Zhang; Kevin Klyman; Yifan Mai 001; Yoav Levine; Yian Zhang; Rishi Bommasani; Percy Liang (CoRR, 2024)

SEA-HELM: Southeast Asian Holistic Evaluation of Language Models. - Yosephine Susanto; Adithya Venkatadri Hulagadri; Jann Railey Montalan; Jian Gang Ngui; Xianbin Yong; Wei Qi Leong; Hamsawardhini Rengarajan; Peerat Limkonchotiwat; Yifan Mai 001; William-Chandra Tjhi (ACL (Findings), 2025)

AIR-BENCH 2024: A Safety Benchmark based on Regulation and Policies Specified Risk Categories. - Yi Zeng 005; Yu Yang 011; Andy Zhou; Jeffrey Ziwei Tan; Yuheng Tu; Yifan Mai 001; Kevin Klyman; Minzhou Pan; Ruoxi Jia 001; Dawn Song; Percy Liang; Bo Li 026 (ICLR, 2025)

AutoBencher: Towards Declarative Benchmark Construction. - Xiang Lisa Li; Farzaan Kaiyom; Evan Zheran Liu; Yifan Mai 001; Percy Liang; Tatsunori Hashimoto (ICLR, 2025)

Evaluating Large Language Models with Enterprise Benchmarks. - Bing Zhang; Mikio Takeuchi; Ryo Kawahara; Shubhi Asthana; Md. Maruf Hossain; Guang-Jie Ren; Kate Soule; Yifan Mai 001; Yada Zhu (NAACL (Industry Track), 2025)

The Mighty ToRR: A Benchmark for Table Reasoning and Robustness. - Shir Ashury-Tahan; Yifan Mai 001; Rajmohan C; Ariel Gera; Yotam Perlitz; Asaf Yehudai; Elron Bandel; Leshem Choshen; Eyal Shnarch; Percy Liang; Michal Shmueli-Scheuer (CoRR, 2025)

AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons. - Shaona Ghosh; Heather Frase; Adina Williams; Sarah Luger; Paul Röttger; Fazl Barez; Sean McGregor; Kenneth Fricklas; Mala Kumar; Quentin Feuillade-Montixi; Kurt Bollacker; Felix Friedrich; et al. (CoRR, 2025)

Judging LLMs on a Simplex. - Patrick Vossler; Fan Xia; Yifan Mai 001; Jean Feng (CoRR, 2025)

MedHELM: Holistic Evaluation of Large Language Models for Medical Tasks. - Suhana Bedi; Hejie Cui; Miguel Fuentes; Alyssa Unell; Michael Wornow; Juan M. Banda; Nikesh Kotecha; Timothy Keyes; Yifan Mai 001; Mert Oez; Hao Qiu; Shrey Jain; et al. (CoRR, 2025)

The Singapore Consensus on Global AI Safety Research Priorities. - Yoshua Bengio; Tegan Maharaj; Luke Ong; Stuart Russell 001; Dawn Song; Max Tegmark; Lan Xue; Ya-Qin Zhang; Stephen Casper; Wan Sie Lee; Sören Mindermann; Vanessa Wilfred; et al. (CoRR, 2025)