RedwoodNLP at SemEval-2021 Task 7: Ensembled Pretrained and Lightweight Models for Humor Detection. - Nathan Chi; Ryan Chi (SemEval@ACL/IJCNLP, 2021)

GLARE: Generative Left-to-right AdversaRial Examples. - Ryan Chi; Nathan Kim; Patrick Liu; Zander Lack; Ethan A. Chi (Eval4NLP, 2022)

Stanford MLab at SemEval 2022 Task 7: Tree- and Transformer-Based Methods for Clarification Plausibility. - Thomas Yim; Junha Lee; Rishi Verma; Scott Hickmann; Annie Zhu; Camron Sallade; Ian Ng; Ryan Chi; Patrick Liu (SemEval@NAACL, 2022)

Holistic Evaluation of Language Models. - Percy Liang; Rishi Bommasani; Tony Lee; Dimitris Tsipras; Dilara Soylu; Michihiro Yasunaga; Yian Zhang; Deepak Narayanan; Yuhuai Wu; Ananya Kumar; Benjamin Newman; Binhang Yuan; et al. (Trans. Mach. Learn. Res., 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low Resource and Extinct Languages. - Andrew M. Bean; Simi Hellsten; Harry Mayne; Jabez Magomere; Ethan Chi; Ryan Chi; Scott Hale; Hannah Rose Kirk (NeurIPS, 2024)

ModeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models. - Nathan A. Chi; Teodor Malchev; Riley Kong; Ryan Chi; Lucas Huang; Ethan A. Chi; R. Thomas McCoy; Dragomir Radev (SIGTYPE, 2024)