Rethinking Exposure Bias In Language Modeling. - Yifan Xu 009; Kening Zhang; Haoyu Dong; Yuezhou Sun; Wenlong Zhao 001; Zhuowen Tu (CoRR, 2019)

Compressing Transformer-Based Semantic Parsing Models using Compositional Code Embeddings. - Prafull Prakash; Saurabh Kumar Shashidhar; Wenlong Zhao 001; Subendhu Rongali; Haidar Khan; Michael Kayser (EMNLP (Findings), 2020)

IGA: An Intent-Guided Authoring Assistant. - Simeng Sun; Wenlong Zhao 001; Varun Manjunatha; Rajiv Jain; Vlad I. Morariu; Franck Dernoncourt; Balaji Vasan Srinivasan; Mohit Iyyer (EMNLP (1), 2021)

Toward Compact Parameter Representations for Architecture-Agnostic Neural Network Compression. - Yuezhou Sun; Wenlong Zhao 001; Lijun Zhang 005; Xiao Liu 030; Hui Guan 001; Matei Zaharia (CoRR, 2021)

Structured Energy Network As a Loss. - Jay Yoon Lee; Dhruvesh Patel; Purujit Goyal; Wenlong Zhao 001; Zhiyang Xu; Andrew McCallum (NeurIPS, 2022)

ezCoref: Towards Unifying Annotation Guidelines for Coreference Resolution. - Ankita Gupta; Marzena Karpinska; Wenlong Zhao 001; Kalpesh Krishna; Jack Merullo; Luke Yeh; Mohit Iyyer; Brendan O'Connor 001 (EACL (Findings), 2023)

Editing Common Sense in Transformers. - Anshita Gupta; Debanjan Mondal; Akshay Krishna Sheshadri; Wenlong Zhao 001; Xiang Li 069; Sarah Wiegreffe; Niket Tandon (EMNLP, 2023)

Machine Reading Comprehension using Case-based Reasoning. - Dung Thai; Dhruv Agarwal 003; Mudit Chaudhary; Wenlong Zhao 001; Rajarshi Das; Jay-Yoon Lee; Hannaneh Hajishirzi; Manzil Zaheer; Andrew McCallum (EMNLP (Findings), 2023)

Editing Commonsense Knowledge in GPT. - Anshita Gupta; Debanjan Mondal; Akshay Krishna Sheshadri; Wenlong Zhao 001; Xiang Lorraine Li; Sarah Wiegreffe; Niket Tandon (CoRR, 2023)

Multistage Collaborative Knowledge Distillation from Large Language Models. - Jiachen Zhao; Wenlong Zhao 001; Andrew Drozdov; Benjamin Rozonoyer; Md. Arafat Sultan; Jay-Yoon Lee; Mohit Iyyer; Andrew McCallum (CoRR, 2023)

Multistage Collaborative Knowledge Distillation from a Large Language Model for Semi-Supervised Sequence Generation. - Jiachen Zhao; Wenlong Zhao 001; Andrew Drozdov; Benjamin Rozonoyer; Md. Arafat Sultan; Jay-Yoon Lee; Mohit Iyyer; Andrew McCallum (ACL (1), 2024)

WorldValuesBench: A Large-Scale Benchmark Dataset for Multi-Cultural Value Awareness of Language Models. - Wenlong Zhao 001; Debanjan Mondal; Niket Tandon; Danica Dillion; Kurt Gray; Yuling Gu (LREC/COLING, 2024)

Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval. - Jonghyun Song; Cheyon Jin; Wenlong Zhao 001; Andrew McCallum; Jay-Yoon Lee (EMNLP, 2024)

Learning Representations for Hierarchies with Minimal Support. - Benjamin Rozonoyer; Michael Boratko; Dhruvesh Patel; Wenlong Zhao 001; Shib Sankar Dasgupta; Hung Le; Andrew McCallum (NeurIPS, 2024)

Comparing Neighbors Together Makes it Easy: Jointly Comparing Multiple Candidates for Efficient and Effective Retrieval. - Jonghyun Song; Cheyon Jin; Wenlong Zhao 001; Jay-Yoon Lee (CoRR, 2024)

From RAGs to rich parameters: Probing how language models utilize external knowledge over parametric information for factual queries. - Hitesh Wadhwa; Rahul Seetharaman; Somyaa Aggarwal; Reshmi Ghosh; Samyadeep Basu; Soundararajan Srinivasan; Wenlong Zhao 001; Shreyas Chaudhari; Ehsan Aghazadeh (CoRR, 2024)

Quantifying reliance on external information over parametric knowledge during Retrieval Augmented Generation (RAG) using mechanistic analysis. - Reshmi Ghosh; Rahul Seetharaman; Hitesh Wadhwa; Somyaa Aggarwal; Samyadeep Basu; Soundararajan Srinivasan; Wenlong Zhao 001; Shreyas Chaudhari; Ehsan Aghazadeh (CoRR, 2024)

Unveiling the Secret Recipe: A Guide For Supervised Fine-Tuning Small LLMs. - Aldo Pareja; Nikhil Shivakumar Nayak; Hao Wang; Krishnateja Killamsetty; Shivchander Sudalairaj; Wenlong Zhao 001; Seungwook Han; Abhishek Bhandwaldar; Guangxuan Xu; Kai Xu 016; Ligong Han; Luke Inglis; et al. (ICLR, 2025)

OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics. - Vineeth Dorna; Anmol Mekala; Wenlong Zhao 001; Andrew McCallum; Zachary C. Lipton; J. Zico Kolter; Pratyush Maini (CoRR, 2025)