Chenglei Si

According to our database, Chenglei Si authored at least 32 papers between 2019 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas.

Chenglei Si, Tatsunori Hashimoto, Diyi Yang

CoRR, June, 2025

Predicting Empirical AI Research Outcomes with Language Models.

Jiaxin Wen, Chenglei Si, Yueh-han Chen, He He, Shi Feng

CoRR, June, 2025

Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering.

Chenglei Si, Yanzhe Zhang, Ryan Li, Zhengyuan Yang, Ruibo Liu, Diyi Yang

Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, 2025

Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers.

Chenglei Si, Diyi Yang, Tatsunori Hashimoto

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

SPHERE: An Evaluation Card for Human-AI Systems.

Dora Zhao, Qianou Ma, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, Tongshuang Wu

Proceedings of the Findings of the Association for Computational Linguistics, 2025

Contextual Experience Replay for Self-Improvement of Language Agents.

Yitao Liu, Chenglei Si, Karthik R. Narasimhan, Shunyu Yao

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

Configurable Foundation Models: Building LLMs from a Modular Perspective.

Chaojun Xiao, Zhengyan Zhang, Chenyang Song, Dazhi Jiang, Feng Yao, Xu Han, Xiaozhi Wang, Shuo Wang, Yufei Huang, Guanyu Lin, Yingfa Chen, Weilin Zhao, Yuge Tu, Zexuan Zhong, Ao Zhang, Chenglei Si, Moo Khai Hao, Chenyang Zhao, Huimin Chen, Yankai Lin, Zhiyuan Liu, Jingbo Shang, Maosong Sun

CoRR, 2024

Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions.

Hua Shen, Tiffany Knearem, Reshmi Ghosh, Kenan Alkiek, Kundan Krishna, Yachuan Liu, Ziqiao Ma, Savvas Petridis, Yi-Hao Peng, Li Qiwei, Sushrita Rakshit, Chenglei Si, Yutong Xie, Jeffrey P. Bigham, Frank Bentley, Joyce Chai, Zachary C. Lipton, Qiaozhu Mei, Rada Mihalcea, Michael Terry, Diyi Yang, Meredith Ringel Morris, Paul Resnick, David Jurgens

CoRR, 2024

The Prompt Report: A Systematic Survey of Prompting Techniques.

Sander Schulhoff, Michael Ilie, Nishant Balepur, Konstantine Kahadze, Amanda Liu, Chenglei Si, Yinheng Li, Aayush Gupta, HyoJung Han, Sevien Schulhoff, Pranav Sandeep Dulepet, Saurav Vidyadhara, Dayeon Ki, Sweta Agrawal, Chau Pham, Gerson C. Kroiz, Feileen Li, Hudson Tao, Ashay Srivastava, Hevander Da Costa, Saloni Gupta, Megan L. Rogers, Inna Goncearenco, Giuseppe Sarli, Igor Galynker, Denis Peskoff, Marine Carpuat, Jules White, Shyamal Anadkat, Alexander Miserlis Hoyle, Philip Resnik

CoRR, 2024

Best Practices and Lessons Learned on Synthetic Data for Language Models.

Ruibo Liu, Jerry Wei, Fangyu Liu, Chenglei Si, Yanzhe Zhang, Jinmeng Rao, Steven Zheng, Daiyi Peng, Diyi Yang, Denny Zhou, Andrew M. Dai

CoRR, 2024

Design2Code: How Far Are We From Automating Front-End Engineering?

Chenglei Si, Yanzhe Zhang, Zhengyuan Yang, Ruibo Liu, Diyi Yang

CoRR, 2024

Large Language Models Help Humans Verify Truthfulness - Except When They Are Convincingly Wrong.

Chenglei Si, Navita Goyal, Tongshuang Wu, Chen Zhao, Shi Feng, Hal Daumé III, Jordan L. Boyd-Graber

Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers), 2024

2023

Sub-Character Tokenization for Chinese Pretrained Language Models.

Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun

Trans. Assoc. Comput. Linguistics, 2023

Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs through a Global Scale Prompt Hacking Competition.

Sander Schulhoff, Jeremy Pinto, Anaum Khan, Louis-François Bouchard, Chenglei Si, Svetlina Anati, Valen Tagliabue, Anson Liu Kost, Christopher Carnahan, Jordan L. Boyd-Graber

CoRR, 2023

Mixture of Prompt Experts for Generalizable and Interpretable Question Answering.

Chenglei Si, Weijia Shi, Chen Zhao, Luke Zettlemoyer, Jordan L. Boyd-Graber

CoRR, 2023

Prompting GPT-3 To Be Reliable.

Chenglei Si, Zhe Gan, Zhengyuan Yang, Shuohang Wang, Jianfeng Wang, Jordan L. Boyd-Graber, Lijuan Wang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Getting MoRE out of Mixture of Language Model Reasoning Experts.

Chenglei Si, Weijia Shi, Chen Zhao, Luke Zettlemoyer, Jordan L. Boyd-Graber

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

Ignore This Title and HackAPrompt: Exposing Systemic Vulnerabilities of LLMs Through a Global Prompt Hacking Competition.

Sander Schulhoff, Jeremy Pinto, Anaum Khan, Louis-François Bouchard, Chenglei Si, Svetlina Anati, Valen Tagliabue, Anson Liu Kost, Christopher Carnahan, Jordan L. Boyd-Graber

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises.

Chenglei Si, Zhengyan Zhang, Yingfa Chen, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Measuring Inductive Biases of In-Context Learning with Underspecified Demonstrations.

Chenglei Si, Dan Friedman, Nitish Joshi, Shi Feng, Danqi Chen, He He

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Revisiting Calibration for Question Answering.

Chenglei Si, Chen Zhao, Sewon Min, Jordan L. Boyd-Graber

CoRR, 2022

Re-Examining Calibration: The Case of Question Answering.

Chenglei Si, Chen Zhao, Sewon Min, Jordan L. Boyd-Graber

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

2021

Between words and characters: A Brief History of Open-Vocabulary Modeling and Tokenization in NLP.

Sabrina J. Mielke, Zaid Alyafeai, Elizabeth Salesky, Colin Raffel, Manan Dey, Matthias Gallé, Arun Raja, Chenglei Si, Wilson Y. Lee, Benoît Sagot, Samson Tan

CoRR, 2021

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining.

Chenglei Si, Zhengyan Zhang, Yingfa Chen, Fanchao Qi, Xiaozhi Wang, Zhiyuan Liu, Maosong Sun

CoRR, 2021

Adversarial Training for Machine Reading Comprehension with Virtual Embeddings.

Ziqing Yang, Yiming Cui, Chenglei Si, Wanxiang Che, Ting Liu, Shijin Wang, Guoping Hu

Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics, 2021

What's in a Name? Answer Equivalence For Open-Domain Question Answering.

Chenglei Si, Chen Zhao, Jordan L. Boyd-Graber

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning.

Chenglei Si, Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

Benchmarking Robustness of Machine Reading Comprehension Models.

Chenglei Si, Ziqing Yang, Yiming Cui, Wentao Ma, Ting Liu, Shijin Wang

Proceedings of the Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021, 2021

2020

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning.

Chenglei Si, Zhengyan Zhang, Fanchao Qi, Zhiyuan Liu, Yasheng Wang, Qun Liu, Maosong Sun

CoRR, 2020

CharBERT: Character-aware Pre-trained Language Model.

Wentao Ma, Yiming Cui, Chenglei Si, Ting Liu, Shijin Wang, Guoping Hu

Proceedings of the 28th International Conference on Computational Linguistics, 2020

2019

What does BERT Learn from Multiple-Choice Reading Comprehension Datasets?

Chenglei Si, Shuohang Wang, Min-Yen Kan, Jing Jiang

CoRR, 2019

Sentiment Aware Neural Machine Translation.

Chenglei Si, Kui Wu, Ai Ti Aw, Min-Yen Kan

Proceedings of the 6th Workshop on Asian Translation, 2019