Zewen at SemEval-2018 Task 1: An Ensemble Model for Affect Prediction in Tweets. - Zewen Chi; Heyan Huang; Jiangui Chen; Hao Wu 066; Ran Wei (SemEval@NAACL-HLT, 2018)

Fast and Accurate Bilingual Lexicon Induction via Matching Optimization. - Zewen Chi; Heyan Huang; Shenjian Zhao; Heng-Da Xu; Xianling Mao (NLPCC (1), 2019)

Complicated Table Structure Recognition. - Zewen Chi; Heyan Huang; Heng-Da Xu; Houjin Yu; Wanxuan Yin; Xianling Mao (CoRR, 2019)

Cross-Lingual Natural Language Generation via Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Wenhui Wang 003; Xian-Ling Mao; Heyan Huang (AAAI, 2020)

A Robust and Domain-Adaptive Approach for Low-Resource Named Entity Recognition. - Houjin Yu; Xian-Ling Mao; Zewen Chi; Wei Wei 002; Heyan Huang (ICKG, 2020)

Can Monolingual Pretrained Models Help Cross-Lingual Classification? - Zewen Chi; Li Dong 004; Furu Wei; Xianling Mao; Heyan Huang (AACL/IJCNLP, 2020)

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. - Shuming Ma; Jian Yang 030; Haoyang Huang; Zewen Chi; Li Dong 004; Dongdong Zhang 001; Hany Hassan Awadalla; Alexandre Muzio; Akiko Eriguchi; Saksham Singhal; Xia Song; Arul Menezes; et al. (CoRR, 2020)

Improving Pretrained Cross-Lingual Language Models via Self-Labeled Word Alignment. - Zewen Chi; Li Dong 004; Bo Zheng 010; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL/IJCNLP (1), 2021)

Consistency Regularization for Cross-Lingual Fine-Tuning. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (ACL/IJCNLP (1), 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Saksham Singhal; Xian-Ling Mao; Heyan Huang; Xia Song; Furu Wei (EMNLP (1), 2021)

A Knowledge Enhanced Chinese GaoKao Reading Comprehension Method. - Xiao Zhang 036; Heqi Zheng; Heyan Huang; Zewen Chi; Xian-Ling Mao (ICBK, 2021)

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Nan Yang 002; Saksham Singhal; Wenhui Wang 003; Xia Song; Xian-Ling Mao; Heyan Huang; Ming Zhou 001 (NAACL-HLT, 2021)

Generating Informative Dialogue Responses with Keywords-Guided Networks. - Heng-Da Xu; Xian-Ling Mao; Zewen Chi; Fanshu Sun; Jing-Jing Zhu; Heyan Huang (NLPCC (2), 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Xian-Ling Mao; Heyan Huang; Furu Wei (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2021)

Cross-Lingual Language Model Meta-Pretraining. - Zewen Chi; Heyan Huang; Luyang Liu; Yu Bai 018; Xian-Ling Mao (CoRR, 2021)

Bridging the Gap: Cross-Lingual Summarization with Compression Rate. - Yu Bai 018; Heyan Huang; Kai Fan 002; Yang Gao 016; Zewen Chi; Boxing Chen (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Bo Zheng 010; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL (1), 2022)

Cross-Lingual Phrase Retrieval. - Heqi Zheng; Xiao Zhang 036; Zewen Chi; Heyan Huang; Yan Tan; Tian Lan 003; Wei Wei 002; Xian-Ling Mao (ACL (1), 2022)

Unsupervised Question Answering via Answer Diversifying. - Yuxiang Nie; Heyan Huang; Zewen Chi; Xian-Ling Mao (COLING, 2022)

ET5: A Novel End-to-end Framework for Conversational Machine Reading Comprehension. - Xiao Zhang 036; Heyan Huang; Zewen Chi; Xian-Ling Mao (COLING, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

Unifying Cross-lingual Summarization and Machine Translation with Compression Rate. - Yu Bai 018; Heyan Huang; Kai Fan 002; Yang Gao 016; Yiming Zhu; Jiaao Zhan; Zewen Chi; Boxing Chen (SIGIR, 2022)

Cross-Lingual Phrase Retrieval. - Heqi Zheng; Xiao Zhang 036; Zewen Chi; Heyan Huang; Tan Yan; Tian Lan 003; Wei Wei 002; Xian-Ling Mao (CoRR, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Language Models are General-Purpose Interfaces. - Yaru Hao; Haoyu Song 002; Li Dong 004; Shaohan Huang; Zewen Chi; Wenhui Wang 003; Shuming Ma; Furu Wei (CoRR, 2022)

TorchScale: Transformers at Scale. - Shuming Ma; Hongyu Wang 009; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Li Dong 004; Alon Benhaim; Barun Patra; Vishrav Chaudhary; Xia Song; Furu Wei (CoRR, 2022)

Food recommendation with graph convolutional network. - Xiaoyan Gao; Fuli Feng; Heyan Huang; Xian-Ling Mao; Tian Lan 003; Zewen Chi (Inf. Sci., 2022)

Bridging The Gap: Entailment Fused-T5 for Open-retrieval Conversational Machine Reading Comprehension. - Xiao Zhang 036; Heyan Huang; Zewen Chi; Xian-Ling Mao (ACL (1), 2023)

Can Cross-Lingual Transferability of Multilingual Transformers Be Activated Without End-Task Data? - Zewen Chi; Heyan Huang; Xian-Ling Mao (ACL (Findings), 2023)

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. - Barun Patra; Saksham Singhal; Shaohan Huang; Zewen Chi; Li Dong 004; Furu Wei; Vishrav Chaudhary; Xia Song (ACL (1), 2023)

Optimizing Prompts for Text-to-Image Generation. - Yaru Hao; Zewen Chi; Li Dong 004; Furu Wei (NeurIPS, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

Measuring Cross-Lingual Transferability of Multilingual Transformers on Sentence Classification. - Zewen Chi; Heyan Huang; Xian-Ling Mao (CoRR, 2023)

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training. - Le Zhuo; Zewen Chi; Minghao Xu; Heyan Huang; Jianan Zhao 002; Heqi Zheng; Conghui He; Xian-Ling Mao; Wentao Zhang (ACL (1), 2024)

ProtLLM: An Interleaved Protein-Language LLM with Protein-as-Word Pre-Training. - Le Zhuo; Zewen Chi; Minghao Xu; Heyan Huang; Heqi Zheng; Conghui He; Xian-Ling Mao; Wentao Zhang (CoRR, 2024)

FlashBack: Efficient Retrieval-Augmented Language Modeling for Long Context Inference. - Runheng Liu; Xingchen Xiao; Heyan Huang; Zewen Chi; Zhijing Wu 001 (CoRR, 2024)

RS-BERT: Pre-training radical enhanced sense embedding for Chinese word sense disambiguation. - Xiaofeng Zhou; Heyan Huang; Zewen Chi; Mucheng Ren; Yang Gao 016 (Inf. Process. Manag., 2024)

Can Pretrained English Language Models Benefit Non-English NLP Systems in Low-Resource Scenarios? - Zewen Chi; Heyan Huang; Luyang Liu; Yu Bai 018; Xiaoyan Gao; Xian-Ling Mao (IEEE ACM Trans. Audio Speech Lang. Process., 2024)

FlashBack: Efficient Retrieval-Augmented Language Modeling for Fast Inference. - Runheng Liu; Xingchen Xiao; Heyan Huang; Zewen Chi; Zhijing Wu 001 (ACL (Findings), 2025)

Think Only When You Need with Large Hybrid-Reasoning Models. - Lingjie Jiang; Xun Wu; Shaohan Huang; Qingxiu Dong; Zewen Chi; Li Dong 004; Xingxing Zhang 002; Tengchao Lv; Lei Cui 001; Furu Wei (CoRR, 2025)

Reward Reasoning Model. - Jiaxin Guo; Zewen Chi; Li Dong 004; Qingxiu Dong; Xun Wu; Shaohan Huang; Furu Wei (CoRR, 2025)

On-Policy RL with Optimal Reward Baseline. - Yaru Hao; Li Dong 004; Xun Wu; Shaohan Huang; Zewen Chi; Furu Wei (CoRR, 2025)