What Does a TextCNN Learn? - Linyuan Gong; Ruyi Ji (CoRR, 2018)

Efficient Training of BERT by Progressively Stacking. - Linyuan Gong; Di He 001; Zhuohan Li 001; Tao Qin 001; Liwei Wang 001; Tie-Yan Liu (ICML, 2019)

Microsoft Research Asia's Systems for WMT19. - Yingce Xia; Xu Tan 003; Fei Tian; Fei Gao 018; Di He 001; Weicong Chen; Yang Fan; Linyuan Gong; Yichong Leng; Renqian Luo; Yiren Wang; Lijun Wu 003; et al. (WMT (2), 2019)

Microsoft Research Asia's Systems for WMT19. - Yingce Xia; Xu Tan 003; Fei Tian; Fei Gao 018; Weicong Chen; Yang Fan; Linyuan Gong; Yichong Leng; Renqian Luo; Yiren Wang; Lijun Wu 003; Jinhua Zhu 001; et al. (CoRR, 2019)

Improved Clinical Abbreviation Expansion via Non-Sense-Based Approaches. - Juyong Kim 002; Linyuan Gong; Justin Khim; Jeremy C. Weiss; Pradeep Ravikumar (ML4H@NeurIPS, 2020)

MC-BERT: Efficient Language Pre-Training via a Meta Controller. - Zhenhui Xu; Linyuan Gong; Guolin Ke; Di He 001; Shuxin Zheng; Liwei Wang 001; Jiang Bian 002; Tie-Yan Liu (CoRR, 2020)

PlotCoder: Hierarchical Decoding for Synthesizing Visualization Code in Programmatic Context. - Xinyun Chen; Linyuan Gong; Alvin Cheung; Dawn Song (ACL/IJCNLP (1), 2021)

Anytime Sampling for Autoregressive Models via Ordered Autoencoding. - Yilun Xu; Yang Song 011; Sahaj Garg; Linyuan Gong; Rui Shu; Aditya Grover; Stefano Ermon (ICLR, 2021)

Joint Language Semantic and Structure Embedding for Knowledge Graph Completion. - Jianhao Shen; Chenguang Wang 001; Linyuan Gong; Dawn Song (COLING, 2022)

Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers. - Linyuan Gong; Chenyan Xiong; Xiaodong Liu 003; Payal Bajaj; Yiqing Xie; Alvin Cheung; Jianfeng Gao 001; Xia Song (ACL (1), 2023)

AST-T5: Structure-Aware Pretraining for Code Generation and Understanding. - Linyuan Gong; Mostafa Elhoushi; Alvin Cheung (ICML, 2024)

Evaluation of LLMs on Syntax-Aware Code Fill-in-the-Middle Tasks. - Linyuan Gong; Sida Wang; Mostafa Elhoushi; Alvin Cheung (ICML, 2024)

ADELT: Transpilation between Deep Learning Frameworks. - Linyuan Gong; Jiayi Wang; Alvin Cheung (IJCAI, 2024)

Structure-Aware Fill-in-the-Middle Pretraining for Code. - Linyuan Gong; Alvin Cheung; Mostafa Elhoushi; Sida Wang (CoRR, 2025)