Pre-Training with Whole Word Masking for Chinese BERT. - Yiming Cui 001; Wanxiang Che; Ting Liu 001; Bing Qin 001; Ziqing Yang 001; Shijin Wang 001; Guoping Hu (CoRR, 2019)

Improving Machine Reading Comprehension via Adversarial Training. - Ziqing Yang 001; Yiming Cui 001; Wanxiang Che; Ting Liu 001; Shijin Wang 001; Guoping Hu (CoRR, 2019)

TextBrewer: An Open-Source Knowledge Distillation Toolkit for Natural Language Processing. - Ziqing Yang 001; Yiming Cui 001; Zhipeng Chen 001; Wanxiang Che; Ting Liu 001; Shijin Wang 001; Guoping Hu (ACL (demo), 2020)

A Sentence Cloze Dataset for Chinese Machine Reading Comprehension. - Yiming Cui 001; Ting Liu 001; Ziqing Yang 001; Zhipeng Chen 001; Wentao Ma; Wanxiang Che; Shijin Wang 001; Guoping Hu (COLING, 2020)

Benchmarking Robustness of Machine Reading Comprehension Models. - Chenglei Si; Ziqing Yang 001; Yiming Cui 001; Wentao Ma; Ting Liu 001; Shijin Wang 001 (ACL/IJCNLP (Findings), 2021)

Adversarial Training for Machine Reading Comprehension with Virtual Embeddings. - Ziqing Yang 001; Yiming Cui 001; Chenglei Si; Wanxiang Che; Ting Liu 001; Shijin Wang 001; Guoping Hu (*SEM, 2021)

Bilingual Alignment Pre-training for Zero-shot Cross-lingual Transfer. - Ziqing Yang 001; Wentao Ma; Yiming Cui 001; Jiani Ye; Wanxiang Che; Shijin Wang 001 (CoRR, 2021)

Pre-Training With Whole Word Masking for Chinese BERT. - Yiming Cui 001; Wanxiang Che; Ting Liu 001; Bing Qin 001; Ziqing Yang 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2021)

TextPruner: A Model Pruning Toolkit for Pre-Trained Language Models. - Ziqing Yang 001; Yiming Cui 001; Zhigang Chen 003 (ACL (demo), 2022)

CINO: A Chinese Minority Pre-trained Language Model. - Ziqing Yang 001; Zihang Xu; Yiming Cui 001; Baoxin Wang; Min Lin; Dayong Wu; Zhigang Chen 003 (COLING, 2022)

HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detection. - Zheng Chu; Ziqing Yang 001; Yiming Cui 001; Zhigang Chen 003; Ming Liu 004 (SemEval@NAACL, 2022)

HFL at SemEval-2022 Task 8: A Linguistics-inspired Regression Model with Data Augmentation for Multilingual News Similarity. - Zihang Xu; Ziqing Yang 001; Yiming Cui 001; Zhigang Chen 003 (SemEval@NAACL, 2022)

Cross-Lingual Text Classification with Multilingual Distillation and Zero-Shot-Aware Training. - Ziqing Yang 001; Yiming Cui 001; Zhigang Chen 003; Shijin Wang 001 (CoRR, 2022)

PERT: Pre-training BERT with Permuted Language Model. - Yiming Cui 001; Ziqing Yang 001; Ting Liu 001 (CoRR, 2022)

Interactive Gated Decoder for Machine Reading Comprehension. - Yiming Cui 001; Wanxiang Che; Ziqing Yang 001; Ting Liu 001; Bing Qin 001; Shijin Wang 001; Guoping Hu (ACM Trans. Asian Low Resour. Lang. Inf. Process., 2022)

Gradient-based Intra-attention Pruning on Pre-trained Language Models. - Ziqing Yang 001; Yiming Cui 001; Xin Yao; Shijin Wang 001 (ACL (1), 2023)

IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning. - Zihang Xu; Ziqing Yang 001; Yiming Cui 001; Shijin Wang 001 (ACL (Findings), 2023)

MiniRBT: A Two-stage Distilled Small Chinese Pre-trained Model. - Xin Yao; Ziqing Yang 001; Yiming Cui 001; Shijin Wang 001 (CoRR, 2023)

Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca. - Yiming Cui 001; Ziqing Yang 001; Xin Yao (CoRR, 2023)