The Design and Realization of the Fault Diagnosis Expert System of CNC. - Long He; Zhengyan Zhang; Gaozuo Zhang (ICDMA, 2011)

The Optimization of Two-Stage Planetary Gear Train Based on Mathmatica. - Tianpei Chen; Zhengyan Zhang; Dingfang Chen; Yongzhi Li (ICPCA/SWS, 2012)

Mechanical Research of the Planet Carrier in Wind Turbine Gear Increaser Based on Co-simulation of ADAMS-ANSYS. - Taotao Li; Dingfang Chen; Pengfei Long; Zhengyan Zhang; Jiquan Hu; Jinghua Zhang (ICPCA/SWS, 2012)

Topological Reconstruction Based on STL Model. - Chen Ping; Zhengyan Zhang; Dingfang Chen; Jiquan Hu; Bin Shan; Li Bo (HCC, 2014)

Privacy-area aware dummy generation algorithms for Location-Based Services. - Ben Niu 001; Zhengyan Zhang; Xiaoqing Li 001; Hui Li 006 (ICC, 2014)

TransNet: Translation-Based Network Representation Learning for Social Relation Extraction. - Cunchao Tu; Zhengyan Zhang; Zhiyuan Liu 001; Maosong Sun 001 (IJCAI, 2017)

Multiscale Adaptive Local Directional Texture Pattern for Facial Expression Recognition. - Zhengyan Zhang; Jingjie Yan; Guanming Lu; Haibo Li 001; Ning Sun; Qi Ge (KSII Trans. Internet Inf. Syst., 2017)

Screen Window Propagating for Image Inpainting. - Huaming Liu; Xuehui Bi; Guanming Lu; Weilan Wang; Jingjie Yan; Zhengyan Zhang (IEEE Access, 2018)

Graph Neural Networks: A Review of Methods and Applications. - Jie Zhou 024; Ganqu Cui; Zhengyan Zhang; Cheng Yang 002; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2018)

Multi-Target Angle Tracking Algorithm for Bistatic Multiple-Input Multiple-Output (MIMO) Radar Based on the Elements of the Covariance Matrix. - Zhengyan Zhang; Jianyun Zhang; Qingsong Zhou; Xiaobo Li (Sensors, 2018)

ERNIE: Enhanced Language Representation with Informative Entities. - Zhengyan Zhang; Xu Han 007; Zhiyuan Liu 001; Xin Jiang 002; Maosong Sun 001; Qun Liu 001 (ACL (1), 2019)

Local directional intensity pattern for facial expression recognition. - Weijia Huang; Zhengyan Zhang; Huaming Liu (ICCAIS, 2019)

A proposed radicality evaluation method for design ideas at conceptual design stage. - Wei Liu 093; Runhua Tan; Guozhong Cao; Zhengyan Zhang; Siyuan Huang; Limeng Liu (Comput. Ind. Eng., 2019)

Adversarial Language Games for Advanced Natural Language Intelligence. - Yuan Yao 013; Haoxi Zhong; Zhengyan Zhang; Xu Han 007; Xiaozhi Wang; Chaojun Xiao; Guoyang Zeng; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2019)

Incomplete Cholesky Decomposition based Kernel Cross Modal Factor Analysis for Audiovisual Continuous Dimensional Emotion Recognition. - Xia Li; Guanming Lu; Jingjie Yan; Haibo Li 001; Zhengyan Zhang; Ning Sun; Shipeng Xie (KSII Trans. Internet Inf. Syst., 2019)

A Unified Framework for Community Detection and Network Representation Learning. - Cunchao Tu; Xiangkai Zeng; Hao Wang 214; Zhengyan Zhang; Zhiyuan Liu 001; Maosong Sun 001; Bo Zhang 056; Leyu Lin (IEEE Trans. Knowl. Data Eng., 2019)

Train No Evil: Selective Masking for Task-Guided Pre-Training. - Yuxian Gu; Zhengyan Zhang; Xiaozhi Wang; Zhiyuan Liu 001; Maosong Sun 001 (EMNLP (1), 2020)

Graph neural networks: A review of methods and applications. - Jie Zhou 024; Ganqu Cui; Shengding Hu; Zhengyan Zhang; Cheng Yang 002; Zhiyuan Liu 001; Lifeng Wang; Changcheng Li; Maosong Sun 001 (AI Open, 2020)

Contextual Knowledge Selection and Embedding towards Enhanced Pre-Trained Language Models. - YuSheng Su; Xu Han 007; Zhengyan Zhang; Peng Li 030; Zhiyuan Liu 001; Yankai Lin; Jie Zhou 016; Maosong Sun 001 (CoRR, 2020)

Better Robustness by More Coverage: Adversarial Training with Mixup Augmentation for Robust Fine-tuning. - Chenglei Si; Zhengyan Zhang; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Qun Liu 001; Maosong Sun 001 (CoRR, 2020)

Adversarial Language Games for Advanced Natural Language Intelligence. - Yuan Yao 013; Haoxi Zhong; Zhengyan Zhang; Xu Han 007; Xiaozhi Wang; Kai Zhang 033; Chaojun Xiao; Guoyang Zeng; Zhiyuan Liu 001; Maosong Sun 001 (AAAI, 2021)

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger. - Fanchao Qi; Mukai Li; Yangyi Chen; Zhengyan Zhang; Zhiyuan Liu 001; Yasheng Wang; Maosong Sun 001 (ACL/IJCNLP (1), 2021)

Better Robustness by More Coverage: Adversarial and Mixup Data Augmentation for Robust Finetuning. - Chenglei Si; Zhengyan Zhang; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Qun Liu 001; Maosong Sun 001 (ACL/IJCNLP (Findings), 2021)

Bridging the Language Gap: Knowledge Injected Multilingual Question Answering. - Zhichao Duan 001; Xiuxing Li; Zhengyan Zhang; Zhenyu Li; Ning Liu 014; Jianyong Wang 001 (ICBK, 2021)

Towards Components-of-Interest Feedback Control and State Estimation of Robotic Manipulator. - Erli Lyu; Zhengyan Zhang; Jiaole Wang; Shuang Song 002; Max Q.-H. Meng (ROBIO, 2021)

Towards Tracking by 2D-target Registration for Surgical Optical Tracking System. - Tinghua Zhang; Zhengyan Zhang; Botao Lin; Junnan Xue; Jiaole Wang; Shuang Song 002 (ROBIO, 2021)

Pre-trained models: Past, present and future. - Xu Han 007; Zhengyan Zhang; Ning Ding 002; Yuxian Gu; Xiao Liu 036; Yuqi Huo; Jiezhong Qiu; Yuan Yao 013; Ao Zhang; Liang Zhang; Wentao Han; Minlie Huang; et al. (AI Open, 2021)

CokeBERT: Contextual knowledge selection and embedding towards enhanced pre-trained language models. - Yusheng Su; Xu Han 007; Zhengyan Zhang; Yankai Lin; Peng Li 030; Zhiyuan Liu 001; Jie Zhou 016; Maosong Sun 001 (AI Open, 2021)

CPM-2: Large-scale cost-effective pre-trained language models. - Zhengyan Zhang; Yuxian Gu; Xu Han 007; Shengqi Chen 001; Chaojun Xiao; Zhenbo Sun; Yuan Yao 013; Fanchao Qi; Jian Guan 002; Pei Ke; Yanzheng Cai; Guoyang Zeng; et al. (AI Open, 2021)

CPM: A large-scale generative Chinese Pre-trained language model. - Zhengyan Zhang; Xu Han 007; Hao Zhou 012; Pei Ke; Yuxian Gu; Deming Ye; Yujia Qin; Yusheng Su; Haozhe Ji; Jian Guan 002; Fanchao Qi; Xiaozhi Wang; et al. (AI Open, 2021)

Know what you don't need: Single-Shot Meta-Pruning for attention heads. - Zhengyan Zhang; Fanchao Qi; Zhiyuan Liu 001; Qun Liu 001; Maosong Sun 001 (AI Open, 2021)

Knowledgeable machine learning for natural language processing. - Xu Han 007; Zhengyan Zhang; Zhiyuan Liu 001 (Commun. ACM, 2021)

Red Alarm for Pre-trained Models: Universal Vulnerabilities by Neuron-Level Backdoor Attacks. - Zhengyan Zhang; Guangxuan Xiao; Yongwei Li; Tian Lv; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Xin Jiang 002; Maosong Sun 001 (CoRR, 2021)

CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Models. - YuSheng Su; Xu Han 007; Yankai Lin; Zhengyan Zhang; Zhiyuan Liu 001; Peng Li 030; Maosong Sun 001 (CoRR, 2021)

SHUOWEN-JIEZI: Linguistically Informed Tokenizers For Chinese Language Model Pretraining. - Chenglei Si; Zhengyan Zhang; Yingfa Chen; Fanchao Qi; Xiaozhi Wang; Zhiyuan Liu 001; Maosong Sun 001 (CoRR, 2021)

Pre-Trained Models: Past, Present and Future. - Xu Han 007; Zhengyan Zhang; Ning Ding 002; Yuxian Gu; Xiao Liu 036; Yuqi Huo; Jiezhong Qiu; Liang Zhang; Wentao Han; Minlie Huang; Qin Jin; Yanyan Lan; et al. (CoRR, 2021)

MoEfication: Conditional Computation of Transformer Models for Efficient Inference. - Zhengyan Zhang; Yankai Lin; Zhiyuan Liu 001; Peng Li 030; Maosong Sun 001; Jie Zhou 016 (CoRR, 2021)

CUGE: A Chinese Language Understanding and Generation Evaluation Benchmark. - Yuan Yao 013; Qingxiu Dong; Jian Guan 002; Boxi Cao; Zhengyan Zhang; Chaojun Xiao; Xiaozhi Wang; Fanchao Qi; Junwei Bao 001; Jinran Nie; Zheni Zeng; Yuxian Gu; et al. (CoRR, 2021)

Multi-scale Local Difference Directional Number Pattern for Group-housed Pigs Recognition. - Weijia Huang; Weixing Zhu; Zhengyan Zhang; Yizheng Guo (KSII Trans. Internet Inf. Syst., 2021)

KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation. - Xiaozhi Wang; Tianyu Gao 001; Zhaocheng Zhu; Zhengyan Zhang; Zhiyuan Liu 001; Juanzi Li; Jian Tang 005 (Trans. Assoc. Comput. Linguistics, 2021)

CSS-LM: A Contrastive Framework for Semi-Supervised Fine-Tuning of Pre-Trained Language Models. - YuSheng Su; Xu Han 007; Yankai Lin; Zhengyan Zhang; Zhiyuan Liu 001; Peng Li 030; Jie Zhou 016; Maosong Sun 001 (IEEE ACM Trans. Audio Speech Lang. Process., 2021)

Reliable Hybrid Mixture Model for Generalized Point Set Registration. - Zhengyan Zhang; Zhe Min; Ang Zhang; Jiaole Wang; Shuang Song 002; Max Q.-H. Meng (IEEE Trans. Instrum. Meas., 2021)

BMInf: An Efficient Toolkit for Big Model Inference and Tuning. - Xu Han 007; Guoyang Zeng; Weilin Zhao; Zhiyuan Liu 001; Zhengyan Zhang; Jie Zhou 016; Jun Zhang; Jia Chao; Maosong Sun 001 (ACL (demo), 2022)

Prompt Tuning for Discriminative Pre-trained Language Models. - Yuan Yao 013; Bowen Dong; Ao Zhang; Zhengyan Zhang; Ruobing Xie; Zhiyuan Liu 001; Leyu Lin; Maosong Sun 001; Jianyong Wang 001 (ACL (Findings), 2022)

MoEfication: Transformer Feed-forward Layers are Mixtures of Experts. - Zhengyan Zhang; Yankai Lin; Zhiyuan Liu 001; Peng Li 030; Maosong Sun 001; Jie Zhou 016 (ACL (Findings), 2022)

Automatic Label Sequence Generation for Prompting Sequence-to-sequence Models. - Zichun Yu; Tianyu Gao 001; Zhengyan Zhang; Yankai Lin; Zhiyuan Liu 001; Maosong Sun 001; Jie Zhou 016 (COLING, 2022)

Finding Skill Neurons in Pre-trained Transformer-based Language Models. - Xiaozhi Wang; Kaiyue Wen; Zhengyan Zhang; Lei Hou 001; Zhiyuan Liu 001; Juanzi Li (EMNLP, 2022)

BMCook: A Task-agnostic Compression Toolkit for Big Models. - Zhengyan Zhang; Baitao Gong; Yingfa Chen; Xu Han 007; Guoyang Zeng; Weilin Zhao; Yanxu Chen; Zhiyuan Liu 001; Maosong Sun 001 (EMNLP (Demos), 2022)

Effective Few-Shot Named Entity Linking by Meta-Learning. - Xiuxing Li; Zhenyu Li; Zhengyan Zhang; Ning Liu 014; Haitao Yuan 002; Wei Zhang 056; Zhiyuan Liu 001; Jianyong Wang 001 (ICDE, 2022)

Generalized 3D Rigid Point Set Registration with Anisotropic Positional Error Based on Bayesian Coherent Point Drift. - Ang Zhang; Zhe Min; Xing Yang 005; Zhengyan Zhang; Jin Pan; Max Q.-H. Meng (ICRA, 2022)

MO-Transformer: A Transformer-Based Multi-Object Point Cloud Reconstruction Network. - Erli Lyu; Zhengyan Zhang; Wei Liu 134; Jiaole Wang; Shuang Song 002; Max Q.-H. Meng (IROS, 2022)

Knowledge Inheritance for Pre-trained Language Models. - Yujia Qin; Yankai Lin; Jing Yi; Jiajie Zhang; Xu Han 007; Zhengyan Zhang; Yusheng Su; Zhiyuan Liu 001; Peng Li 030; Maosong Sun 001; Jie Zhou 016 (NAACL-HLT, 2022)

Liver function classification based on local direction number and non-local binary pattern. - Weijia Huang; Wei Yang; Zhengyan Zhang; Caiping Xi; Zehui Wang; Yuanjiang Li (Multim. Tools Appl., 2022)

Generalized Point Set Registration With Fuzzy Correspondences Based on Variational Bayesian Inference. - Ang Zhang; Zhe Min; Zhengyan Zhang; Max Q.-H. Meng (IEEE Trans. Fuzzy Syst., 2022)

COSINE: Compressive Network Embedding on Large-Scale Information Networks. - Zhengyan Zhang; Cheng Yang 002; Zhiyuan Liu 001; Maosong Sun 001; Zhichong Fang; Bo Zhang 056; Leyu Lin (IEEE Trans. Knowl. Data Eng., 2022)

A Unified Understanding of Deep NLP Models for Text Classification. - Zhen Li 044; Xiting Wang; Weikai Yang; Jing Wu 004; Zhengyan Zhang; Zhiyuan Liu 001; Maosong Sun 001; Hui Zhang 013; Shixia Liu (IEEE Trans. Vis. Comput. Graph., 2022)

READIN: A Chinese Multi-Task Benchmark with Realistic and Diverse Input Noises. - Chenglei Si; Zhengyan Zhang; Yingfa Chen; Xiaozhi Wang; Zhiyuan Liu 001; Maosong Sun 001 (ACL (1), 2023)

Plug-and-Play Document Modules for Pre-trained Models. - Chaojun Xiao; Zhengyan Zhang; Xu Han 007; Chi-Min Chan; Yankai Lin; Zhiyuan Liu 001; Xiangyang Li; Zhonghua Li; Zhao Cao; Maosong Sun 001 (ACL (1), 2023)

Plug-and-Play Knowledge Injection for Pre-trained Language Models. - Zhengyan Zhang; Zhiyuan Zeng; Yankai Lin; Huadong Wang; Deming Ye; Chaojun Xiao; Xu Han 007; Zhiyuan Liu 001; Peng Li 030; Maosong Sun 001; Jie Zhou 016 (ACL (1), 2023)

Emergent Modularity in Pre-trained Transformers. - Zhengyan Zhang; Zhiyuan Zeng; Yankai Lin; Chaojun Xiao; Xiaozhi Wang; Xu Han 007; Zhiyuan Liu 001; Ruobing Xie; Maosong Sun 001; Jie Zhou 016 (ACL (Findings), 2023)

Variator: Accelerating Pre-trained Models with Plug-and-Play Compression Modules. - Chaojun Xiao; Yuqi Luo; Wenbin Zhang; Pengle Zhang; Xu Han 007; Yankai Lin; Zhengyan Zhang; Ruobing Xie; Zhiyuan Liu 001; Maosong Sun 001; Jie Zhou 016 (EMNLP (Findings), 2023)

Non-Rigid 3D Point Set Registration With Reliable Hybrid Mixture Model. - Haocheng Huang; Zhengyan Zhang; Zhe Min; Max Q.-H. Meng; Shuang Song 002; Jiaole Wang (ROBIO, 2023)

A Transferable Multi-Agent Reinforcement Learning Method for Distribution Service Restoration. - Ruiqi Si; Ji Qiao; Xiaohui Wang; Kaixuan Ji; Zibo Wang; Zhang Jun; Xuanying Pan; Zhengyan Zhang (SMC, 2023)

UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models. - Deming Ye; Yankai Lin; Zhengyan Zhang; Maosong Sun 001 (CoRR, 2023)

CPET: Effective Parameter-Efficient Tuning for Compressed Large Language Models. - Weilin Zhao; Yuxiang Huang; Xu Han 007; Zhiyuan Liu 001; Zhengyan Zhang; Maosong Sun 001 (CoRR, 2023)

Sub-Character Tokenization for Chinese Pretrained Language Models. - Chenglei Si; Zhengyan Zhang; Yingfa Chen; Fanchao Qi; Xiaozhi Wang; Zhiyuan Liu 001; Yasheng Wang; Qun Liu 001; Maosong Sun 001 (Trans. Assoc. Comput. Linguistics, 2023)

Anisotropic Generalized Bayesian Coherent Point Drift for Point Set Registration. - Ang Zhang; Zhe Min; Zhengyan Zhang; Xing Yang 005; Max Q.-H. Meng (IEEE Trans Autom. Sci. Eng., 2023)

Anisotropic 6-D Rigid Point Set Registration. - Zhe Min; Ang Zhang; Delong Zhu; Jin Pan; Zhengyan Zhang; Max Q.-H. Meng (IEEE Trans. Instrum. Meas., 2023)

Tracking-by-Registration: A Robust Approach for Optical Tracking System in Surgical Navigation. - Jiaole Wang; Tinghua Zhang; Zhengyan Zhang; Max Q.-H. Meng; Shuang Song 002 (IEEE Trans. Instrum. Meas., 2023)

Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-level Backdoor Attacks. - Zhengyan Zhang; Guangxuan Xiao; Yongwei Li; Tian Lv; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Xin Jiang 002; Maosong Sun 001 (Mach. Intell. Res., 2023)

DRFM-Based Repeater Jamming Reconstruction and Cancellation Method with Accurate Edge Detection. - Bowen Han; Xiaodong Qu; Xiaopeng Yang; Wolin Li; Zhengyan Zhang (Remote. Sens., 2023)

Research on SUnet Winter Wheat Identification Method Based on GF-2. - Ke Zhou; Zhengyan Zhang; Le Liu; Ru Miao; Yang Yang; Tongcan Ren; Ming Yue (Remote. Sens., 2023)

DRFM Repeater Jamming Suppression Method Based on Joint Range-Angle Sparse Recovery and Beamforming for Distributed Array Radar. - Bowen Han; Xiaodong Qu; Xiaopeng Yang; Zhengyan Zhang; Wolin Li (Remote. Sens., 2023)

Hybrid Indoor Positioning System Based on Acoustic Ranging and Wi-Fi Fingerprinting under NLOS Environments. - Zhengyan Zhang; Yue Yu 003; Liang Chen 007; Ruizhi Chen (Remote. Sens., 2023)

Robust Semi-Supervised Point Cloud Registration via Latent GMM-Based Correspondence. - Zhengyan Zhang; Erli Lyu; Zhe Min; Ang Zhang; Yue Yu 003; Max Q.-H. Meng (Remote. Sens., 2023)

Robust and Scalable Model Editing for Large Language Models. - Yingfa Chen; Zhengyan Zhang; Xu Han 007; Chaojun Xiao; Zhiyuan Liu 001; Chen Chen; Kuai Li; Tao Yang; Maosong Sun 001 (LREC/COLING, 2024)

Exploring the Benefit of Activation Sparsity in Pre-training. - Zhengyan Zhang; Chaojun Xiao; Qiujieli Qin; Yankai Lin; Zhiyuan Zeng; Xu Han 007; Zhiyuan Liu 001; Ruobing Xie; Maosong Sun 001; Jie Zhou 016 (ICML, 2024)

OBHMR: Robust Partial-to-full Generalized Point Set Registration with Overlap-guided Bidirectional Hybrid Mixture Model. - Xinzhe Du; Zhengyan Zhang; Ang Zhang; Rui Song 002; Yibin Li 001; Max Q.-H. Meng; Zhe Min (IROS, 2024)

DeepBHMR: Learning Bidirectional Hybrid Mixture Models for Generalized Rigid Point Set Registration. - Zhe Min; Zhengyan Zhang; Ang Zhang; Rui Song 002; Yibin Li 001; Max Q.-H. Meng (IROS, 2024)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory. - Chaojun Xiao; Pengle Zhang; Xu Han 007; Guangxuan Xiao; Yankai Lin; Zhengyan Zhang; Zhiyuan Liu 001; Maosong Sun 001 (NeurIPS, 2024)

CPT: Colorful Prompt Tuning for pre-trained vision-language models. - Yuan Yao 013; Ao Zhang; Zhengyan Zhang; Zhiyuan Liu 001; Tat-Seng Chua; Maosong Sun 001 (AI Open, 2024)

ReLU2 Wins: Discovering Efficient Activation Functions for Sparse LLMs. - Zhengyan Zhang; Yixin Song; Guanghui Yu; Xu Han 007; Yankai Lin; Chaojun Xiao; Chenyang Song; Zhiyuan Liu 001; Zeyu Mi; Maosong Sun 001 (CoRR, 2024)

InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory. - Chaojun Xiao; Pengle Zhang; Xu Han 007; Guangxuan Xiao; Yankai Lin; Zhengyan Zhang; Zhiyuan Liu 001; Song Han 003; Maosong Sun 001 (CoRR, 2024)

Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters. - Yixin Song; Haotong Xie; Zhengyan Zhang; Bo Wen; Li Ma; Zeyu Mi; Haibo Chen 001 (CoRR, 2024)

Configurable Foundation Models: Building LLMs from a Modular Perspective. - Chaojun Xiao; Zhengyan Zhang; Chenyang Song; Dazhi Jiang; Feng Yao; Xu Han 007; Xiaozhi Wang; Shuo Wang 013; Yufei Huang 008; Guanyu Lin; Yingfa Chen; Weilin Zhao; et al. (CoRR, 2024)

DOA Estimation Method Based on Unsupervised Learning Network With Threshold Capon Spectrum Weighted Penalty. - Zhengyan Zhang; Xiaodong Qu; Wolin Li; Hongzhe Miao; Fengrui Liu (IEEE Signal Process. Lett., 2024)

Robust Adaptive Beamforming Method Based on Steering Vector Phase Correction and Covariance Matrix Reconstruction. - Wolin Li; Xiaodong Qu; Xiaopeng Yang; Bowen Han; Zhengyan Zhang; Aly E. Fathy (IEEE Commun. Lett., 2024)

CGAN: lightweight and feature aggregation network for high-performance interactive image segmentation. - Gui Yan; Zhengyan Zhang; Chen Zhihua; Zhang Chuang; Zhang Jin (Vis. Comput., 2024)

Correction to: Red Alarm for Pre-trained Models: Universal Vulnerability to Neuron-level Backdoor Attacks. - Zhengyan Zhang; Guangxuan Xiao; Yongwei Li; Tian Lv; Fanchao Qi; Zhiyuan Liu 001; Yasheng Wang; Xin Jiang 002; Maosong Sun 001 (Mach. Intell. Res., 2024)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Yuxing Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (ACL (1), 2025)

ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models. - Chenyang Song; Xu Han 007; Zhengyan Zhang; Shengding Hu; Xiyu Shi; Kuai Li; Chen Chen; Zhiyuan Liu 001; Guangli Li; Tao Yang; Maosong Sun 001 (COLING, 2025)

PF-MAAC: A learning-based method for probabilistic optimization in time-constrained non-adversarial moving target search. - Qihang Peng; Hongliang Guo; Zhengyan Zhang; Chih-Yung Wen; Yaochu Jin (Swarm Evol. Comput., 2025)

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention. - Jingyang Yuan; Huazuo Gao; Damai Dai; Junyu Luo 002; Liang Zhao; Zhengyan Zhang; Zhenda Xie; Y. X. Wei; Lean Wang; Zhiping Xiao 001; Yuqing Wang; Chong Ruan; et al. (CoRR, 2025)