The Impact of Reasoning Step Length on Large Language Models. - Mingyu Jin; Qinkai Yu; Dong Shu; Haiyan Zhao 003; Wenyue Hua; Yanda Meng; Yongfeng Zhang; Mengnan Du (ACL (Findings), 2024)

Mitigating Shortcuts in Language Models with Soft Label Encoding. - Zirui He; Huiqi Deng; Haiyan Zhao 003; Ninghao Liu; Mengnan Du (LREC/COLING, 2024)

Opening the Black Box of Large Language Models: Two Views on Holistic Interpretability. - Haiyan Zhao 003; Fan Yang 023; Himabindu Lakkaraju; Mengnan Du (CoRR, 2024)

Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era. - Xuansheng Wu; Haiyan Zhao 003; Yaochen Zhu; Yucheng Shi; Fan Yang 023; Tianming Liu 001; Xiaoming Zhai; Wenlin Yao; Jundong Li; Mengnan Du; Ninghao Liu (CoRR, 2024)

Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers? - Mingyu Jin; Qinkai Yu; Jingyuan Huang; Qingcheng Zeng; Zhenting Wang; Wenyue Hua; Haiyan Zhao 003; Kai Mei; Yanda Meng; Kaize Ding; Fan Yang 023; Mengnan Du; et al. (CoRR, 2024)

Exploring Multilingual Probing in Large Language Models: A Cross-Language Analysis. - Daoyang Li; Mingyu Jin; Qingcheng Zeng; Haiyan Zhao 003; Mengnan Du (CoRR, 2024)

Explainability for Large Language Models: A Survey. - Haiyan Zhao 003; Hanjie Chen; Fan Yang 023; Ninghao Liu; Huiqi Deng; Hengyi Cai; Shuaiqiang Wang; Dawei Yin; Mengnan Du (ACM Trans. Intell. Syst. Technol., 2024)

Exploring Concept Depth: How Large Language Models Acquire Knowledge and Concept at Different Layers? - Mingyu Jin; Qinkai Yu; Jingyuan Huang; Qingcheng Zeng; Zhenting Wang; Wenyue Hua; Haiyan Zhao 003; Kai Mei; Yanda Meng; Kaize Ding; Fan Yang 023; Mengnan Du; et al. (COLING, 2025)

Beyond Single Concept Vector: Modeling Concept Subspace in LLMs with Gaussian Distribution. - Haiyan Zhao 003; Heng Zhao; Bo Shen; Ali Payani; Fan Yang 023; Mengnan Du (ICLR, 2025)

Large Vision-Language Model Alignment and Misalignment: A Survey Through the Lens of Explainability. - Dong Shu; Haiyan Zhao 003; Jingyu Hu 002; Weiru Liu; Lu Cheng; Mengnan Du (CoRR, 2025)

SAIF: A Sparse Autoencoder Framework for Interpreting and Steering Instruction Following of Language Models. - Zirui He; Haiyan Zhao 003; Yiran Qiao 001; Fan Yang 023; Ali Payani; Jing Ma 002; Mengnan Du (CoRR, 2025)

A Survey on Sparse Autoencoders: Interpreting the Internal Mechanisms of Large Language Models. - Dong Shu; Xuansheng Wu; Haiyan Zhao 003; Daking Rai; Ziyu Yao 002; Ninghao Liu; Mengnan Du (CoRR, 2025)

Beyond Input Activations: Identifying Influential Latents by Gradient Sparse Autoencoders. - Dong Shu; Xuansheng Wu; Haiyan Zhao 003; Mengnan Du; Ninghao Liu (CoRR, 2025)

Denoising Concept Vectors with Sparse Autoencoders for Improved Language Model Steering. - Haiyan Zhao 003; Xuansheng Wu; Fan Yang 023; Bo Shen; Ninghao Liu; Mengnan Du (CoRR, 2025)