Wentao Shu

According to our database, Wentao Shu authored at least 12 papers between 2022 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

A Distributional View for Visual Mechanistic Interpretability: KL-Minimal Soft-Constraint Principle.

Guancheng Zhou, Yisi Luo, Zhengfu He, Zhenyu Jin, Xuyang Ge, Wentao Shu, Deyu Meng, Xipeng Qiu

CoRR, May, 2026

Tracing the Thought of a Grandmaster-level Chess-Playing Transformer.

Rui Lin, Zhenyu Jin, Guancheng Zhou, Xuyang Ge, Wentao Shu, Jiaxing Wu, Junxuan Wang, Zhengfu He, Junping Zhang, Xipeng Qiu

CoRR, April, 2026

2025

Evolution of Concepts in Language Model Pre-Training.

Xuyang Ge, Wentao Shu, Jiaxing Wu, Yunhua Zhou, Zhengfu He, Xipeng Qiu

CoRR, September, 2025

Attention Layers Add Into Low-Dimensional Residual Subspaces.

Junxuan Wang, Xuyang Ge, Wentao Shu, Zhengfu He, Xipeng Qiu

CoRR, August, 2025

Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition.

Zhengfu He, Junxuan Wang, Rui Lin, Xuyang Ge, Wentao Shu, Qiong Tang, Junping Zhang, Xipeng Qiu

CoRR, April, 2025

Towards Universality: Studying Mechanistic Similarity Across Language Model Architectures.

Junxuan Wang, Xuyang Ge, Wentao Shu, Qiong Tang, Yunhua Zhou, Zhengfu He, Xipeng Qiu

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Llama Scope: Extracting Millions of Features from Llama-3.1-8B with Sparse Autoencoders.

Zhengfu He, Wentao Shu, Xuyang Ge, Lingjie Chen, Junxuan Wang, Yunhua Zhou, Frances Liu, Qipeng Guo, Xuanjing Huang, Zuxuan Wu, Yu-Gang Jiang, Xipeng Qiu

CoRR, 2024

Automatically Identifying Local and Global Circuits with Linear Computation Graphs.

Xuyang Ge, Fukang Zhu, Wentao Shu, Junxuan Wang, Zhengfu He, Xipeng Qiu

CoRR, 2024

Memorize Step by Step: Efficient Long-Context Prefilling with Incremental Memory and Decremental Chunk.

Zhiyuan Zeng, Qipeng Guo, Xiaoran Liu, Zhangyue Yin, Wentao Shu, Mianqiu Huang, Bo Wang, Yunhua Zhou, Linlin Li, Qun Liu, Xipeng Qiu

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2022

StyleFormerGAN-VC:Improving Effect of few shot Cross-Lingual Voice Conversion Using VAE-StarGAN and Attention-AdaIN.

Dengfeng Ke, Wenhan Yao, Ruixin Hu, Liangjie Huang, Qi Luo, Wentao Shu

Proceedings of the 24th IEEE/ACIS International Conference on Software Engineering, 2022

A New Spoken Language Teaching Tech: Combining Multi-attention and AdaIN for One-shot Cross Language Voice Conversion.

Dengfeng Ke, Wenhan Yao, Ruixin Hu, Liangjie Huang, Qi Luo, Wentao Shu

Proceedings of the 13th International Symposium on Chinese Spoken Language Processing, 2022

AdaptiveFormer: A Few-shot Speaker Adaptive Speech Synthesis Model based on FastSpeech2.

Dengfeng Ke, Ruixin Hu, Qi Luo, Liangjie Huang, Wenhan Yao, Wentao Shu, Jinsong Zhang, Yanlu Xie

Proceedings of the 13th International Symposium on Chinese Spoken Language Processing, 2022