Initialization is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing. - Zhongwang Zhang; Pengxiao Lin; Zhiwei Wang; Yaoyu Zhang; Zhi-Qin John Xu (NeurIPS, 2024)

Initialization is Critical to Whether Transformers Fit Composite Functions by Inference or Memorizing. - Zhongwang Zhang; Pengxiao Lin; Zhiwei Wang; Yaoyu Zhang; Zhi-Qin John Xu (CoRR, 2024)

M2M: Learning controllable Multi of experts and multi-scale operators are the Partial Differential Equations need. - Aoming Liang; Zhaoyang Mu; Pengxiao Lin; Cong Wang; Mingming Ge; Ling Shao 001; Dixia Fan; Hao Tang 005 (CoRR, 2024)

Complexity Control Facilitates Reasoning-Based Compositional Generalization in Transformers. - Zhongwang Zhang; Pengxiao Lin; Zhiwei Wang; Yaoyu Zhang; Zhi-Qin John Xu (CoRR, 2025)

Reasoning Bias of Next Token Prediction Training. - Pengxiao Lin; Zhongwang Zhang; Zhi-Qin John Xu (CoRR, 2025)

Scalable Complexity Control Facilitates Reasoning Ability of LLMs. - Liangkai Hang; Junjie Yao; Zhiwei Bai; Tianyi Chen; Yang Chen; Rongjie Diao; Hezhou Li; Pengxiao Lin; Zhiwei Wang; Cheng Xu; Zhongwang Zhang; Zhangchen Zhou; et al. (CoRR, 2025)

Achilles' Heel of Mamba: Essential difficulties of the Mamba architecture demonstrated by synthetic data. - Tianyi Chen; Pengxiao Lin; Zhiwei Wang; Zhi-Qin John Xu (CoRR, 2025)

Identity Bridge: Enabling Implicit Reasoning via Shared Latent Memory. - Pengxiao Lin; Zheng-An Chen; Zhi-Qin John Xu (CoRR, 2025)