PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation. - Yunhe Wang 001; Hanting Chen; Yehui Tang; Tianyu Guo 001; Kai Han 002; Ying Nie; Xutao Wang; Hailin Hu 002; Zheyuan Bai; Yun Wang; Fangcheng Liu; Zhicheng Liu 001; et al. (CoRR, 2023)