PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing. - Xiaozhe Ren; Pingyi Zhou; Xinfan Meng; Xinjing Huang; Yadao Wang; Weichao Wang; Pengfei Li; Xiaoda Zhang; Alexander Podolskiy; Grigory Arshinov; Andrey Bout; Irina Piontkovskaya; et al. (CoRR, 2023)