cosFormer: Rethinking Softmax In Attention. - Zhen Qin 003; Weixuan Sun; Hui Deng; Dongxu Li; Yunshen Wei; Baohong Lv; Junjie Yan; Lingpeng Kong; Yiran Zhong (ICLR, 2022)

Scaling TransNormer to 175 Billion Parameters. - Zhen Qin 003; Dong Li 033; Weigao Sun; Weixuan Sun; Xuyang Shen; Xiaodong Han; Yunshen Wei; Baohong Lv; Fei Yuan; Xiao Luo; Yu Qiao 001; Yiran Zhong (CoRR, 2023)