A Simple and Effective Positional Encoding for Transformers. - Pu-Chin Chen; Henry Tsai; Srinadh Bhojanapalli; Hyung Won Chung; Yin-Wen Chang; Chun-Sung Ferng (EMNLP (1), 2021)

Demystifying the Better Performance of Position Encoding Variants for Transformer. - Pu-Chin Chen; Henry Tsai; Srinadh Bhojanapalli; Hyung Won Chung; Yin-Wen Chang; Chun-Sung Ferng (CoRR, 2021)