Is Attention All What You Need? - An Empirical Investigation on Convolution-Based Active Memory and Self-Attention. - Thomas Dowdell; Hongyu Zhang (CoRR, 2019)

Language Modelling for Source Code with Transformer-XL. - Thomas Dowdell; Hongyu Zhang (CoRR, 2020)