Cottention: Linear Transformers With Cosine Attention. - Gabriel Mongaras; Trevor Dohm; Eric C. Larson (CoRR, 2024)

On the Expressiveness of Softmax Attention: A Recurrent Neural Network Perspective. - Gabriel Mongaras; Eric C. Larson (CoRR, 2025)