Attention-likelihood relationship in Transformers. - Valeria Ruscio; Valentino Maiorca; Fabrizio Silvestri (Tiny Papers @ ICLR, 2023)

Beyond position: how rotary embeddings shape representations and memory in autoregressive transfomers. - Valeria Ruscio; Fabrizio Silvestri (CoRR, 2024)

Beyond Position: the emergence of wavelet-like properties in Transformers. - Valeria Ruscio; Umberto Nanni; Fabrizio Silvestri (ACL (1), 2025)

What are you sinking? A geometric approach on attention sink. - Valeria Ruscio; Umberto Nanni; Fabrizio Silvestri (CoRR, 2025)