HashFormers: Towards Vocabulary-independent Pre-trained Transformers. - Huiyin Xue; Nikolaos Aletras (EMNLP, 2022)

Pit One Against Many: Leveraging Attention-head Embeddings for Parameter-efficient Multi-head Attention. - Huiyin Xue; Nikolaos Aletras (EMNLP (Findings), 2023)

DReSD: Dense Retrieval for Speculative Decoding. - Milan Gritta; Huiyin Xue; Gerasimos Lampouras (ACL (Findings), 2025)