Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned. - Elena Voita; David Talbot; Fedor Moiseev; Rico Sennrich; Ivan Titov 001 (ACL (1), 2019)

SKILL: Structured Knowledge Infusion for Large Language Models. - Fedor Moiseev; Zhe Dong; Enrique Alfonseca; Martin Jaggi (NAACL-HLT, 2022)

SamToNe: Improving Contrastive Loss for Dual Encoder Retrieval Models with Same Tower Negatives. - Fedor Moiseev; Gustavo Hernández Abrego; Péter Dornbach; Imed Zitouni; Enrique Alfonseca; Zhe Dong (ACL (Findings), 2023)

Adapting Decoder-Based Language Models for Diverse Encoder Downstream Tasks. - Paul Suganthan; Fedor Moiseev; Le Yan; Junru Wu; Jianmo Ni; Jay Han; Imed Zitouni; Enrique Alfonseca; Xuanhui Wang; Zhe Dong (CoRR, 2025)

Gemini Embedding: Generalizable Embeddings from Gemini. - Jinhyuk Lee; Feiyang Chen; Sahil Dua; Daniel Cer; Madhuri Shanbhogue; Iftekhar Naim; Gustavo Hernández Ábrego; Zhe Li; Kaifeng Chen; Henrique Schechter Vera; Xiaoqi Ren; Shanfeng Zhang; et al. (CoRR, 2025)

Encoder-Decoder Gemma: Improving the Quality-Efficiency Trade-Off via Adaptation. - Biao Zhang; Fedor Moiseev; Joshua Ainslie; Paul Suganthan; Min Ma; Surya Bhupatiraju; Federico Lebrón; Orhan Firat; Armand Joulin; Zhe Dong (CoRR, 2025)