RA-DIT: Retrieval-Augmented Dual Instruction Tuning. - Xi Victoria Lin; Xilun Chen 002; Mingda Chen; Weijia Shi; Maria Lomeli; Richard James 001; Pedro Rodriguez 001; Jacob Kahn; Gergely Szilvasy; Mike Lewis; Luke Zettlemoyer; Wen-tau Yih (ICLR, 2024)

The Faiss library. - Matthijs Douze; Alexandr Guzhva; Chengqi Deng; Jeff Johnson 004; Gergely Szilvasy; Pierre-Emmanuel Mazaré; Maria Lomeli; Lucas Hosseini; Hervé Jégou (CoRR, 2024)

Vector search with small radiuses. - Gergely Szilvasy; Pierre-Emmanuel Mazaré; Matthijs Douze (CoRR, 2024)

Evaluation data contamination in LLMs: how do we measure it and (when) does it matter? - Aaditya K. Singh; Muhammed Yusuf Kocyigit; Andrew Poulton; David Esiobu; Maria Lomeli; Gergely Szilvasy; Dieuwke Hupkes (CoRR, 2024)

Inference-time sparse attention with asymmetric indexing. - Pierre-Emmanuel Mazaré; Gergely Szilvasy; Maria Lomeli; Francisco Massa; Naila Murray; Hervé Jégou; Matthijs Douze (CoRR, 2025)

Stochastic activations. - Maria Lomeli; Matthijs Douze; Gergely Szilvasy; Loïc Cabannes; Jade Copet; Sainbayar Sukhbaatar; Jason Weston; Gabriel Synnaeve; Pierre-Emmanuel Mazaré; Hervé Jégou (CoRR, 2025)

Short window attention enables long-term memorization. - Loïc Cabannes; Maximilian Beck; Gergely Szilvasy; Matthijs Douze; Maria Lomeli; Jade Copet; Pierre-Emmanuel Mazaré; Gabriel Synnaeve; Hervé Jégou (CoRR, 2025)