Aiming to Know You Better Perhaps Makes Me a More Engaging Dialogue Partner. - Yury Zemlyanskiy; Fei Sha (CoNLL, 2018)

Self-Attentive, Multi-Context One-Class Classification for Unsupervised Anomaly Detection on Text. - Lukas Ruff; Yury Zemlyanskiy; Robert A. Vandermeulen; Thomas Schnake; Marius Kloft (ACL (1), 2019)

DOCENT: Learning Self-Supervised Entity Representations from Large Document Collections. - Yury Zemlyanskiy; Sudeep Gandhe; Ruining He; Bhargav Kanagal; Anirudh Ravula; Juraj Gottweis; Fei Sha; Ilya Eckstein (EACL, 2021)

ReadTwice: Reading Very Large Documents with Memories. - Yury Zemlyanskiy; Joshua Ainslie; Michiel de Jong; Philip Pham; Ilya Eckstein; Fei Sha (NAACL-HLT, 2021)

Generate-and-Retrieve: Use Your Predictions to Improve Retrieval for Semantic Parsing. - Yury Zemlyanskiy; Michiel de Jong; Joshua Ainslie; Panupong Pasupat; Peter Shaw 004; Linlu Qiu; Sumit Sanghai; Fei Sha (COLING, 2022)

Mention Memory: incorporating textual knowledge into Transformers through entity mention attention. - Michiel de Jong; Yury Zemlyanskiy; Nicholas FitzGerald; Fei Sha; William W. Cohen (ICLR, 2022)

FiDO: Fusion-in-Decoder optimized for stronger performance and faster inference. - Michiel de Jong; Yury Zemlyanskiy; Joshua Ainslie; Nicholas FitzGerald; Sumit Sanghai; Fei Sha; William W. Cohen (ACL (Findings), 2023)

CoLT5: Faster Long-Range Transformers with Conditional Computation. - Joshua Ainslie; Tao Lei; Michiel de Jong; Santiago Ontañón; Siddhartha Brahma; Yury Zemlyanskiy; David C. Uthus; Mandy Guo; James Lee-Thorp; Yi Tay; Yun-Hsuan Sung; Sumit Sanghai (EMNLP, 2023)

GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints. - Joshua Ainslie; James Lee-Thorp; Michiel de Jong; Yury Zemlyanskiy; Federico Lebrón; Sumit Sanghai (EMNLP, 2023)

Pre-computed memory or on-the-fly encoding? A hybrid approach to retrieval augmentation makes the most of your compute. - Michiel de Jong; Yury Zemlyanskiy; Nicholas FitzGerald; Joshua Ainslie; Sumit Sanghai; Fei Sha; William W. Cohen (ICML, 2023)

Arithmetic Sampling: Parallel Diverse Decoding for Large Language Models. - Luke Vilnis; Yury Zemlyanskiy; Patrick Murray; Alexandre Tachard Passos; Sumit Sanghai (ICML, 2023)

GLIMMER: generalized late-interaction memory reranker. - Michiel de Jong; Yury Zemlyanskiy; Nicholas FitzGerald; Sumit Sanghai; William W. Cohen; Joshua Ainslie (CoRR, 2023)

MEMORY-VQ: Compression for Tractable Internet-Scale Memory. - Yury Zemlyanskiy; Michiel de Jong; Luke Vilnis; Santiago Ontañón; William W. Cohen; Sumit Sanghai; Joshua Ainslie (NAACL (Short Papers), 2024)