Transformers with convolutional context for ASR. - Abdelrahman Mohamed; Dmytro Okhonko; Luke Zettlemoyer (CoRR, 2019)

Training ASR Models By Generation of Contextual Information. - Kritika Singh; Dmytro Okhonko; Jun Liu; Yongqiang Wang 005; Frank Zhang 001; Ross B. Girshick; Sergey Edunov; Fuchun Peng; Yatharth Saraf; Geoffrey Zweig; Abdelrahman Mohamed (ICASSP, 2020)

Fairseq S2T: Fast Speech-to-Text Modeling with Fairseq. - Changhan Wang; Yun Tang 002; Xutai Ma; Anne Wu; Dmytro Okhonko; Juan Miguel Pino (AACL/IJCNLP (System Demonstrations), 2020)

NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned. - Sewon Min; Jordan L. Boyd-Graber; Chris Alberti; Danqi Chen 001; Eunsol Choi; Michael Collins 001; Kelvin Guu; Hannaneh Hajishirzi; Kenton Lee; Jennimaria Palomaki; Colin Raffel; Adam Roberts; et al. (NeurIPS (Competition and Demos), 2020)

Unified Open-Domain Question Answering with Structured and Unstructured Knowledge. - Barlas Oguz; Xilun Chen 002; Vladimir Karpukhin; Stan Peshterliev; Dmytro Okhonko; Michael Sejr Schlichtkrull; Sonal Gupta; Yashar Mehdad; Scott Yih (CoRR, 2020)

VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding. - Hu Xu 001; Gargi Ghosh; Po-Yao Huang 001; Dmytro Okhonko; Armen Aghajanyan; Florian Metze; Luke Zettlemoyer; Christoph Feichtenhofer (EMNLP (1), 2021)

The Web Is Your Oyster - Knowledge-Intensive NLP against a Very Large Web Corpus. - Aleksandra Piktus; Fabio Petroni; Vladimir Karpukhin; Dmytro Okhonko; Samuel Broscheit; Gautier Izacard; Patrick Lewis 001; Barlas Oguz; Edouard Grave; Wen-tau Yih; Sebastian Riedel 001 (CoRR, 2021)

HTLM: Hyper-Text Pre-Training and Prompting of Language Models. - Armen Aghajanyan; Dmytro Okhonko; Mike Lewis; Mandar Joshi; Hu Xu 001; Gargi Ghosh; Luke Zettlemoyer (ICLR, 2022)

CCQA: A New Web-Scale Question Answering Dataset for Model Pre-Training. - Patrick Huber; Armen Aghajanyan; Barlas Oguz; Dmytro Okhonko; Scott Yih; Sonal Gupta; Xilun Chen 002 (NAACL-HLT (Findings), 2022)

UniK-QA: Unified Representations of Structured and Unstructured Knowledge for Open-Domain Question Answering. - Barlas Oguz; Xilun Chen 002; Vladimir Karpukhin; Stan Peshterliev; Dmytro Okhonko; Michael Sejr Schlichtkrull; Sonal Gupta; Yashar Mehdad; Scott Yih (NAACL-HLT (Findings), 2022)

CM3: A Causal Masked Multimodal Model of the Internet. - Armen Aghajanyan; Bernie Huang; Candace Ross; Vladimir Karpukhin; Hu Xu 001; Naman Goyal 001; Dmytro Okhonko; Mandar Joshi; Gargi Ghosh; Mike Lewis; Luke Zettlemoyer (CoRR, 2022)

LegoNN: Building Modular Encoder-Decoder Models. - Siddharth Dalmia; Dmytro Okhonko; Mike Lewis; Sergey Edunov; Shinji Watanabe 001; Florian Metze; Luke Zettlemoyer; Abdelrahman Mohamed (IEEE ACM Trans. Audio Speech Lang. Process., 2023)