WikiReading: A Novel Large-scale Language Understanding Task over Wikipedia. - Daniel Hewlett; Alexandre Lacoste; Llion Jones; Illia Polosukhin; Andrew Fandrianto; Jay Han; Matthew Kelcey; David Berthelot (ACL (1), 2016)

Accurate Supervised and Semi-Supervised Machine Reading for Long Documents. - Izzeddin Gur; Daniel Hewlett; Alexandre Lacoste; Llion Jones (EMNLP, 2017)

Attention is All you Need. - Ashish Vaswani; Noam Shazeer; Niki Parmar; Jakob Uszkoreit; Llion Jones; Aidan N. Gomez; Lukasz Kaiser; Illia Polosukhin (NIPS, 2017)

One Model To Learn Them All. - Lukasz Kaiser; Aidan N. Gomez; Noam Shazeer; Ashish Vaswani; Niki Parmar; Llion Jones; Jakob Uszkoreit (CoRR, 2017)

Byte-Level Machine Reading Across Morphologically Varied Languages. - Tom Kenter; Llion Jones; Daniel Hewlett (AAAI, 2018)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Mike Schuster; Noam Shazeer; Niki Parmar; Ashish Vaswani; Jakob Uszkoreit; et al. (ACL (1), 2018)

Tensor2Tensor for Neural Machine Translation. - Ashish Vaswani; Samy Bengio; Eugene Brevdo; François Chollet; Aidan N. Gomez; Stephan Gouws; Llion Jones; Lukasz Kaiser; Nal Kalchbrenner; Niki Parmar; Ryan Sepassi; Noam Shazeer; et al. (AMTA (1), 2018)

The Best of Both Worlds: Combining Recent Advances in Neural Machine Translation. - Mia Xu Chen; Orhan Firat; Ankur Bapna; Melvin Johnson; Wolfgang Macherey; George F. Foster; Llion Jones; Niki Parmar; Mike Schuster; Zhifeng Chen; Yonghui Wu; Macduff Hughes (CoRR, 2018)

Character-Level Language Modeling with Deeper Self-Attention. - Rami Al-Rfou; Dokook Choe; Noah Constant; Mandy Guo; Llion Jones (AAAI, 2019)

Lingvo: a Modular and Scalable Framework for Sequence-to-Sequence Modeling. - Jonathan Shen; Patrick Nguyen; Yonghui Wu; Zhifeng Chen; Mia Xu Chen; Ye Jia; Anjuli Kannan; Tara N. Sainath; Yuan Cao 007; Chung-Cheng Chiu; Yanzhang He; Jan Chorowski; et al. (CoRR, 2019)

Natural Questions: a Benchmark for Question Answering Research. - Tom Kwiatkowski; Jennimaria Palomaki; Olivia Redfield; Michael Collins 001; Ankur P. Parikh; Chris Alberti; Danielle Epstein; Illia Polosukhin; Jacob Devlin; Kenton Lee; Kristina Toutanova; Llion Jones; et al. (Trans. Assoc. Comput. Linguistics, 2019)

ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computing. - Ahmed Elnaggar; Michael Heinzinger; Christian Dallago; Ghalia Rehawi; Yu Wang; Llion Jones; Tom Gibbs; Tamas Feher; Christoph Angerer; Martin Steinegger; Debsindhu Bhowmik; Burkhard Rost (CoRR, 2020)

A Comparative Study on Neural Architectures and Training Methods for Japanese Speech Recognition. - Shigeki Karita; Yotaro Kubo; Michiel Adriaan Unico Bacchiani; Llion Jones (Interspeech, 2021)

DF-Conformer: Integrated Architecture of Conv-Tasnet and Conformer Using Linear Complexity Self-Attention for Speech Enhancement. - Yuma Koizumi; Shigeki Karita; Scott Wisdom; Hakan Erdogan; John R. Hershey; Llion Jones; Michiel Bacchiani (WASPAA, 2021)

CodeTrans: Towards Cracking the Language of Silicone's Code Through Self-Supervised Deep Learning and High Performance Computing. - Ahmed Elnaggar; Wei Ding; Llion Jones; Tom Gibbs; Tamas Feher; Christoph Angerer; Silvia Severini; Florian Matthes; Burkhard Rost (CoRR, 2021)

ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning. - Ahmed Elnaggar; Michael Heinzinger; Christian Dallago; Ghalia Rehawi; Yu Wang; Llion Jones; Tom Gibbs; Tamas Feher; Christoph Angerer; Martin Steinegger; Debsindhu Bhowmik; Burkhard Rost (IEEE Trans. Pattern Anal. Mach. Intell., 2022)

Helpful Neighbors: Leveraging Neighbors in Geographic Feature Pronunciation. - Llion Jones; Richard Sproat; Haruko Ishikawa; Alexander Gutkin (Trans. Assoc. Comput. Linguistics, 2023)

The Ungrounded Alignment Problem. - Marc Pickett; Aakash Kumar Nain; Joseph Modayil; Llion Jones (CoRR, 2024)

Transformer Layers as Painters. - Qi Sun; Marc Pickett; Aakash Kumar Nain; Llion Jones (AAAI, 2025)

Continuous Thought Machines. - Luke Darlow; Ciaran Regan; Sebastian Risi; Jeffrey Seely; Llion Jones (CoRR, 2025)

Sudoku-Bench: Evaluating creative reasoning with Sudoku variants. - Jeffrey Seely; Yuki Imajuku; Tianyu Zhao 001; Edoardo Cetin; Llion Jones (CoRR, 2025)

TransEvalnia: Reasoning-based Evaluation and Ranking of Translations. - Richard Sproat; Tianyu Zhao; Llion Jones (CoRR, 2025)