Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser. - Adhiguna Kuncoro; Miguel Ballesteros; Lingpeng Kong; Chris Dyer; Noah A. Smith (EMNLP, 2016)

Recurrent Neural Network Grammars. - Chris Dyer; Adhiguna Kuncoro; Miguel Ballesteros; Noah A. Smith (HLT-NAACL, 2016)

Dependency Parsing with LSTMs: An Empirical Evaluation. - Adhiguna Kuncoro; Yuichiro Sawai; Kevin Duh; Yuji Matsumoto 001 (CoRR, 2016)

What Do Recurrent Neural Network Grammars Learn About Syntax? - Adhiguna Kuncoro; Miguel Ballesteros; Lingpeng Kong; Chris Dyer; Graham Neubig; Noah A. Smith (EACL (1), 2017)

DyNet: The Dynamic Neural Network Toolkit. - Graham Neubig; Chris Dyer; Yoav Goldberg; Austin Matthews; Waleed Ammar; Antonios Anastasopoulos; Miguel Ballesteros; David Chiang 001; Daniel Clothiaux; Trevor Cohn; Kevin Duh; Manaal Faruqui; et al. (CoRR, 2017)

LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better. - Adhiguna Kuncoro; Chris Dyer; John Hale; Dani Yogatama; Stephen Clark; Phil Blunsom (ACL (1), 2018)

Finding syntax in human encephalography with beam search. - John T. Hale; Chris Dyer; Adhiguna Kuncoro; Jonathan Brennan (ACL (1), 2018)

Memory Architectures in Recurrent Neural Network Language Models. - Dani Yogatama; Yishu Miao; Gábor Melis; Wang Ling; Adhiguna Kuncoro; Chris Dyer; Phil Blunsom (ICLR (Poster), 2018)

Scalable Syntax-Aware Language Models Using Knowledge Distillation. - Adhiguna Kuncoro; Chris Dyer; Laura Rimell; Stephen Clark; Phil Blunsom (ACL (1), 2019)

Text Genre and Training Data Size in Human-like Parsing. - John T. Hale; Adhiguna Kuncoro; Keith Hall; Chris Dyer; Jonathan Brennan (EMNLP/IJCNLP (1), 2019)

Unsupervised Recurrent Neural Network Grammars. - Yoon Kim; Alexander M. Rush; Lei Yu 008; Adhiguna Kuncoro; Chris Dyer; Gábor Melis (NAACL-HLT (1), 2019)

Syntactic Structure Distillation Pretraining for Bidirectional Encoders. - Adhiguna Kuncoro; Lingpeng Kong; Daniel Fried; Dani Yogatama; Laura Rimell; Chris Dyer; Phil Blunsom (Trans. Assoc. Comput. Linguistics, 2020)

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. - Samuel Cahyawijaya; Genta Indra Winata; Bryan Wilie; Karissa Vincentio; Xiaohong Li; Adhiguna Kuncoro; Sebastian Ruder; Zhi Yuan Lim; Syafri Bahar; Masayu Leylia Khodra; Ayu Purwarianti; Pascale Fung (EMNLP (1), 2021)

Mind the Gap: Assessing Temporal Generalization in Neural Language Models. - Angeliki Lazaridou; Adhiguna Kuncoro; Elena Gribovskaya; Devang Agrawal; Adam Liska; Tayfun Terzi; Mai Gimenez; Cyprien de Masson d'Autume; Tomás Kociský; Sebastian Ruder; Dani Yogatama; Kris Cao; et al. (NeurIPS, 2021)

Pitfalls of Static Language Modelling. - Angeliki Lazaridou; Adhiguna Kuncoro; Elena Gribovskaya; Devang Agrawal; Adam Liska; Tayfun Terzi; Mai Gimenez; Cyprien de Masson d'Autume; Sebastian Ruder; Dani Yogatama; Kris Cao; Tomás Kociský; et al. (CoRR, 2021)

A Systematic Investigation of Commonsense Understanding in Large Language Models. - Xiang Lorraine Li; Adhiguna Kuncoro; Cyprien de Masson d'Autume; Phil Blunsom; Aida Nematzadeh (CoRR, 2021)

Scaling Language Models: Methods, Analysis & Insights from Training Gopher. - Jack W. Rae; Sebastian Borgeaud; Trevor Cai; Katie Millican; Jordan Hoffmann; H. Francis Song; John Aslanides; Sarah Henderson; Roman Ring; Susannah Young; Eliza Rutherford; Tom Hennigan; et al. (CoRR, 2021)

A Systematic Investigation of Commonsense Knowledge in Large Language Models. - Xiang Lorraine Li; Adhiguna Kuncoro; Jordan Hoffmann; Cyprien de Masson d'Autume; Phil Blunsom; Aida Nematzadeh (EMNLP, 2022)

Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale. - Laurent Sartran; Samuel Barrett; Adhiguna Kuncoro; Milos Stanojevic; Phil Blunsom; Chris Dyer (Trans. Assoc. Comput. Linguistics, 2022)

A Natural Bias for Language Generation Models. - Clara Meister; Wojciech Stokowiec; Tiago Pimentel; Lei Yu 008; Laura Rimell; Adhiguna Kuncoro (ACL (2), 2023)

On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research. - Made Nindyatama Nityasya; Haryo Akbarianto Wibowo; Alham Fikri Aji; Genta Indra Winata; Radityo Eko Prasojo; Phil Blunsom; Adhiguna Kuncoro (ACL (1), 2023)

DiLoCo: Distributed Low-Communication Training of Language Models. - Arthur Douillard; Qixuang Feng; Andrei A. Rusu; Rachita Chhaparia; Yani Donchev; Adhiguna Kuncoro; Marc'Aurelio Ranzato; Arthur Szlam; Jiajun Shen (CoRR, 2023)

DiPaCo: Distributed Path Composition. - Arthur Douillard; Qixuan Feng; Andrei A. Rusu; Adhiguna Kuncoro; Yani Donchev; Rachita Chhaparia; Ionel Gog; Marc'Aurelio Ranzato; Jiajun Shen; Arthur Szlam (CoRR, 2024)