Adhiguna Kuncoro

According to our database, Adhiguna Kuncoro authored at least 23 papers between 2016 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DiPaCo: Distributed Path Composition.

Arthur Douillard, Qixuan Feng, Andrei A. Rusu, Adhiguna Kuncoro, Yani Donchev, Rachita Chhaparia, Ionel Gog, Marc'Aurelio Ranzato, Jiajun Shen, Arthur Szlam

CoRR, 2024

2023

DiLoCo: Distributed Low-Communication Training of Language Models.

Arthur Douillard, Qixuang Feng, Andrei A. Rusu, Rachita Chhaparia, Yani Donchev, Adhiguna Kuncoro, Marc'Aurelio Ranzato, Arthur Szlam, Jiajun Shen

CoRR, 2023

On "Scientific Debt" in NLP: A Case for More Rigour in Language Model Pre-Training Research.

Made Nindyatama Nityasya, Haryo Akbarianto Wibowo, Alham Fikri Aji, Genta Indra Winata, Radityo Eko Prasojo, Phil Blunsom, Adhiguna Kuncoro

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

A Natural Bias for Language Generation Models.

Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

2022

Transformer Grammars: Augmenting Transformer Language Models with Syntactic Inductive Biases at Scale.

Laurent Sartran, Samuel Barrett, Adhiguna Kuncoro, Milos Stanojevic, Phil Blunsom, Chris Dyer

Trans. Assoc. Comput. Linguistics, 2022

A Systematic Investigation of Commonsense Knowledge in Large Language Models.

Xiang Lorraine Li, Adhiguna Kuncoro, Jordan Hoffmann, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Scaling Language Models: Methods, Analysis & Insights from Training Gopher.

Jack W. Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, H. Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, Eliza Rutherford, Tom Hennigan, Jacob Menick, Albin Cassirer, Richard Powell, George van den Driessche, Lisa Anne Hendricks, Maribeth Rauh, Po-Sen Huang, Amelia Glaese, Johannes Welbl, Sumanth Dathathri, Saffron Huang, Jonathan Uesato, John Mellor, Irina Higgins, Antonia Creswell, Nat McAleese, Amy Wu, Erich Elsen, Siddhant M. Jayakumar, Elena Buchatskaya, David Budden, Esme Sutherland, Karen Simonyan, Michela Paganini, Laurent Sifre, Lena Martens, Xiang Lorraine Li, Adhiguna Kuncoro, Aida Nematzadeh, Elena Gribovskaya, Domenic Donato, Angeliki Lazaridou, Arthur Mensch, Jean-Baptiste Lespiau, Maria Tsimpoukelli, Nikolai Grigorev, Doug Fritz, Thibault Sottiaux, Mantas Pajarskas, Toby Pohlen, Zhitao Gong, Daniel Toyama, Cyprien de Masson d'Autume, Yujia Li, Tayfun Terzi, Vladimir Mikulik, Igor Babuschkin, Aidan Clark, Diego de Las Casas, Aurelia Guy, Chris Jones, James Bradbury, Matthew J. Johnson, Blake A. Hechtman, Laura Weidinger, Iason Gabriel, William Isaac, Edward Lockhart, Simon Osindero, Laura Rimell, Chris Dyer, Oriol Vinyals, Kareem Ayoub, Jeff Stanway, Lorrayne Bennett, Demis Hassabis, Koray Kavukcuoglu, Geoffrey Irving

CoRR, 2021

A Systematic Investigation of Commonsense Understanding in Large Language Models.

Xiang Lorraine Li, Adhiguna Kuncoro, Cyprien de Masson d'Autume, Phil Blunsom, Aida Nematzadeh

CoRR, 2021

Pitfalls of Static Language Modelling.

Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomás Kociský, Susannah Young, Phil Blunsom

CoRR, 2021

Mind the Gap: Assessing Temporal Generalization in Neural Language Models.

Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Tomás Kociský, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, Phil Blunsom

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation.

Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

2020

Syntactic Structure Distillation Pretraining for Bidirectional Encoders.

Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom

Trans. Assoc. Comput. Linguistics, 2020

2019

Unsupervised Recurrent Neural Network Grammars.

Yoon Kim, Alexander M. Rush, Lei Yu, Adhiguna Kuncoro, Chris Dyer, Gábor Melis

Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2019

Text Genre and Training Data Size in Human-like Parsing.

John T. Hale, Adhiguna Kuncoro, Keith Hall, Chris Dyer, Jonathan Brennan

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

Scalable Syntax-Aware Language Models Using Knowledge Distillation.

Adhiguna Kuncoro, Chris Dyer, Laura Rimell, Stephen Clark, Phil Blunsom

Proceedings of the 57th Conference of the Association for Computational Linguistics, 2019

2018

Memory Architectures in Recurrent Neural Network Language Models.

Dani Yogatama, Yishu Miao, Gábor Melis, Wang Ling, Adhiguna Kuncoro, Chris Dyer, Phil Blunsom

Proceedings of the 6th International Conference on Learning Representations, 2018

Finding syntax in human encephalography with beam search.

John T. Hale, Chris Dyer, Adhiguna Kuncoro, Jonathan Brennan

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better.

Adhiguna Kuncoro, Chris Dyer, John Hale, Dani Yogatama, Stephen Clark, Phil Blunsom

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

DyNet: The Dynamic Neural Network Toolkit.

Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews, Waleed Ammar, Antonios Anastasopoulos, Miguel Ballesteros, David Chiang, Daniel Clothiaux, Trevor Cohn, Kevin Duh, Manaal Faruqui, Cynthia Gan, Dan Garrette, Yangfeng Ji, Lingpeng Kong, Adhiguna Kuncoro, Gaurav Kumar, Chaitanya Malaviya, Paul Michel, Yusuke Oda, Matthew Richardson, Naomi Saphra, Swabha Swayamdipta, Pengcheng Yin

CoRR, 2017

What Do Recurrent Neural Network Grammars Learn About Syntax?

Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Graham Neubig, Noah A. Smith

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics, 2017

2016

Dependency Parsing with LSTMs: An Empirical Evaluation.

Adhiguna Kuncoro, Yuichiro Sawai, Kevin Duh, Yuji Matsumoto

CoRR, 2016

Recurrent Neural Network Grammars.

Chris Dyer, Adhiguna Kuncoro, Miguel Ballesteros, Noah A. Smith

Proceedings of the NAACL HLT 2016, 2016

Distilling an Ensemble of Greedy Dependency Parsers into One MST Parser.

Adhiguna Kuncoro, Miguel Ballesteros, Lingpeng Kong, Chris Dyer, Noah A. Smith

Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 2016