Dani Yogatama

According to our database, Dani Yogatama authored at least 58 papers between 2009 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2024

Understanding In-Context Learning with a Pelican Soup Framework.

Ting-Rui Chiang, Dani Yogatama

CoRR, 2024

DeLLMa: A Framework for Decision Making Under Uncertainty with Large Language Models.

Ollie Liu, Deqing Fu, Dani Yogatama, Willie Neiswanger

CoRR, 2024

2023

On Retrieval Augmentation and the Limitations of Language Model Training.

Ting-Rui Chiang, Xinyan Velocity Yu, Joshua Robinson, Ollie Liu, Isabelle Lee, Dani Yogatama

CoRR, 2023

Interpretable Diffusion via Information Decomposition.

Xianghao Kong, Ollie Liu, Han Li, Dani Yogatama, Greg Ver Steeg

CoRR, 2023

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?

Yi Tay, Mostafa Dehghani, Samira Abnar, Hyung Won Chung, William Fedus, Jinfeng Rao, Sharan Narang, Vinh Q. Tran, Dani Yogatama, Donald Metzler

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

The Distributional Hypothesis Does Not Fully Explain the Benefits of Masked Language Model Pretraining.

Ting-Rui Chiang, Dani Yogatama

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

Emergent Abilities of Large Language Models.

Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, William Fedus

Trans. Mach. Learn. Res., 2022

Relational Memory-Augmented Language Models.

Qi Liu, Dani Yogatama, Phil Blunsom

Trans. Assoc. Comput. Linguistics, 2022

Questions Are All You Need to Train a Dense Passage Retriever.

Devendra Singh Sachan, Mike Lewis, Dani Yogatama, Luke Zettlemoyer, Joelle Pineau, Manzil Zaheer

CoRR, 2022

Language Models Can See: Plugging Visual Controls in Text Generation.

Yixuan Su, Tian Lan, Yahui Liu, Fangyu Liu, Dani Yogatama, Yan Wang, Lingpeng Kong, Nigel Collier

CoRR, 2022

HighMMT: Towards Modality and Task Generalization for High-Modality Representation Learning.

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Shentong Mo, Dani Yogatama, Louis-Philippe Morency, Ruslan Salakhutdinov

CoRR, 2022

A Contrastive Framework for Neural Text Generation.

Yixuan Su, Tian Lan, Yan Wang, Dani Yogatama, Lingpeng Kong, Nigel Collier

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Scale Efficiently: Insights from Pretraining and Finetuning Transformers.

Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler

Proceedings of the Tenth International Conference on Learning Representations, 2022

ABC: Attention with Bounded-memory Control.

Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, Noah A. Smith

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2022

2021

Adaptive Semiparametric Language Models.

Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong

Trans. Assoc. Comput. Linguistics, 2021

Balancing Average and Worst-case Accuracy in Multitask Learning.

Paul Michel, Sebastian Ruder, Dani Yogatama

CoRR, 2021

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers.

Yi Tay, Mostafa Dehghani, Jinfeng Rao, William Fedus, Samira Abnar, Hyung Won Chung, Sharan Narang, Dani Yogatama, Ashish Vaswani, Donald Metzler

CoRR, 2021

Pitfalls of Static Language Modelling.

Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomás Kociský, Susannah Young, Phil Blunsom

CoRR, 2021

End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering.

Devendra Singh Sachan, Siva Reddy, William L. Hamilton, Chris Dyer, Dani Yogatama

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

Mind the Gap: Assessing Temporal Generalization in Neural Language Models.

Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Tomás Kociský, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, Phil Blunsom

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

LiRo: Benchmark and leaderboard for Romanian language tasks.

Stefan Daniel Dumitrescu, Petru Rebeja, Beáta Lorincz, Mihaela Gaman, Andrei-Marius Avram, Mihai Ilie, Andrei Pruteanu, Adriana Stan, Lorena Rosia, Cristina Iacobescu, Luciana Morogan, George Dima, Gabriel Marchidan, Traian Rebedea, Madalina Chitez, Dani Yogatama, Sebastian Ruder, Radu Tudor Ionescu, Razvan Pascanu, Viorica Patraucean

Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks 1, 2021

Random Feature Attention.

Hao Peng, Nikolaos Pappas, Dani Yogatama, Roy Schwartz, Noah A. Smith, Lingpeng Kong

Proceedings of the 9th International Conference on Learning Representations, 2021

Finetuning Pretrained Transformers into RNNs.

Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, Noah A. Smith

Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, 2021

2020

Syntactic Structure Distillation Pretraining for Bidirectional Encoders.

Adhiguna Kuncoro, Lingpeng Kong, Daniel Fried, Dani Yogatama, Laura Rimell, Chris Dyer, Phil Blunsom

Trans. Assoc. Comput. Linguistics, 2020

Modelling Latent Skills for Multitask Language Generation.

Kris Cao, Dani Yogatama

CoRR, 2020

A Mutual Information Maximization Perspective of Language Representation Learning.

Lingpeng Kong, Cyprien de Masson d'Autume, Lei Yu, Wang Ling, Zihang Dai, Dani Yogatama

Proceedings of the 8th International Conference on Learning Representations, 2020

Reducing Sentiment Bias in Language Models via Counterfactual Evaluation.

Po-Sen Huang, Huan Zhang, Ray Jiang, Robert Stanforth, Johannes Welbl, Jack Rae, Vishal Maini, Dani Yogatama, Pushmeet Kohli

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2020, 2020

A Call for More Rigor in Unsupervised Cross-lingual Learning.

Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

On the Cross-lingual Transferability of Monolingual Representations.

Mikel Artetxe, Sebastian Ruder, Dani Yogatama

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

2019

Jointly learning sentence embeddings and syntax with unsupervised Tree-LSTMs.

Jean Maillard, Stephen Clark, Dani Yogatama

Nat. Lang. Eng., 2019

Grandmaster level in StarCraft II using multi-agent reinforcement learning.

Oriol Vinyals, Igor Babuschkin, Wojciech M. Czarnecki, Michaël Mathieu, Andrew Dudzik, Junyoung Chung, David H. Choi, Richard Powell, Timo Ewalds, Petko Georgiev, Junhyuk Oh, Dan Horgan, Manuel Kroiss, Ivo Danihelka, Aja Huang, Laurent Sifre, Trevor Cai, John P. Agapiou, Max Jaderberg, Alexander Sasha Vezhnevets, Rémi Leblond, Tobias Pohlen, Valentin Dalibard, David Budden, Yury Sulsky, James Molloy, Tom Le Paine, Çaglar Gülçehre, Ziyu Wang, Tobias Pfaff, Yuhuai Wu, Roman Ring, Dani Yogatama, Dario Wünsch, Katrina McKinney, Oliver Smith, Tom Schaul, Timothy P. Lillicrap, Koray Kavukcuoglu, Demis Hassabis, Chris Apps, David Silver

Nat., 2019

Learning and Evaluating General Linguistic Intelligence.

Dani Yogatama, Cyprien de Masson d'Autume, Jerome T. Connor, Tomás Kociský, Mike Chrzanowski, Lingpeng Kong, Angeliki Lazaridou, Wang Ling, Lei Yu, Chris Dyer, Phil Blunsom

CoRR, 2019

Episodic Memory in Lifelong Language Learning.

Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama

Proceedings of the Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, 2019

Variational Smoothing in Recurrent Neural Network Language Models.

Lingpeng Kong, Gábor Melis, Wang Ling, Lei Yu, Dani Yogatama

Proceedings of the 7th International Conference on Learning Representations, 2019

Achieving Verified Robustness to Symbol Substitutions via Interval Bound Propagation.

Po-Sen Huang, Robert Stanforth, Johannes Welbl, Chris Dyer, Dani Yogatama, Sven Gowal, Krishnamurthy Dvijotham, Pushmeet Kohli

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, 2019

2018

Memory Architectures in Recurrent Neural Network Language Models.

Dani Yogatama, Yishu Miao, Gábor Melis, Wang Ling, Adhiguna Kuncoro, Chris Dyer, Phil Blunsom

Proceedings of the 6th International Conference on Learning Representations, 2018

LSTMs Can Learn Syntax-Sensitive Dependencies Well, But Modeling Structure Makes Them Better.

Adhiguna Kuncoro, Chris Dyer, John Hale, Dani Yogatama, Stephen Clark, Phil Blunsom

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

2017

Generative and Discriminative Text Classification with Recurrent Neural Networks.

Dani Yogatama, Chris Dyer, Wang Ling, Phil Blunsom

CoRR, 2017

Learning to Compose Words into Sentences with Reinforcement Learning.

Dani Yogatama, Phil Blunsom, Chris Dyer, Edward Grefenstette, Wang Ling

Proceedings of the 5th International Conference on Learning Representations, 2017

Program Induction by Rationale Generation: Learning to Solve and Explain Algebraic Word Problems.

Wang Ling, Dani Yogatama, Chris Dyer, Phil Blunsom

Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, 2017

2016

Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin.

Dario Amodei, Sundaram Ananthanarayanan, Rishita Anubhai, Jingliang Bai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Awni Y. Hannun, Billy Jun, Tony Han, Patrick LeGresley, Xiangang Li, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Sheng Qian, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Chong Wang, Yi Wang, Zhiqian Wang, Bo Xiao, Yan Xie, Dani Yogatama, Jun Zhan, Zhenyao Zhu

Proceedings of the 33nd International Conference on Machine Learning, 2016

2015

Bayesian Optimization of Text Representations.

Dani Yogatama, Noah A. Smith

CoRR, 2015

Deep Speech 2: End-to-End Speech Recognition in English and Mandarin.

Dario Amodei, Rishita Anubhai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Jingdong Chen, Mike Chrzanowski, Adam Coates, Greg Diamos, Erich Elsen, Jesse H. Engel, Linxi Fan, Christopher Fougner, Tony Han, Awni Y. Hannun, Billy Jun, Patrick LeGresley, Libby Lin, Sharan Narang, Andrew Y. Ng, Sherjil Ozair, Ryan Prenger, Jonathan Raiman, Sanjeev Satheesh, David Seetapun, Shubho Sengupta, Yi Wang, Zhiqian Wang, Chong Wang, Bo Xiao, Dani Yogatama, Jun Zhan, Zhenyao Zhu

CoRR, 2015

Learning Word Representations with Hierarchical Sparse Coding.

Dani Yogatama, Manaal Faruqui, Chris Dyer, Noah A. Smith

Proceedings of the 32nd International Conference on Machine Learning, 2015

Bayesian Optimization of Text Representations.

Dani Yogatama, Lingpeng Kong, Noah A. Smith

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

Extractive Summarization by Maximizing Semantic Volume.

Dani Yogatama, Fei Liu, Noah A. Smith

Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, 2015

Embedding Methods for Fine Grained Entity Type Classification.

Dani Yogatama, Daniel Gillick, Nevena Lazic

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

Sparse Overcomplete Word Vector Representations.

Manaal Faruqui, Yulia Tsvetkov, Dani Yogatama, Chris Dyer, Noah A. Smith

Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing, 2015

2014

Dynamic Language Models for Streaming Text.

Dani Yogatama, Chong Wang, Bryan R. Routledge, Noah A. Smith, Eric P. Xing

Trans. Assoc. Comput. Linguistics, 2014

Making the Most of Bag of Words: Sentence Regularization with Alternating Direction Method of Multipliers.

Dani Yogatama, Noah A. Smith

Proceedings of the 31th International Conference on Machine Learning, 2014

Efficient Transfer Learning Method for Automatic Hyperparameter Tuning.

Dani Yogatama, Gideon Mann

Proceedings of the Seventeenth International Conference on Artificial Intelligence and Statistics, 2014

Linguistic Structured Sparsity in Text Categorization.

Dani Yogatama, Noah A. Smith

Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics, 2014

2013

A Sparse and Adaptive Prior for Time-Dependent Model Parameters.

Dani Yogatama, Bryan R. Routledge, Noah A. Smith

CoRR, 2013

A Penny for Your Tweets: Campaign Contributions and Capitol Hill Microblogs.

Tae Yano, Dani Yogatama, Noah A. Smith

Proceedings of the Seventh International Conference on Weblogs and Social Media, 2013

2012

A Probabilistic Model for Canonicalizing Named Entity Mentions.

Dani Yogatama, Yanchuan Sim, Noah A. Smith

Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea, 2012

2011

Predicting a Scientific Community's Response to an Article.

Dani Yogatama, Michael Heilman, Brendan O'Connor, Chris Dyer, Bryan R. Routledge, Noah A. Smith

Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing, 2011

Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments.

Kevin Gimpel, Nathan Schneider, Brendan O'Connor, Dipanjan Das, Daniel Mills, Jacob Eisenstein, Michael Heilman, Dani Yogatama, Jeffrey Flanigan, Noah A. Smith

Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19-24 June, 2011, Portland, Oregon, USA, 2011

2009

Multilingual Spectral Clustering Using Document Similarity Propagation.

Dani Yogatama, Kumiko Tanaka-Ishii

Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, 2009