Guy Gur-Ari

According to our database, Guy Gur-Ari authored at least 13 papers between 2018 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Towards Understanding Inductive Bias in Transformers: A View From Infinity.

Itay Lavie, Guy Gur-Ari, Zohar Ringel

CoRR, 2024

2023

PaLM: Scaling Language Modeling with Pathways.

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vinodkumar Prabhakaran, Emily Reif, Nan Du, Ben Hutchinson, Reiner Pope, James Bradbury, Jacob Austin, Michael Isard, Guy Gur-Ari, Pengcheng Yin, Toju Duke, Anselm Levskaya, Sanjay Ghemawat, Sunipa Dev, Henryk Michalewski, Xavier Garcia, Vedant Misra, Kevin Robinson, Liam Fedus, Denny Zhou, Daphne Ippolito, David Luan, Hyeontaek Lim, Barret Zoph, Alexander Spiridonov, Ryan Sepassi, David Dohan, Shivani Agrawal, Mark Omernick, Andrew M. Dai, Thanumalayan Sankaranarayana Pillai, Marie Pellat, Aitor Lewkowycz, Erica Moreira, Rewon Child, Oleksandr Polozov, Katherine Lee, Zongwei Zhou, Xuezhi Wang, Brennan Saeta, Mark Diaz, Orhan Firat, Michele Catasta, Jason Wei, Kathy Meier-Hellstern, Douglas Eck, Jeff Dean, Slav Petrov, Noah Fiedel

J. Mach. Learn. Res., 2023

2022

Solving Quantitative Reasoning Problems with Language Models.

Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay V. Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Exploring Length Generalization in Large Language Models.

Cem Anil, Yuhuai Wu, Anders Andreassen, Aitor Lewkowycz, Vedant Misra, Vinay V. Ramasesh, Ambrose Slone, Guy Gur-Ari, Ethan Dyer, Behnam Neyshabur

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

2021

Show Your Work: Scratchpads for Intermediate Computation with Language Models.

Maxwell I. Nye, Anders Johan Andreassen, Guy Gur-Ari, Henryk Michalewski, Jacob Austin, David Bieber, David Dohan, Aitor Lewkowycz, Maarten Bosma, David Luan, Charles Sutton, Augustus Odena

CoRR, 2021

Are wider nets better given the same number of parameters?

Anna Golubeva, Guy Gur-Ari, Behnam Neyshabur

Proceedings of the 9th International Conference on Learning Representations, 2021

2020

On the training dynamics of deep networks with L₂ regularization.

Aitor Lewkowycz, Guy Gur-Ari

CoRR, 2020

On the asymptotics of wide networks with polynomial activations.

Kyle Aitken, Guy Gur-Ari

CoRR, 2020

The large learning rate phase of deep learning: the catapult mechanism.

Aitor Lewkowycz, Yasaman Bahri, Ethan Dyer, Jascha Sohl-Dickstein, Guy Gur-Ari

CoRR, 2020

On the training dynamics of deep networks with $L_2$ regularization.

Aitor Lewkowycz, Guy Gur-Ari

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020

Asymptotics of Wide Networks from Feynman Diagrams.

Ethan Dyer, Guy Gur-Ari

Proceedings of the 8th International Conference on Learning Representations, 2020

2019

Wider Networks Learn Better Features.

Dar Gilboa, Guy Gur-Ari

CoRR, 2019

2018

Gradient Descent Happens in a Tiny Subspace.

Guy Gur-Ari, Daniel A. Roberts, Ethan Dyer

CoRR, 2018