Andrey Gromov

According to our database, Andrey Gromov authored at least 20 papers between 2014 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Learning Rate Transfer in Normalized Transformers.

Boris Shigida, Boris Hanin, Andrey Gromov

CoRR, April, 2026

MobileLLM-Flash: Latency-Guided On-Device LLM Design for Industry Scale Deployment.

Hanxian Huang, Igor Fedorov, Andrey Gromov, Bernard Beckerman, Naveen Suda, David Eriksson, Maximilian Balandat, Rylan Conway, Patrick Huber, Chinnadhurai Sankar, Ayushi Dalmia, Zechun Liu, Lemeng Wu, Tarek Elgamal, Adithya Sagar, Vikas Chandra, Raghuraman Krishnamoorthi

CoRR, March, 2026

A Scalable Measure of Loss Landscape Curvature for Analyzing the Training Dynamics of LLMs.

Dayal Singh Kalra, Jean-Christophe Gagnon-Audet, Andrey Gromov, Ishita Mediratta, Kelvin Niu, Alexander H. Miller, Michael Shvartsman

CoRR, January, 2026

On the origin of neural scaling laws: from random graphs to natural language.

Maissam Barkeshli, Alberto Alfarano, Andrey Gromov

CoRR, January, 2026

2025

Towards Distributed Neural Architectures.

Aditya Cowsik, Tianyu He, Andrey Gromov

CoRR, June, 2025

Spectral Journey: How Transformers Predict the Shortest Path.

Andrew Cohen, Andrey Gromov, Kaiyu Yang, Yuandong Tian

CoRR, February, 2025

PARQ: Piecewise-Affine Regularized Quantization.

Lisa Jin, Jianhao Ma, Zechun Liu, Andrey Gromov, Aaron Defazio, Lin Xiao

Proceedings of the Forty-second International Conference on Machine Learning, 2025

The Unreasonable Ineffectiveness of the Deeper Layers.

Andrey Gromov, Kushal Tirumala, Hassan Shapourian, Paolo Glorioso, Daniel A. Roberts

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations.

Rylan Schaeffer, Victor Lecomte, Dhruv Bhandarkar Pai, Andres Carranza, Berivan Isik, Alyssa Unell, Mikail Khona, Thomas E. Yerxa, Yann LeCun, SueYeon Chung, Andrey Gromov, Ravid Shwartz-Ziv, Sanmi Koyejo

CoRR, 2024

Grokking Modular Polynomials.

Darshil Doshi, Tianyu He, Aritra Das, Andrey Gromov

CoRR, 2024

Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data.

Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Henry Sleight, John Hughes, Tomasz Korbak, Rajashree Agrawal, Dhruv Pai, Andrey Gromov, Daniel A. Roberts, Diyi Yang, David L. Donoho, Sanmi Koyejo

CoRR, 2024

Bridging Associative Memory and Probabilistic Modeling.

Rylan Schaeffer, Nika Zahedi, Mikail Khona, Dhruv Pai, Sang T. Truong, Yilun Du, Mitchell Ostrow, Sarthak Chandra, Andres Carranza, Ila Rani Fiete, Andrey Gromov, Sanmi Koyejo

CoRR, 2024

Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks.

Tianyu He, Darshil Doshi, Aritra Das, Andrey Gromov

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

To Grok or not to Grok: Disentangling Generalization and Memorization on Corrupted Algorithmic Datasets.

Darshil Doshi, Aritra Das, Tianyu He, Andrey Gromov

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Deconstructing the generalization gap.

Andrey Gromov

Nat. Mac. Intell., December, 2023

Grokking modular arithmetic.

Andrey Gromov

CoRR, 2023

Critical Initialization of Wide and Deep Neural Networks using Partial Jacobians: General Theory and Applications.

Darshil Doshi, Tianyu He, Andrey Gromov

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

AutoInit: Automatic Initialization via Jacobian Tuning.

Tianyu He, Darshil Doshi, Andrey Gromov

CoRR, 2022

2021

Critical initialization of wide and deep neural networks through partial Jacobians: general theory and applications to LayerNorm.

Darshil Doshi, Tianyu He, Andrey Gromov

CoRR, 2021

2014

The Concept of Automation in Conventional Systems Creation Applied to the Preliminary Aircraft Design.

Nikolay Borgest, Maksim Korovin, Andrey Gromov, Aleksey Gromov

Proceedings of the Soft Computing in Computer and Information Science, 2014