Dayal Singh Kalra

According to our database, Dayal Singh Kalra authored at least 9 papers between 2023 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Quantifying Hyperparameter Transfer and the Importance of Embedding Layer Learning Rate.

Dayal Singh Kalra, Maissam Barkeshli

CoRR, May, 2026

A Scalable Measure of Loss Landscape Curvature for Analyzing the Training Dynamics of LLMs.

Dayal Singh Kalra, Jean-Christophe Gagnon-Audet, Andrey Gromov, Ishita Mediratta, Kelvin Niu, Alexander H. Miller, Michael Shvartsman

CoRR, January, 2026

2025

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence.

Sean McLeish, Ang Li, John Kirchenbauer, Dayal Singh Kalra, Brian R. Bartoldson, Bhavya Kailkhura, Avi Schwarzschild, Jonas Geiping, Tom Goldstein, Micah Goldblum

CoRR, November, 2025

When Can You Get Away with Low Memory Adam?

Dayal Singh Kalra, John Kirchenbauer, Maissam Barkeshli, Tom Goldstein

CoRR, March, 2025

(How) Can Transformers Predict Pseudo-Random Numbers?

Tao Tao, Darshil Doshi, Dayal Singh Kalra, Tianyu He, Maissam Barkeshli

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos.

Dayal Singh Kalra, Tianyu He, Maissam Barkeshli

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Why Warmup the Learning Rate? Underlying Mechanisms and Improvements.

Dayal Singh Kalra, Maissam Barkeshli

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

2023

Phase diagram of training dynamics in deep neural networks: effect of learning rate, depth, and width.

Dayal Singh Kalra, Maissam Barkeshli

CoRR, 2023

Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width.

Dayal Singh Kalra, Maissam Barkeshli

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023