Dayal Singh Kalra

According to our database, Dayal Singh Kalra authored at least 6 papers between 2023 and 2025.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2025

When Can You Get Away with Low Memory Adam?

Dayal Singh Kalra, John Kirchenbauer, Maissam Barkeshli, Tom Goldstein

CoRR, March, 2025

(How) Can Transformers Predict Pseudo-Random Numbers?

Tao Tao, Darshil Doshi, Dayal Singh Kalra, Tianyu He, Maissam Barkeshli

CoRR, February, 2025

Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos.

Dayal Singh Kalra, Tianyu He, Maissam Barkeshli

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Why Warmup the Learning Rate? Underlying Mechanisms and Improvements.

Dayal Singh Kalra, Maissam Barkeshli

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

2023

Phase diagram of training dynamics in deep neural networks: effect of learning rate, depth, and width.

Dayal Singh Kalra, Maissam Barkeshli

CoRR, 2023

Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width.

Dayal Singh Kalra, Maissam Barkeshli

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023