Ionut-Vlad Modoranu

According to our database, Ionut-Vlad Modoranu authored at least 12 papers between 2021 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning.

Ionut-Vlad Modoranu, Mher Safaryan, Dan Alistarh

CoRR, May, 2026

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication.

Andrej Jovanovic, Alex Iacob, Mher Safaryan, Ionut-Vlad Modoranu, Lorenzo Sani, William F. Shen, Xinchi Qiu, Dan Alistarh, Nicholas D. Lane

CoRR, February, 2026

DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers.

Ionut-Vlad Modoranu, Philip Zmushko, Erik Schultheis, Mher Safaryan, Dan Alistarh

CoRR, February, 2026

2025

Optimizers Qualitatively Alter Solutions And We Should Leverage This.

Razvan Pascanu, Clare Lyle, Ionut-Vlad Modoranu, Naima Elosegui Borras, Dan Alistarh, Petar Velickovic, Sarath Chandar, Soham De, James Martens

CoRR, July, 2025

SVD-Free Low-Rank Adaptive Gradient Optimization for Large Language Models.

Ionut-Vlad Modoranu, Mher Safaryan, Erik Schultheis, Dan Alistarh

CoRR, May, 2025

Unified Scaling Laws for Compressed Representations.

Andrei Panferov, Alexandra Volkova, Ionut-Vlad Modoranu, Vage Egiazarian, Mher Safaryan, Dan Alistarh

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics.

Thomas Robert, Mher Safaryan, Ionut-Vlad Modoranu, Dan Alistarh

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information.

Diyuan Wu, Ionut-Vlad Modoranu, Mher Safaryan, Denis Kuznedelev, Dan Alistarh

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence.

Ionut-Vlad Modoranu, Mher Safaryan, Grigory Malinovsky, Eldar Kurtic, Thomas Robert, Peter Richtárik, Dan Alistarh

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Error Feedback Can Accurately Compress Preconditioners.

Ionut-Vlad Modoranu, Aleksei Kalinov, Eldar Kurtic, Elias Frantar, Dan Alistarh

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Error Feedback Can Accurately Compress Preconditioners.

Ionut-Vlad Modoranu, Aleksei Kalinov, Eldar Kurtic, Dan Alistarh

CoRR, 2023

2021

A Panda? No, It's a Sloth: Slowdown Attacks on Adaptive Multi-Exit Neural Network Inference.

Sanghyun Hong, Yigitcan Kaya, Ionut-Vlad Modoranu, Tudor Dumitras

Proceedings of the 9th International Conference on Learning Representations, 2021