Ivan Ilin

According to our database, Ivan Ilin authored at least 7 papers between 2023 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Thanos: A Block-wise Pruning Algorithm for Efficient Large Language Model Compression.

Ivan Ilin, Peter Richtárik

CoRR, April, 2025

Hessian of Perplexity for Large Language Models by PyTorch autograd (Open Source).

Ivan Ilin

CoRR, April, 2025

HIGGS: Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Vladimir Malinovskii, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, 2025

2024

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Vladimir Malinovskii, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

CoRR, 2024

Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity.

Alexander Tyurin, Marta Pozzi, Ivan Ilin, Peter Richtárik

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression.

Vladimir Malinovskii, Denis Mazur, Ivan Ilin, Denis Kuznedelev, Konstantin Burlachenko, Kai Yi, Dan Alistarh, Peter Richtárik

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

2023

Kimad: Adaptive Gradient Compression with Bandwidth Awareness.

Jihao Xin, Ivan Ilin, Shunkang Zhang, Marco Canini, Peter Richtárik

Proceedings of the 4th International Workshop on Distributed Machine Learning, 2023