Igor Sokolov

According to our database, Igor Sokolov authored at least 9 papers between 2021 and 2025.

Collaborative distances:

• Dijkstra number of five.
• Erdős number of four.

2025

Bernoulli-LoRA: A Theoretical Framework for Randomized Low-Rank Adaptation.

Igor Sokolov, Abdurakhmon Sadiev, Yury Demidovich, Fawaz S. Al-Qahtani, Peter Richtárik

CoRR, August, 2025

2024

MARINA-P: Superior Performance in Non-smooth Federated Optimization with Adaptive Stepsizes.

Igor Sokolov, Peter Richtárik

CoRR, 2024

Cohort Squeeze: Beyond a Single Communication Round per Cohort in Cross-Device Federated Learning.

Kai Yi, Timur Kharisov, Igor Sokolov, Peter Richtárik

CoRR, 2024

Don't Compress Gradients in Random Reshuffling: Compress Gradient Differences.

Abdurakhmon Sadiev, Grigory Malinovsky, Eduard Gorbunov, Igor Sokolov, Ahmed Khaled, Konstantin Burlachenko, Peter Richtárik

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

2023

A Guide Through the Zoo of Biased SGD.

Yury Demidovich, Grigory Malinovsky, Igor Sokolov, Peter Richtárik

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

Federated Optimization Algorithms with Random Reshuffling and Gradient Compression.

Abdurakhmon Sadiev, Grigory Malinovsky, Eduard Gorbunov, Igor Sokolov, Ahmed Khaled, Konstantin Burlachenko, Peter Richtárik

CoRR, 2022

3PC: Three Point Compressors for Communication-Efficient Distributed Training and a Better Theory for Lazy Aggregation.

Peter Richtárik, Igor Sokolov, Elnur Gasanov, Ilyas Fatkhullin, Zhize Li, Eduard Gorbunov

Proceedings of the International Conference on Machine Learning, 2022

2021

EF21 with Bells & Whistles: Practical Algorithmic Extensions of Modern Error Feedback.

Ilyas Fatkhullin, Igor Sokolov, Eduard Gorbunov, Zhize Li, Peter Richtárik

CoRR, 2021

EF21: A New, Simpler, Theoretically Better, and Practically Faster Error Feedback.

Peter Richtárik, Igor Sokolov, Ilyas Fatkhullin

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021