Andrei Panferov

According to our database, Andrei Panferov authored at least 13 papers between 2024 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

Apertus LLM Family Expansion via Distillation and Quantization.

Andrei Panferov, Davit Melikidze, Martin Jaggi, Dan Alistarh

CoRR, May, 2026

Grid Games: The Power of Multiple Grids for Quantizing Large Language Models.

Vage Egiazarian, Erik Schultheis, Andrei Panferov, Earl Killian, Torsten Hoefler, Dan Alistarh

CoRR, May, 2026

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation.

Andrei Panferov, Erik Schultheis, Soroush Tabesh, Dan Alistarh

CoRR, January, 2026

2025

Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization.

Vage Egiazarian, Roberto L. Castro, Denis Kuznedelev, Andrei Panferov, Eldar Kurtic, Shubhra Pandit, Alexandre Noll Marques, Mark Kurtz, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh

CoRR, September, 2025

Quartet: Native FP4 Training Can Be Optimal for Large Language Models.

Roberto L. Castro, Andrei Panferov, Soroush Tabesh, Oliver Sieberling, Jiale Chen, Mahdi Nikdan, Saleh Ashkboos, Dan Alistarh

CoRR, May, 2025

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations.

Andrei Panferov, Jiale Chen, Soroush Tabesh, Roberto L. Castro, Mahdi Nikdan, Dan Alistarh

CoRR, February, 2025

Correlated Quantization for Faster Nonconvex Distributed Optimization.

Andrei Panferov, Yury Demidovich, Ahmad Rammal, Peter Richtárik

Proceedings of the Conference on Uncertainty in Artificial Intelligence, 2025

Unified Scaling Laws for Compressed Representations.

Andrei Panferov, Alexandra Volkova, Ionut-Vlad Modoranu, Vage Egiazarian, Mher Safaryan, Dan Alistarh

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

HIGGS: Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Vladimir Malinovskii, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, 2025

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations.

Andrei Panferov, Jiale Chen, Soroush Tabesh, Mahdi Nikdan, Dan Alistarh

Proceedings of the Forty-second International Conference on Machine Learning, 2025

2024

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Vladimir Malinovskii, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

CoRR, 2024

Panza: A Personalized Text Writing Assistant via Data Playback and Local Fine-Tuning.

Armand Nicolicioiu, Eugenia Iofinova, Eldar Kurtic, Mahdi Nikdan, Andrei Panferov, Ilia Markov, Nir Shavit, Dan Alistarh

CoRR, 2024

Extreme Compression of Large Language Models via Additive Quantization.

Vage Egiazarian, Andrei Panferov, Denis Kuznedelev, Elias Frantar, Artem Babenko, Dan Alistarh

Proceedings of the Forty-first International Conference on Machine Learning, 2024