Andrei Panferov

According to our database, Andrei Panferov authored at least 8 papers between 2024 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

Unified Scaling Laws for Compressed Representations.

Andrei Panferov, Alexandra Volkova, Ionut-Vlad Modoranu, Vage Egiazarian, Mher Safaryan, Dan Alistarh

CoRR, June, 2025

Quartet: Native FP4 Training Can Be Optimal for Large Language Models.

Roberto L. Castro, Andrei Panferov, Soroush Tabesh, Oliver Sieberling, Jiale Chen, Mahdi Nikdan, Saleh Ashkboos, Dan Alistarh

CoRR, May, 2025

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations.

Andrei Panferov, Jiale Chen, Soroush Tabesh, Roberto L. Castro, Mahdi Nikdan, Dan Alistarh

CoRR, February, 2025

Correlated Quantization for Faster Nonconvex Distributed Optimization.

Andrei Panferov, Yury Demidovich, Ahmad Rammal, Peter Richtárik

Proceedings of the Conference on Uncertainty in Artificial Intelligence, 2025

HIGGS: Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Vladimir Malinovskii, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies, 2025

2024

Pushing the Limits of Large Language Model Quantization via the Linearity Theorem.

Vladimir Malinovskii, Andrei Panferov, Ivan Ilin, Han Guo, Peter Richtárik, Dan Alistarh

CoRR, 2024

Panza: A Personalized Text Writing Assistant via Data Playback and Local Fine-Tuning.

Armand Nicolicioiu, Eugenia Iofinova, Eldar Kurtic, Mahdi Nikdan, Andrei Panferov, Ilia Markov, Nir Shavit, Dan Alistarh

CoRR, 2024

Extreme Compression of Large Language Models via Additive Quantization.

Vage Egiazarian, Andrei Panferov, Denis Kuznedelev, Elias Frantar, Artem Babenko, Dan Alistarh

Proceedings of the Forty-first International Conference on Machine Learning, 2024