Survey on Efficient Training of Large Neural Networks. - Julia Gusak; Daria Cherniuk; Alena Shilova; Alexandr Katrutsa; Daniel Bershatsky; Xunyi Zhao; Lionel Eyraud-Dubois; Oleh Shliazhko; Denis Dimitrov; Ivan V. Oseledets; Olivier Beaumont (IJCAI, 2022)

Survey on Large Scale Neural Network Training. - Julia Gusak; Daria Cherniuk; Alena Shilova; Alexandr Katrutsa; Daniel Bershatsky; Xunyi Zhao; Lionel Eyraud-Dubois; Oleg Shlyazhko; Denis Dimitrov; Ivan V. Oseledets; Olivier Beaumont (CoRR, 2022)

Run LoRA Run: Faster and Lighter LoRA Implementations. - Daria Cherniuk; Aleksandr Mikhalev; Ivan V. Oseledets (CoRR, 2023)

Quantization of Large Language Models with an Overdetermined Basis. - Daniil Merkulov; Daria Cherniuk; Alexander Rudikov; Ivan V. Oseledets; Ekaterina A. Muravleva; Aleksandr Mikhalev; Boris Kashin (UAI, 2024)

LoTR: Low Tensor Rank Weight Adaptation. - Daniel Bershatsky; Daria Cherniuk; Talgat Daulbaev; Aleksandr Mikhalev; Ivan V. Oseledets (CoRR, 2024)

Quantization Aware Factorization for Deep Neural Network Compression. - Daria Cherniuk; Stanislav Abukhovich; Anh Huy Phan 001; Ivan V. Oseledets; Andrzej Cichocki; Julia Gusak (J. Artif. Intell. Res., 2024)

Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models. - Viktoriia Chekalina; Daniil Moskovskiy; Daria Cherniuk; Maxim Kurkin; Andrey Kuznetsov; Evgeny Frolov (CoRR, 2025)