Survey on Large Scale Neural Network Training. - Julia Gusak; Daria Cherniuk; Alena Shilova; Alexandr Katrutsa; Daniel Bershatsky; Xunyi Zhao; Lionel Eyraud-Dubois; Oleg Shlyazhko; Denis Dimitrov; Ivan V. Oseledets; Olivier Beaumont (CoRR, 2022)