Learning@home: Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts. - Maksim Riabinin; Anton Gusev (CoRR, 2020)

Petals: Collaborative Inference and Fine-tuning of Large Models. - Alexander Borzunov; Dmitry Baranchuk; Tim Dettmers; Maksim Riabinin; Younes Belkada; Artem Chumachenko; Pavel Samygin; Colin Raffel (ACL (demo), 2023)