Online Normalization for Training Neural Networks. - Vitaliy Chiley; Ilya Sharapov; Atli Kosson; Urs Köster; Ryan Reece; Sofia Samaniego de la Fuente; Vishal Subbiah; Michael James 002 (NeurIPS, 2019)

Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation. - Mihir Pendse; Vithursan Thangarasa; Vitaliy Chiley; Ryan Holmdahl; Joel Hestness; Dennis DeCoste (BrainLes@MICCAI (2), 2020)

Adaptive Braking for Mitigating Gradient Delay. - Abhinav Venigalla; Atli Kosson; Vitaliy Chiley; Urs Köster (CoRR, 2020)

Pipelined Backpropagation at Scale: Training Large Models without Batches. - Atli Kosson; Vitaliy Chiley; Abhinav Venigalla; Joel Hestness; Urs Köster (MLSys, 2021)

RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network. - Vitaliy Chiley; Vithursan Thangarasa; Abhay Gupta; Anshul Samar; Joel Hestness; Dennis DeCoste (MLSys, 2023)

Sparse Upcycling: Inference Inefficient Finetuning. - Sasha Doubov; Nikhil Sardana; Vitaliy Chiley (ENLSP, 2024)

Inference-Friendly Models With MixAttention. - Shashank Rajput; Ying Sheng 007; Sean Owen; Vitaliy Chiley (ENLSP, 2024)

LoRA Learns Less and Forgets Less. - Dan Biderman; Jacob P. Portes; Jose Javier Gonzalez Ortiz; Mansheej Paul; Philip Greengard; Connor Jennings; Daniel King; Sam Havens; Vitaliy Chiley; Jonathan Frankle; Cody Blakeney; John Patrick Cunningham (Trans. Mach. Learn. Res., 2024)