Representation Learning Using a Single Forward Pass. - Aditya Somasundaram; Pushkal Mishra; Ayon Borthakur (CoRR, 2024)

Learning Using a Single Forward Pass. - Aditya Somasundaram; Pushkal Mishra; Ayon Borthakur (Trans. Mach. Learn. Res., 2025)

Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful. - Martin Marek; Sanae Lotfi; Aditya Somasundaram; Andrew Gordon Wilson; Micah Goldblum (CoRR, 2025)