MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence. - Ionut-Vlad Modoranu; Mher Safaryan; Grigory Malinovsky; Eldar Kurtic; Thomas Robert 007; Peter Richtárik; Dan Alistarh (NeurIPS, 2024)

LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics. - Thomas Robert 007; Mher Safaryan; Ionut-Vlad Modoranu; Dan Alistarh (ICLR, 2025)