Scalable One-Pass Optimisation of High-Dimensional Weight-Update Hyperparameters by Implicit Differentiation. - Ross M. Clarke; Elre Talea Oldewage; José Miguel Hernández-Lobato (ICLR, 2022)

Adam through a Second-Order Lens. - Ross M. Clarke; Baiyu Su; José Miguel Hernández-Lobato (CoRR, 2023)

Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens. - Ross M. Clarke; José Miguel Hernández-Lobato (ICML, 2024)

Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks. - Elre Talea Oldewage; Ross M. Clarke; José Miguel Hernández-Lobato (Trans. Mach. Learn. Res., 2024)