Efficient Subsampled Gauss-Newton and Natural Gradient Methods for Training Neural Networks. - Yi Ren 007; Donald Goldfarb (CoRR, 2019)

Practical Quasi-Newton Methods for Training Deep Neural Networks. - Donald Goldfarb; Yi Ren 007; Achraf Bahamou (NeurIPS, 2020)

Tensor Normal Training for Deep Learning Models. - Yi Ren 007; Donald Goldfarb (NeurIPS, 2021)

Kronecker-factored Quasi-Newton Methods for Convolutional Neural Networks. - Yi Ren 007; Donald Goldfarb (CoRR, 2021)

A Mini-Block Natural Gradient Method for Deep Neural Networks. - Achraf Bahamou; Donald Goldfarb; Yi Ren 007 (CoRR, 2022)

Using Second-Order Information in Training Deep Neural Networks - Yi Ren 007 (2022)

A Mini-Block Fisher Method for Deep Neural Networks. - Achraf Bahamou; Donald Goldfarb; Yi Ren 007 (AISTATS, 2023)