Second-order Optimization Method for Large Mini-batch: Training ResNet-50 on ImageNet in 35 Epochs. - Kazuki Osawa; Yohei Tsuji; Yuichiro Ueno; Akira Naruse; Rio Yokota; Satoshi Matsuoka (CoRR, 2018)

Large-Scale Distributed Second-Order Optimization Using Kronecker-Factored Approximate Curvature for Deep Convolutional Neural Networks. - Kazuki Osawa; Yohei Tsuji; Yuichiro Ueno; Akira Naruse; Rio Yokota; Satoshi Matsuoka (CVPR, 2019)

Performance Optimizations and Analysis of Distributed Deep Learning with Approximated Second-Order Optimization Method. - Yohei Tsuji; Kazuki Osawa; Yuichiro Ueno; Akira Naruse; Rio Yokota; Satoshi Matsuoka (ICPP Workshops, 2019)

Double-Precision FPUs in High-Performance Computing: An Embarrassment of Riches? - Jens Domke; Kazuaki Matsumura; Mohamed Wahib; Haoyu Zhang; Keita Yashima; Toshiki Tsuchikawa; Yohei Tsuji; Artur Podobas; Satoshi Matsuoka (IPDPS, 2019)

Rich Information is Affordable: A Systematic Performance Analysis of Second-order Optimization Using K-FAC. - Yuichiro Ueno; Kazuki Osawa; Yohei Tsuji; Akira Naruse; Rio Yokota (KDD, 2020)

Scalable and Practical Natural Gradient for Large-Scale Deep Learning. - Kazuki Osawa; Yohei Tsuji; Yuichiro Ueno; Akira Naruse; Chuan-Sheng Foo; Rio Yokota (IEEE Trans. Pattern Anal. Mach. Intell., 2022)