ASDL: A Unified Interface for Gradient Preconditioning in PyTorch. - Kazuki Osawa; Satoki Ishikawa; Rio Yokota; Shigang Li 002; Torsten Hoefler (CoRR, 2023)

On the Parameterization of Second-Order Optimization Effective towards the Infinite Width. - Satoki Ishikawa; Ryo Karakida (ICLR, 2024)

When Does Second-Order Optimization Speed Up Training? - Satoki Ishikawa; Rio Yokota (Tiny Papers @ ICLR, 2024)

Lion Cub: Minimizing Communication Overhead in Distributed Lion. - Satoki Ishikawa; Tal Ben-Nun; Brian Van Essen; Rio Yokota; Nikoli Dryden (CoRR, 2024)

PhiNets: Brain-inspired Non-contrastive Learning Based on Temporal Prediction Hypothesis. - Satoki Ishikawa; Makoto Yamada; Han Bao 002; Yuki Takezawa (ICLR, 2025)

Local Loss Optimization in the Infinite Width: Stable Parameterization of Predictive Coding Networks and Target Propagation. - Satoki Ishikawa; Rio Yokota; Ryo Karakida (ICLR, 2025)

PhiNet v2: A Mask-Free Brain-Inspired Vision Foundation Model from Video. - Makoto Yamada; Kian Ming A. Chai; Ayoub Rhim; Satoki Ishikawa; Mohammad Sabokrou; Yao-Hung Hubert Tsai (CoRR, 2025)