A layer-block-wise pipeline for memory and bandwidth reduction in distributed deep learning. - Haruki Mori; Tetsuya Youkawa; Shintaro Izumi; Masahiko Yoshimoto; Hiroshi Kawaguchi 001; Atsuki Inoue (MLSP, 2017)

Delayed Weight Update for Faster Convergence in Data-Parallel Deep Learning. - Tetsuya Youkawa; Haruki Mori; Yuki Miyauchi; Kazuki Yamada; Shintaro Izumi; Masahiko Yoshimoto; Hiroshi Kawaguchi 001 (GlobalSIP, 2018)

Layer Skip Learning using LARS variables for 39% Faster Conversion Time and Lower Bandwidth. - Yuki Miyauchi; Haruki Mori; Tetsuya Youkawa; Kazuki Yamada; Shintato Izumi; Masahiko Yoshimoto; Hiroshi Kawaguchi 001; Atsuki Inoue (ICECS, 2018)

Adaptive Learning Rate Adjustment with Short-Term Pre-Training in Data-Parallel Deep Learning. - Kazuki Yamada; Haruki Mori; Tetsuya Youkawa; Yuki Miyauchi; Shintaro Izumi; Masahiko Yoshimoto; Hiroshi Kawaguchi 001 (SiPS, 2018)