An Optimization Pass for Training Speed-Up and Strategy Search in 3D Parallelism. - Ryubu Hosoki; Kento Sato; Toshio Endo; Julien Bigot; Edouard Audit (CLUSTER Workshops, 2024)

AshPipe: Asynchronous Hybrid Pipeline Parallel for DNN Training. - Ryubu Hosoki; Toshio Endo; Takahiro Hirofuchi; Tsutomu Ikegami (HPC Asia, 2024)