torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models. - Chiheon Kim; Heungsub Lee; Myungryong Jeong; Woonhyuk Baek; Boogeon Yoon; Ildoo Kim; Sungbin Lim; Sungwoong Kim (CoRR, 2020)