torchgpipe: On-the-fly Pipeline Parallelism for Training Giant Models. - Chiheon Kim; Heungsub Lee; Myungryong Jeong; Woonhyuk Baek; Boogeon Yoon; Ildoo Kim; Sungbin Lim; Sungwoong Kim (CoRR, 2020)

What Changes Can Large-scale Language Models Bring? Intensive Study on HyperCLOVA: Billions-scale Korean Generative Pretrained Transformers. - Boseop Kim; HyoungSeok Kim; Sang-Woo Lee 001; Gichang Lee; Dong-Hyun Kwak; Dong Hyeon Jeon; Sunghyun Park 005; Sungju Kim; Seonhoon Kim; Dongpil Seo; Heungsub Lee; Minyoung Jeong; et al. (EMNLP (1), 2021)

HPCClusterScape: Increasing Transparency and Efficiency of Shared High-Performance Computing Clusters for Large-scale AI Models. - Heungseok Park; Aeree Cho; Hyojun Jeon; Hayoung Lee; Youngil Yang; Sungjae Lee; Heungsub Lee; Jaegul Choo (CoRR, 2023)