Directional Analysis of Stochastic Gradient Descent via von Mises-Fisher Distributions in Deep learning. - Cheolhyoung Lee; Kyunghyun Cho; Wanmo Kang (CoRR, 2018)

Mixout: Effective Regularization to Finetune Large-scale Pretrained Language Models. - Cheolhyoung Lee; Kyunghyun Cho; Wanmo Kang (ICLR, 2020)

A Non-monotonic Self-terminating Language Model. - Eugene Choi; Kyunghyun Cho; Cheolhyoung Lee (ICLR, 2023)

Unsupervised Learning of Initialization in Deep Neural Networks via Maximum Mean Discrepancy. - Cheolhyoung Lee; Kyunghyun Cho (CoRR, 2023)