Sukjin Hong

According to our database, Sukjin Hong authored at least 3 papers between 2022 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Token-Scaled Logit Distillation for Ternary Weight Generative Language Models.

Minsoo Kim, Sihwa Lee, Janghwan Lee, Sukjin Hong, Du-Seong Chang, Wonyong Sung, Jungwook Choi

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective.

Jongwoo Ko, Seungjoon Park, Minchan Jeong, Sukjin Hong, Euijai Ahn, Du-Seong Chang, Se-Young Yun

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

2022

Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders.

Minsoo Kim, Sihwa Lee, Sukjin Hong, Du-Seong Chang, Jungwook Choi

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022