SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling. - Sanghoon Kim; Dahyun Kim 001; Chanjun Park; Wonsung Lee; Wonho Song; Yunsu Kim 004; Hyeonwoo Kim; Yungi Kim; Hyeonju Lee; Jihoo Kim; Changbae Ahn; Seonghoon Yang; et al. (NAACL (Industry Track), 2024)

Rethinking KenLM: Good and Bad Model Ensembles for Efficient Text Quality Filtering in Large Web Corpora. - Yungi Kim; Hyunsoo Ha; Sukyung Lee; Jihoo Kim; Seonghoon Yang; Chanjun Park (CoRR, 2024)

1 Trillion Token (1TT) Platform: A Novel Framework for Efficient Data Sharing and Compensation in Large Language Models. - Chanjun Park; Hyunsoo Ha; Jihoo Kim; Yungi Kim; Dahyun Kim 001; Sukyung Lee; Seonghoon Yang (CoRR, 2024)

LP Data Pipeline: Lightweight, Purpose-driven Data Pipeline for Large Language Models. - Yungi Kim; Hyunsoo Ha; Seonghoon Yang; Sukyung Lee; Jihoo Kim; Chanjun Park (CoRR, 2024)