Model Merging in Pre-training of Large Language Models. - Yunshui Li; Yiyuan Ma; Shen Yan; Chaoyi Zhang; Jing Liu; Jianqiao Lu; Ziwen Xu; Mengzhao Chen; Minrui Wang; Shiyi Zhan; Jin Ma; Xunhao Lai; et al. (CoRR, 2025)