Enhancing Multilingual LLM Pretraining with Model-Based Data Selection. - Bettina Messmer; Vinko Sabolcec; Martin Jaggi (CoRR, 2025)

Can Performant LLMs Be Ethical? Quantifying the Impact of Web Crawling Opt-Outs. - Dongyang Fan; Vinko Sabolcec; Matin Ansaripour; Ayush Kumar Tarun; Martin Jaggi; Antoine Bosselut; Imanol Schlag (CoRR, 2025)

URLs Help, Topics Guide: Understanding Metadata Utility in LLM Training. - Dongyang Fan; Vinko Sabolcec; Martin Jaggi (CoRR, 2025)

FineWeb2: One Pipeline to Scale Them All - Adapting Pre-Training Data Processing to Every Language. - Guilherme Penedo; Hynek Kydlícek; Vinko Sabolcec; Bettina Messmer; Negar Foroutan; Amir Hossein Kargaran; Colin Raffel; Martin Jaggi; Leandro von Werra; Thomas Wolf 008 (CoRR, 2025)