A Dataset and Strong Baselines for Classification of Czech News Texts. - Hynek Kydlícek; Jindrich Libovický (TSD, 2023)

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale. - Guilherme Penedo; Hynek Kydlícek; Loubna Ben Allal; Anton Lozhkov; Margaret Mitchell; Colin A. Raffel; Leandro von Werra; Thomas Wolf 008 (NeurIPS, 2024)

BenCzechMark : A Czech-centric Multitask and Multimetric Benchmark for Large Language Models with Duel Scoring Mechanism. - Martin Fajcik; Martin Docekal; Jan Dolezal; Karel Ondrej; Karel Benes; Jan Kapsa; Pavel Smrz; Alexander Polok; Michal Hradis; Zuzana Neverilová; Ales Horák; Radoslav Sabol; et al. (CoRR, 2024)

Towards Best Practices for Open Datasets for LLM Training. - Stefan Baack; Stella Biderman; Kasia Odrozek; Aviya Skowron; Ayah Bdeir; Jillian Bommarito; Jennifer Ding; Maximilian Gahntz; Paul Keller; Pierre-Carl Langlais; Greg Lindahl; Sebastian Majstorovic; et al. (CoRR, 2025)

SmolLM2: When Smol Goes Big - Data-Centric Training of a Small Language Model. - Loubna Ben Allal; Anton Lozhkov; Elie Bakouch; Gabriel Martín Blázquez; Guilherme Penedo; Lewis Tunstall; Andrés Marafioti; Hynek Kydlícek; Agustín Piqueres Lajarín; Vaibhav Srivastav; Joshua Lochner; Caleb Fahlgren; et al. (CoRR, 2025)

Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs. - Longxu Dou; Qian Liu 012; Fan Zhou; Changyu Chen; Zili Wang; Ziqi Jin; Zichen Liu; Tongyao Zhu; Cunxiao Du; Penghui Yang 001; Haonan Wang; Jiaheng Liu; et al. (CoRR, 2025)

FineWeb2: One Pipeline to Scale Them All - Adapting Pre-Training Data Processing to Every Language. - Guilherme Penedo; Hynek Kydlícek; Vinko Sabolcec; Bettina Messmer; Negar Foroutan; Amir Hossein Kargaran; Colin Raffel; Martin Jaggi; Leandro von Werra; Thomas Wolf 008 (CoRR, 2025)