Towards Best Practices for Open Datasets for LLM Training. - Stefan Baack; Stella Biderman; Kasia Odrozek; Aviya Skowron; Ayah Bdeir; Jillian Bommarito; Jennifer Ding; Maximilian Gahntz; Paul Keller; Pierre-Carl Langlais; Greg Lindahl; Sebastian Majstorovic; et al. (CoRR, 2025)

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text. - Nikhil Kandpal; Brian Lester; Colin Raffel; Sebastian Majstorovic; Stella Biderman; Baber Abbasi; Luca Soldaini; Enrico Shippole; A. Feder Cooper; Aviya Skowron; John Kirchenbauer; Shayne Longpre; et al. (CoRR, 2025)