The Data Provenance Initiative: A Large Scale Audit of Dataset Licensing & Attribution in AI. - Shayne Longpre; Robert Mahari; Anthony Chen; Naana Obeng-Marnu; Damien Sileo; William Brannon; Niklas Muennighoff; Nathan Khazam; Jad Kabbara; Kartik Perisetla; Xinyi Wu; Enrico Shippole; et al. (CoRR, 2023)

YaRN: Efficient Context Window Extension of Large Language Models. - Bowen Peng; Jeffrey Quesnelle; Honglu Fan; Enrico Shippole (ICLR, 2024)

Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformers. - Katherine Crowson; Stefan Andreas Baumann; Alex Birch; Tanishq Mathew Abraham; Daniel Z. Kaplan; Enrico Shippole (ICML, 2024)

Consent in Crisis: The Rapid Decline of the AI Data Commons. - Shayne Longpre; Robert Mahari; Ariel Lee; Campbell Lund; Hamidah Oderinwale; William Brannon; Nayan Saxena; Naana Obeng-Marnu; Tobin South; Cole Hunter; Kevin Klyman; Christopher Klamm; et al. (NeurIPS, 2024)

Consent in Crisis: The Rapid Decline of the AI Data Commons. - Shayne Longpre; Robert Mahari; Ariel Lee; Campbell Lund; Hamidah Oderinwale; William Brannon; Nayan Saxena; Naana Obeng-Marnu; Tobin South; Cole Hunter; Kevin Klyman; Christopher Klamm; et al. (CoRR, 2024)

Bridging the Data Provenance Gap Across Text, Speech and Video. - Shayne Longpre; Nikhil Singh 003; Manuel Cherep; Kushagra Tiwary; Joanna Materzynska; William Brannon; Robert Mahari; Manan Dey; Mohammed Hamdy; Nayan Saxena; Ahmad Mustafa Anis; Emad A. Alghamdi; et al. (CoRR, 2024)

A large-scale audit of dataset licensing and attribution in AI. - Shayne Longpre; Robert Mahari; Anthony Chen; Naana Obeng-Marnu; Damien Sileo; William Brannon; Niklas Muennighoff; Nathan Khazam; Jad Kabbara; Kartik Perisetla; Xinyi Wu; Enrico Shippole; et al. (Nat. Mac. Intell., 2024)

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text. - Nikhil Kandpal; Brian Lester; Colin Raffel; Sebastian Majstorovic; Stella Biderman; Baber Abbasi; Luca Soldaini; Enrico Shippole; A. Feder Cooper; Aviya Skowron; John Kirchenbauer; Shayne Longpre; et al. (CoRR, 2025)