Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakes. - Simran Arora; Brandon Yang; Sabri Eyuboglu; Avanika Narayan; Andrew Hojel; Immanuel Trummer; Christopher Ré (Proc. VLDB Endow., 2023)

Rethinking Reflection in Pre-Training. - Darsh J. Shah; Peter Rushton; Somanshu Singla; Mohit Parmar; Kurt Smith; Yash Vanjani; Ashish Vaswani; Adarsh Chaluvaraju; Andrew Hojel; Andrew Ma; Anil Thomas; Anthony M. Polloreno; et al. (CoRR, 2025)

Practical Efficiency of Muon for Pretraining. - Ishaan Shah; Anthony M. Polloreno; Karl Stratos; Philip Monk; Adarsh Chaluvaraju; Andrew Hojel; Andrew Ma; Anil Thomas; Ashish Tanwer; Darsh J. Shah; Khoi Nguyen; Kurt Smith; et al. (CoRR, 2025)

Essential-Web v1.0: 24T tokens of organized web data. - Andrew Hojel; Michael Pust; Tim Romanski; Yash Vanjani; Ritvik Kapila; Mohit Parmar; Adarsh Chaluvaraju; Alok Tripathy; Anil Thomas; Ashish Tanwer; Darsh J. Shah; Ishaan Shah; et al. (CoRR, 2025)