MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining. - Jacob P. Portes; Alexander Trott; Sam Havens; Daniel King; Abhinav Venigalla; Moin Nadeem; Nikhil Sardana; Daya Khudia; Jonathan Frankle (NeurIPS, 2023)

Is the GPU Half-Empty or Half-Full? Practical Scheduling Techniques for LLMs. - Ferdi Kossmann; Bruce Fontaine; Daya Khudia; Michael J. Cafarella; Samuel Madden 001 (CoRR, 2024)