Project MPG: towards a generalized performance benchmark for LLM capabilities. - Lucas Spangher; Tianle Li; William F. Arnold; Nick Masiewicki; Xerxes Dotiwalla; Rama Parusmathi; Peter Grabowski; Eugene Ie; Daniel Gruhl (CoRR, 2024)

Chatbot Arena Estimate: towards a generalized performance benchmark for LLM capabilities. - Lucas Spangher; Tianle Li; William F. Arnold; Nick Masiewicki; Xerxes Dotiwalla; Rama Kumar Pasumarthi; Peter Grabowski; Eugene Ie; Daniel Gruhl (NAACL (Industry Track), 2025)

Factored Agents: Decoupling In-Context Learning and Memorization for Robust Tool Use. - Nicholas Roth; Christopher Hidey; Lucas Spangher; William F. Arnold; Chang Ye; Nick Masiewicki; Jinoo Baek; Peter Grabowski; Eugene Ie (CoRR, 2025)