Lessons from the bleeding edge: large-scale production inference of LLMs. - Yubin Kim 001; Arthur Maciejewicz; Brandon Beveridge (eCom@SIGIR, 2025)