VIDUR: A Large-Scale Simulation Framework for LLM Inference. - Amey Agrawal; Nitin Kedia; Jayashree Mohan; Ashish Panwar; Nipun Kwatra; Bhargav S. Gulavani; Ramachandran Ramjee; Alexey Tumanov (MLSys, 2024)

Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve. - Amey Agrawal; Nitin Kedia; Ashish Panwar; Jayashree Mohan; Nipun Kwatra; Bhargav S. Gulavani; Alexey Tumanov; Ramachandran Ramjee (OSDI, 2024)

Metron: Holistic Performance Evaluation Framework for LLM Inference Systems. - Amey Agrawal; Anmol Agarwal; Nitin Kedia; Jayashree Mohan; Souvik Kundu 009; Nipun Kwatra; Ramachandran Ramjee; Alexey Tumanov (CoRR, 2024)

On Evaluating Performance of LLM Inference Serving Systems. - Amey Agrawal; Nitin Kedia; Anmol Agarwal; Jayashree Mohan; Nipun Kwatra; Souvik Kundu 009; Ramachandran Ramjee; Alexey Tumanov (CoRR, 2025)