The Effect of Model Size on Worst-Group Generalization. - Alan Pham; Eunice Chan; Vikranth Srivatsa; Dhruba Ghosh; Yaoqing Yang; Yaodong Yu; Ruiqi Zhong; Joseph E. Gonzalez; Jacob Steinhardt (CoRR, 2021)

InferCept: Efficient Intercept Support for Augmented Large Language Model Inference. - Reyna Abhyankar; Zijian He; Vikranth Srivatsa; Hao Zhang; Yiying Zhang 005 (ICML, 2024)

APIServe: Efficient API Support for Large-Language Model Inferencing. - Reyna Abhyankar; Zijian He; Vikranth Srivatsa; Hao Zhang; Yiying Zhang 005 (CoRR, 2024)

Preble: Efficient Distributed Prompt Scheduling for LLM Serving. - Vikranth Srivatsa; Zijian He; Reyna Abhyankar; Dongming Li; Yiying Zhang 005 (ICLR, 2025)

Cognify: Supercharging Gen-AI Workflows With Hierarchical Autotuning. - Zijian He; Reyna Abhyankar; Vikranth Srivatsa; Yiying Zhang 005 (CoRR, 2025)