Yile Gu

According to our database, Yile Gu authored at least 29 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

ConsumerBench: Benchmarking Generative AI Applications on End-User Devices.

Yile Gu, Rohan Kadekodi, Hoang Nguyen, Keisuke Kamahori, Yiyu Liu, Baris Kasikci

CoRR, June, 2025

Semantic Scheduling for LLM Inference.

Wenyue Hua, Dujian Ding, Yile Gu, Yujie Ren, Kai Mei, Minghua Ma, William Yang Wang

CoRR, June, 2025

TeleRAG: Efficient Retrieval-Augmented Generation Inference with Lookahead Retrieval.

Chien-Yu Lin, Keisuke Kamahori, Yiyu Liu, Xiaoxiang Shi, Madhav Mahesh Kashyap, Yile Gu, Rulin Shao, Zihao Ye, Kan Zhu, Stephanie Wang, Arvind Krishnamurthy, Rohan Kadekodi, Luis Ceze, Baris Kasikci

CoRR, February, 2025

Tactic: Adaptive Sparse Attention with Clustering and Distribution Fitting for Long-Context LLMs.

Kan Zhu, Tian Tang, Qinyu Xu, Yile Gu, Zhichen Zeng, Rohan Kadekodi, Liangyu Zhao, Ang Li, Arvind Krishnamurthy, Baris Kasikci

CoRR, February, 2025

Argos: Agentic Time-Series Anomaly Detection with Autonomous Rule Generation via Large Language Models.

Yile Gu, Yifan Xiong, Jonathan Mace, Yuting Jiang, Yigong Hu, Baris Kasikci, Peng Cheng

CoRR, January, 2025

Scalable and Accurate Application-Level Crash-Consistency Testing via Representative Testing.

Yile Gu, Ian Neal, Jiexiao Xu, Shaun Christopher Lee, Ayman Said, Musa Haydar, Jacob Van Geffen, Rohan Kadekodi, Andrew Quinn, Baris Kasikci

Proc. ACM Program. Lang., 2025

NanoFlow: Towards Optimal Large Language Model Serving Throughput.

Kan Zhu, Yufei Gao, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Ziren Wang, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci

Proceedings of the 19th USENIX Symposium on Operating Systems Design and Implementation, 2025

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models.

Keisuke Kamahori, Tian Tang, Yile Gu, Kan Zhu, Baris Kasikci

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback.

Guan-Ting Lin, Prashanth Gurunath Shivakumar, Aditya Gourav, Yile Gu, Ankur Gandhe, Hung-yi Lee, Ivan Bulyko

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

NanoFlow: Towards Optimal Large Language Model Serving Throughput.

Kan Zhu, Yilong Zhao, Liangyu Zhao, Gefei Zuo, Yile Gu, Dedong Xie, Yufei Gao, Qinyu Xu, Tian Tang, Zihao Ye, Keisuke Kamahori, Chien-Yu Lin, Stephanie Wang, Arvind Krishnamurthy, Baris Kasikci

CoRR, 2024

Fiddler: CPU-GPU Orchestration for Fast Inference of Mixture-of-Experts Models.

Keisuke Kamahori, Yile Gu, Kan Zhu, Baris Kasikci

CoRR, 2024

Reducing Energy Bloat in Large Model Training.

Jae-Won Chung, Yile Gu, Insu Jang, Luoxi Meng, Nikhil Bansal, Mosharaf Chowdhury

Proceedings of the ACM SIGOPS 30th Symposium on Operating Systems Principles, 2024

Paralinguistics-Enhanced Large Language Modeling of Spoken Dialogue.

Guan-Ting Lin, Prashanth Gurunath Shivakumar, Ankur Gandhe, Chao-Han Huck Yang, Yile Gu, Shalini Ghosh, Andreas Stolcke, Hung-Yi Lee, Ivan Bulyko

Proceedings of the IEEE International Conference on Acoustics, 2024

Towards ASR Robust Spoken Language Understanding Through in-Context Learning with Word Confusion Networks.

Kevin Everson, Yile Gu, Chao-Han Huck Yang, Prashanth Gurunath Shivakumar, Guan-Ting Lin, Jari Kolehmainen, Ivan Bulyko, Ankur Gandhe, Shalini Ghosh, Wael Hamza, Hung-Yi Lee, Ariya Rastrow, Andreas Stolcke

Proceedings of the IEEE International Conference on Acoustics, 2024

Multi-Modal Retrieval For Large Language Model Based Speech Recognition.

Aditya Gourav, Jari Kolehmainen, Prashanth Gurunath Shivakumar, Yile Gu, Grant P. Strimel, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Perseus: Removing Energy Bloat from Large Model Training.

Jae-Won Chung, Yile Gu, Insu Jang, Luoxi Meng, Nikhil Bansal, Mosharaf Chowdhury

CoRR, 2023

Distillation Strategies for Discriminative Speech Recognition Rescoring.

Prashanth Gurunath Shivakumar, Jari Kolehmainen, Yile Gu, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Personalization for BERT-based Discriminative Speech Recognition Rescoring.

Jari Kolehmainen, Yile Gu, Aditya Gourav, Prashanth Gurunath Shivakumar, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Scaling Laws for Discriminative Speech Recognition Rescoring Models.

Yile Gu, Prashanth Gurunath Shivakumar, Jari Kolehmainen, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Proceedings of the 24th Annual Conference of the International Speech Communication Association, 2023

Low-Rank Adaptation of Large Language Model Rescoring for Parameter-Efficient Speech Recognition.

Yu Yu, Chao-Han Huck Yang, Jari Kolehmainen, Prashanth Gurunath Shivakumar, Yile Gu, Sungho Ryu, Roger Ren, Qi Luo, Aditya Gourav, I-Fan Chen, Yi-Chieh Liu, Tuan Dinh, Ankur Gandhe, Denis Filimonov, Shalini Ghosh, Andreas Stolcke, Ariya Rastrow, Ivan Bulyko

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

Generative Speech Recognition Error Correction With Large Language Models and Task-Activating Prompting.

Chao-Han Huck Yang, Yile Gu, Yi-Chieh Liu, Shalini Ghosh, Ivan Bulyko, Andreas Stolcke

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

Discriminative Speech Recognition Rescoring With Pre-Trained Language Models.

Prashanth Gurunath Shivakumar, Jari Kolehmainen, Yile Gu, Ankur Gandhe, Ariya Rastrow, Ivan Bulyko

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

2022

Mitigating Closed-Model Adversarial Examples with Bayesian Neural Modeling for Enhanced End-to-End Speech Recognition.

Chao-Han Huck Yang, Zeeshan Ahmed, Yile Gu, Joseph Szurley, Roger Ren, Linda Liu, Andreas Stolcke, Ivan Bulyko

Proceedings of the IEEE International Conference on Acoustics, 2022

RescoreBERT: Discriminative Speech Recognition Rescoring With Bert.

Liyan Xu, Yile Gu, Jari Kolehmainen, Haidar Khan, Ankur Gandhe, Ariya Rastrow, Andreas Stolcke, Ivan Bulyko

Proceedings of the IEEE International Conference on Acoustics, 2022

2021

Adjunct-Emeritus Distillation for Semi-Supervised Language Model Adaptation.

Scott Novotney, Yile Gu, Ivan Bulyko

Proceedings of the 22nd Annual Conference of the International Speech Communication Association, Interspeech 2021, Brno, Czechia, August 30, 2021

Domain-Aware Neural Language Models for Speech Recognition.

Linda Liu, Yile Gu, Aditya Gourav, Ankur Gandhe, Shashank Kalmane, Denis Filimonov, Ariya Rastrow, Ivan Bulyko

Proceedings of the IEEE International Conference on Acoustics, 2021

Personalization Strategies for End-to-End Speech Recognition Systems.

Aditya Gourav, Linda Liu, Ankur Gandhe, Yile Gu, Guitang Lan, Xiangyang Huang, Shashank Kalmane, Gautam Tiwari, Denis Filimonov, Ariya Rastrow, Andreas Stolcke, Ivan Bulyko

Proceedings of the IEEE International Conference on Acoustics, 2021

Multi-Task Language Modeling for Improving Speech Recognition of Rare Words.

Chao-Han Huck Yang, Linda Liu, Ankur Gandhe, Yile Gu, Anirudh Raju, Denis Filimonov, Ivan Bulyko

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2021

2020

Improving accuracy of rare words for RNN-Transducer through unigram shallow fusion.

Vijay Ravi, Yile Gu, Ankur Gandhe, Ariya Rastrow, Linda Liu, Denis Filimonov, Scott Novotney, Ivan Bulyko

CoRR, 2020