I-BERT: Integer-only BERT Quantization. - Sehoon Kim 001; Amir Gholami; Zhewei Yao; Michael W. Mahoney; Kurt Keutzer (ICML, 2021)

Memory-Efficient Hardware Performance Counters with Approximate-Counting Algorithms. - Jingyi Xu; Sehoon Kim 001; Borivoje Nikolic; Yakun Sophia Shao (ISPASS, 2021)

Terra: Imperative-Symbolic Co-Execution of Imperative Deep Learning Programs. - Taebum Kim; Eunji Jeong; Geon-Woo Kim; Yunmo Koo; Sehoon Kim 001; Gyeong-In Yu; Byung-Gon Chun (NeurIPS, 2021)

A Survey of Quantization Methods for Efficient Neural Network Inference. - Amir Gholami; Sehoon Kim 001; Zhen Dong 003; Zhewei Yao; Michael W. Mahoney; Kurt Keutzer (CoRR, 2021)

Q-ASR: Integer-only Zero-shot Quantization for Efficient Speech Recognition. - Sehoon Kim 001; Amir Gholami; Zhewei Yao; Aniruddha Nrusimha; Bohan Zhai; Tianren Gao; Michael W. Mahoney; Kurt Keutzer (CoRR, 2021)

Learned Token Pruning for Transformers. - Sehoon Kim 001; Sheng Shen 001; David Thorsley; Amir Gholami; Joseph Hassoun; Kurt Keutzer (CoRR, 2021)

Applications and Techniques for Fast Machine Learning in Science. - Allison McCarn Deiana; Nhan Tran; Joshua Agar; Michaela Blott; Giuseppe Di Guglielmo; Javier M. Duarte; Philip C. Harris; Scott Hauck; Mia Liu; Mark S. Neubauer; Jennifer Ngadiuba; Seda Ogrenci Memik; et al. (CoRR, 2021)

WindTunnel: Towards Differentiable ML Pipelines Beyond a Single Modele. - Gyeong-In Yu; Saeed Amizadeh; Sehoon Kim 001; Artidoro Pagnoni; Ce Zhang 001; Byung-Gon Chun; Markus Weimer; Matteo Interlandi (Proc. VLDB Endow., 2021)

Integer-Only Zero-Shot Quantization for Efficient Speech Recognition. - Sehoon Kim 001; Amir Gholami; Zhewei Yao; Nicholas Lee; Patrick Wang; Aniruddha Nrusimha; Bohan Zhai; Tianren Gao; Michael W. Mahoney; Kurt Keutzer (ICASSP, 2022)

Learned Token Pruning for Transformers. - Sehoon Kim 001; Sheng Shen 001; David Thorsley; Amir Gholami; Woosuk Kwon; Joseph Hassoun; Kurt Keutzer (KDD, 2022)

Squeezeformer: An Efficient Transformer for Automatic Speech Recognition. - Sehoon Kim 001; Amir Gholami; Albert E. Shaw; Nicholas Lee; Karttikeya Mangalam; Jitendra Malik; Michael W. Mahoney; Kurt Keutzer (NeurIPS, 2022)

A Fast Post-Training Pruning Framework for Transformers. - Woosuk Kwon; Sehoon Kim 001; Michael W. Mahoney; Joseph Hassoun; Kurt Keutzer; Amir Gholami (NeurIPS, 2022)

Hessian-Aware Pruning and Optimal Neural Implant. - Shixing Yu; Zhewei Yao; Amir Gholami; Zhen Dong 003; Sehoon Kim 001; Michael W. Mahoney; Kurt Keutzer (WACV, 2022)

Applications and Techniques for Fast Machine Learning in Science. - Allison McCarn Deiana; Nhan Tran; Joshua Agar; Michaela Blott; Giuseppe Di Guglielmo; Javier M. Duarte; Philip C. Harris; Scott Hauck; Mia Liu; Mark S. Neubauer; Jennifer Ngadiuba; Seda Ogrenci Memik; et al. (Frontiers Big Data, 2022)

Speculative Decoding with Big Little Decoder. - Sehoon Kim 001; Karttikeya Mangalam; Suhong Moon; Jitendra Malik; Michael W. Mahoney; Amir Gholami; Kurt Keutzer (NeurIPS, 2023)

Big Little Transformer Decoder. - Sehoon Kim 001; Karttikeya Mangalam; Jitendra Malik; Michael W. Mahoney; Amir Gholami; Kurt Keutzer (CoRR, 2023)

Full Stack Optimization of Transformer Inference: a Survey. - Sehoon Kim 001; Coleman Hooper; Thanakul Wattanawong; Minwoo Kang; Ruohan Yan; Hasan Genc; Grace Dinh; Qijing Huang 001; Kurt Keutzer; Michael W. Mahoney; Yakun Sophia Shao; Amir Gholami (CoRR, 2023)

SPEED: Speculative Pipelined Execution for Efficient Decoding. - Coleman Hooper; Sehoon Kim 001; Hiva Mohammadzadeh; Hasan Genc; Kurt Keutzer; Amir Gholami; Yakun Sophia Shao (CoRR, 2023)

LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement. - Nicholas Lee; Thanakul Wattanawong; Sehoon Kim 001; Karttikeya Mangalam; Sheng Shen 001; Gopala Anumanchipalli; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (ACL (Findings), 2024)

SqueezeLLM: Dense-and-Sparse Quantization. - Sehoon Kim 001; Coleman Hooper; Amir Gholami; Zhen Dong 003; Xiuyu Li; Sheng Shen 001; Michael W. Mahoney; Kurt Keutzer (ICML, 2024)

An LLM Compiler for Parallel Function Calling. - Sehoon Kim 001; Suhong Moon; Ryan Tabrizi; Nicholas Lee; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (ICML, 2024)

KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization. - Coleman Hooper; Sehoon Kim 001; Hiva Mohammadzadeh; Michael W. Mahoney; Yakun Sophia Shao; Kurt Keutzer; Amir Gholami (NeurIPS, 2024)

Learned Best-Effort LLM Serving. - Siddharth Jha; Coleman Hooper; Xiaoxuan Liu; Sehoon Kim 001; Kurt Keutzer (CoRR, 2024)

Characterizing Prompt Compression Methods for Long Context Inference. - Siddharth Jha; Lutfi Eren Erdogan; Sehoon Kim 001; Kurt Keutzer; Amir Gholami (CoRR, 2024)

TinyAgent: Function Calling at the Edge. - Lutfi Eren Erdogan; Nicholas Lee; Siddharth Jha; Sehoon Kim 001; Ryan Tabrizi; Suhong Moon; Coleman Hooper; Gopala Anumanchipalli; Kurt Keutzer; Amir Gholami (CoRR, 2024)

Efficient and Scalable Estimation of Tool Representations in Vector Space. - Suhong Moon; Siddharth Jha; Lutfi Eren Erdogan; Sehoon Kim 001; Woosang Lim; Kurt Keutzer; Amir Gholami (CoRR, 2024)

Squeezed Attention: Accelerating Long Context Length LLM Inference. - Coleman Hooper; Sehoon Kim 001; Hiva Mohammadzadeh; Monishwaran Maheswaran; June Paik; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (CoRR, 2024)

Corrigendum: Applications and techniques for fast machine learning in science. - Allison McCarn Deiana; Nhan Tran; Joshua Agar; Michaela Blott; Giuseppe Di Guglielmo; Javier M. Duarte; Philip C. Harris; Scott Hauck; Mia Liu; Mark S. Neubauer; Jennifer Ngadiuba; Seda Ogrenci-Memik; et al. (Frontiers Big Data, 2024)

AI and Memory Wall. - Amir Gholami; Zhewei Yao; Sehoon Kim 001; Coleman Hooper; Michael W. Mahoney; Kurt Keutzer (IEEE Micro, 2024)

Full Stack Approach for Efficient Deep Learning Inference - Sehoon Kim 001 (2024)

Squeezed Attention: Accelerating Long Context Length LLM Inference. - Coleman Richard Charles Hooper; Sehoon Kim 001; Hiva Mohammadzadeh; Monishwaran Maheswaran; Sebastian Zhao; June Paik; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (ACL (1), 2025)

QuantSpec: Self-Speculative Decoding with Hierarchical Quantized KV Cache. - Rishabh Tiwari; Haocheng Xi; Aditya Tomar; Coleman Hooper; Sehoon Kim 001; Maxwell Horton; Mahyar Najibi; Michael W. Mahoney; Kurt Keutzer; Amir Gholami (CoRR, 2025)

ETS: Efficient Tree Search for Inference-Time Scaling. - Coleman Hooper; Sehoon Kim 001; Suhong Moon; Kerem Dilmen; Monishwaran Maheswaran; Nicholas Lee; Michael W. Mahoney; Yakun Sophia Shao; Kurt Keutzer; Amir Gholami (CoRR, 2025)

Plan-and-Act: Improving Planning of Agents for Long-Horizon Tasks. - Lutfi Eren Erdogan; Nicholas Lee; Sehoon Kim 001; Suhong Moon; Hiroki Furuta; Gopala Anumanchipalli; Kurt Keutzer; Amir Gholami (CoRR, 2025)

Multipole Attention for Efficient Long Context Reasoning. - Coleman Hooper; Sebastian Zhao; Luca Manolache; Sehoon Kim 001; Michael W. Mahoney; Yakun Sophia Shao; Kurt Keutzer; Amir Gholami (CoRR, 2025)