Souvik Kundu

According to our database, Souvik Kundu authored at least 35 papers between 2023 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

On Evaluating Performance of LLM Inference Serving Systems.

Amey Agrawal, Nitin Kedia, Anmol Agarwal, Jayashree Mohan, Nipun Kwatra, Souvik Kundu, Ramachandran Ramjee, Alexey Tumanov

CoRR, July, 2025

On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention.

Yeonju Ro, Zhenyu Zhang, Souvik Kundu, Zhangyang Wang, Aditya Akella

CoRR, June, 2025

Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection.

Yeshwanth Venkatesha, Souvik Kundu, Priyadarshini Panda

CoRR, June, 2025

Accelerating LLM Inference with Flexible N:M Sparsity via A Fully Digital Compute-in-Memory Accelerator.

Akshat Ramachandran, Souvik Kundu, Arnab Raha, Shamik Kundu, Deepak A. Mathaikutty, Tushar Krishna

CoRR, April, 2025

Understanding and Optimizing Multi-Stage AI Inference Pipelines.

Abhimanyu Rajeshkumar Bambhaniya, Hanjiang Wu, Suvinay Subramanian, Sudarshan Srinivasan, Souvik Kundu, Amir Yazdanbakhsh, Midhilesh Elavazhagan, Madhu Kumar, Tushar Krishna

CoRR, April, 2025

SEAL: Steerable Reasoning Calibration of Large Language Models for Free.

Runjin Chen, Zhenyu Zhang, Junyuan Hong, Souvik Kundu, Zhangyang Wang

CoRR, April, 2025

OuroMamba: A Data-Free Quantization Framework for Vision Mamba Models.

Akshat Ramachandran, Mingyu Lee, Huan Xu, Souvik Kundu, Tushar Krishna

CoRR, March, 2025

Enhancing Large Language Models for Hardware Verification: A Novel SystemVerilog Assertion Dataset.

Anand Menon, Samit S. Miftah, Shamik Kundu, Souvik Kundu, Amisha Srivastava, Arnab Raha, Gabriel Theodor Sonnenschein, Suvadeep Banerjee, Deepak Mathaikutty, Kanad Basu

CoRR, March, 2025

LANTERN++: Enhanced Relaxed Speculative Decoding with Static Tree Drafting for Visual Auto-regressive Models.

Sihwan Park, Doohyuk Jang, Sungyub Kim, Souvik Kundu, Eunho Yang

CoRR, February, 2025

CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing.

Wenhao Zheng, Yixiao Chen, Weitong Zhang, Souvik Kundu, Yun Li, Zhengzhong Liu, Eric P. Xing, Hongyi Wang, Huaxiu Yao

CoRR, February, 2025

Unraveling Zeroth-Order Optimization through the Lens of Low-Dimensional Structured Perturbations.

Sihwan Park, Jihun Yun, Sungyub Kim, Souvik Kundu, Eunho Yang

CoRR, January, 2025

Fast and Cost-effective Speculative Edge-Cloud Decoding with Early Exits.

Yeshwanth Venkatesha, Souvik Kundu, Priyadarshini Panda

Trans. Mach. Learn. Res., 2025

MicroScopiQ: Accelerating Foundational Models through Outlier-Aware Microscaling Quantization.

Akshat Ramachandran, Souvik Kundu, Tushar Krishna

Proceedings of the 52nd Annual International Symposium on Computer Architecture, 2025

LANTERN: Accelerating Visual Autoregressive Models with Relaxed Speculative Decoding.

Doohyuk Jang, Sihwan Park, June Yong Yang, Yeonsung Jung, Jihun Yun, Souvik Kundu, Sungyub Kim, Eunho Yang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Scaling Long Context Training Data by Long-Distance Referrals.

Yonghao Zhuang, Lanxiang Hu, Longfei Yun, Souvik Kundu, Zhengzhong Liu, Eric P. Xing, Hao Zhang

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

LLM-NPU: Towards Efficient Foundation Model Inference on Low-Power Neural Processing Units.

Arnab Raha, Souvik Kundu, Sharath Nittur Sridhar, Shamik Kundu, Soumendu Kumar Ghosh, Alessandro Palla, Arghadip Das, Darren Crews, Deepak A. Mathaikutty

Proceedings of the IEEE International Conference on Omni-layer Intelligent Systems, 2025

2024

Bit-by-Bit: Investigating the Vulnerabilities of Binary Neural Networks to Adversarial Bit Flipping.

Shamik Kundu, Sanjay Das, Sayar Karmakar, Arnab Raha, Souvik Kundu, Yiorgos Makris, Kanad Basu

Trans. Mach. Learn. Res., 2024

Unveiling Adversarially Robust Graph Lottery Tickets.

Subhajit Dutta Chowdhury, Zhiyu Ni, Qingyuan Peng, Souvik Kundu, Pierluigi Nuzzo

Trans. Mach. Learn. Res., 2024

AttentionBreaker: Adaptive Evolutionary Optimization for Unmasking Vulnerabilities in LLMs through Bit-Flip Attacks.

Sanjay Das, Swastik Bhattacharya, Souvik Kundu, Shamik Kundu, Anand Menon, Arnab Raha, Kanad Basu

CoRR, 2024

Metron: Holistic Performance Evaluation Framework for LLM Inference Systems.

Amey Agrawal, Anmol Agarwal, Nitin Kedia, Jayashree Mohan, Souvik Kundu, Nipun Kwatra, Ramachandran Ramjee, Alexey Tumanov

CoRR, 2024

CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs.

Akshat Ramachandran, Souvik Kundu, Tushar Krishna

CoRR, 2024

Demystifying Platform Requirements for Diverse LLM Inference Use Cases.

Abhimanyu Bambhaniya, Ritik Raj, Geonhwa Jeong, Souvik Kundu, Sudarshan Srinivasan, Midhilesh Elavazhagan, Madhu Kumar, Tushar Krishna

CoRR, 2024

GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM.

Hao Kang, Qingru Zhang, Souvik Kundu, Geonhwa Jeong, Zaoxing Liu, Tushar Krishna, Tuo Zhao

CoRR, 2024

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization.

Haoran You, Yipin Guo, Yichao Fu, Wei Zhou, Huihong Shi, Xiaofan Zhang, Souvik Kundu, Amir Yazdanbakhsh, Yingyan (Celine) Lin

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2024, 2024

Junk DNA Hypothesis: Pruning Small Pre-Trained Weights Irreversibly and Monotonically Impairs "Difficult" Downstream Tasks in LLMs.

Lu Yin, Ajay Kumar Jaiswal, Shiwei Liu, Souvik Kundu, Zhangyang Wang

Proceedings of the Forty-first International Conference on Machine Learning, 2024

Fusing Models with Complementary Expertise.

Hongyi Wang, Felipe Maia Polo, Yuekai Sun, Souvik Kundu, Eric P. Xing, Mikhail Yurochkin

Proceedings of the Twelfth International Conference on Learning Representations, 2024

Analyzing Adversarial Vulnerabilities of Graph Lottery Tickets.

Subhajit Dutta Chowdhury, Zhiyu Ni, Qingyuan Peng, Souvik Kundu, Pierluigi Nuzzo

Proceedings of the IEEE International Conference on Acoustics, 2024

Towards Real-Time LLM Inference on Heterogeneous Edge Platforms.

Rakshith Jayanth, Neelesh Gupta, Souvik Kundu, Deepak A. Mathaikutty, Viktor K. Prasanna

Proceedings of the 31st IEEE International Conference on High Performance Computing, Data and Analytics, HiPC 2024, 2024

GEAR: An Efficient Error Reduction Framework for KV Cache Compression in LLM Inference.

Hao Kang, Qingru Zhang, Souvik Kundu, Geonhwa Jeong, Zaoxing Liu, Tushar Krishna, Tuo Zhao

Proceedings of the NeurIPS Efficient Natural Language and Speech Processing Workshop, 2024

GenQ: Quantization in Low Data Regimes with Generative Synthetic Data.

Yuhang Li, Youngeun Kim, Donghyun Lee, Souvik Kundu, Priyadarshini Panda

Proceedings of the Computer Vision - ECCV 2024, 2024

2023

Sparse but Strong: Crafting Adversarially Robust Graph Lottery Tickets.

Subhajit Dutta Chowdhury, Zhiyu Ni, Qingyuan Peng, Souvik Kundu, Pierluigi Nuzzo

CoRR, 2023

Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity.

Lu Yin, Shiwei Liu, Ajay Jaiswal, Souvik Kundu, Zhangyang Wang

CoRR, 2023

Don't just prune by magnitude! Your mask topology is a secret weapon.

Duc Hoang, Souvik Kundu, Shiwei Liu, Zhangyang Wang

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

NeRFool: Uncovering the Vulnerability of Generalizable Neural Radiance Fields against Adversarial Perturbations.

Yonggan Fu, Ye Yuan, Souvik Kundu, Shang Wu, Shunyao Zhang, Yingyan Celine Lin

Proceedings of the International Conference on Machine Learning, 2023

Vision HGNN: An Image is More than a Graph of Nodes.

Yan Han, Peihao Wang, Souvik Kundu, Ying Ding, Zhangyang Wang

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023