Qingru Zhang

According to our database, Qingru Zhang authored at least 12 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

GEAR: An Efficient KV Cache Compression Recipe for Near-Lossless Generative Inference of LLM.

Hao Kang, Qingru Zhang, Souvik Kundu, Geonhwa Jeong, Zaoxing Liu, Tushar Krishna, Tuo Zhao

CoRR, 2024

2023

Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs.

Qingru Zhang, Chandan Singh, Liyuan Liu, Xiaodong Liu, Bin Yu, Jianfeng Gao, Tuo Zhao

CoRR, 2023

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

CoRR, 2023

Robust Multi-Agent Reinforcement Learning via Adversarial Regularization: Theoretical Foundation and Stable Algorithms.

Alexander Bukharin, Yan Li, Yue Yu, Qingru Zhang, Zhehui Chen, Simiao Zuo, Chao Zhang, Songan Zhang, Tuo Zhao

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Less is More: Task-aware Layer-wise Distillation for Language Model Compression.

Chen Liang, Simiao Zuo, Qingru Zhang, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2023

LoSparse: Structured Compression of Large Language Models based on Low-Rank and Sparse Approximation.

Yixiao Li, Yifan Yu, Qingru Zhang, Chen Liang, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2023

Adaptive Budget Allocation for Parameter-Efficient Fine-Tuning.

Qingru Zhang, Minshuo Chen, Alexander Bukharin, Pengcheng He, Yu Cheng, Weizhu Chen, Tuo Zhao

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layer.

Qingru Zhang, Dhananjay Ram, Cole Hawkins, Sheng Zha, Tuo Zhao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

2022

MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.

Simiao Zuo, Qingru Zhang, Chen Liang, Pengcheng He, Tuo Zhao, Weizhu Chen

Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2022

PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance.

Qingru Zhang, Simiao Zuo, Chen Liang, Alexander Bukharin, Pengcheng He, Weizhu Chen, Tuo Zhao

Proceedings of the International Conference on Machine Learning, 2022

2021

A Biased Graph Neural Network Sampler with Near-Optimal Regret.

Qingru Zhang, David Wipf, Quan Gan, Le Song

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2019

AdaShift: Decorrelation and Convergence of Adaptive Learning Rate Methods.

Zhiming Zhou, Qingru Zhang, Guansong Lu, Hongwei Wang, Weinan Zhang, Yong Yu

Proceedings of the 7th International Conference on Learning Representations, 2019