Enhancing Inference Efficiency of Large Language Models: Investigating Optimization Strategies and Architectural Innovations. - Georgy Tyukin (CoRR, 2024)

Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models. - Georgy Tyukin; Gbètondji J.-S. Dovonon; Jean Kaddour; Pasquale Minervini (CoRR, 2024)