Farewell to Length Extrapolation, a Training-Free Infinite Context with Finite Attention Scope. - Xiaoran Liu; Qipeng Guo; Yuerong Song; Zhigeng Liu; Kai Lv 001; Hang Yan 001; Linlin Li 001; Qun Liu 001; Xipeng Qiu (CoRR, 2024)

ReAttention: Training-Free Infinite Context with Finite Attention Scope. - Xiaoran Liu; Ruixiao Li; Zhigeng Liu; Qipeng Guo; Yuerong Song; Kai Lv 001; Hang Yan 001; Linlin Li 001; Qun Liu 001; Xipeng Qiu (ICLR, 2025)

Thus Spake Long-Context Large Language Model. - Xiaoran Liu; Ruixiao Li; Mianqiu Huang; Zhigeng Liu; Yuerong Song; Qipeng Guo; Siyang He; Qiqi Wang 014; Linlin Li 001; Qun Liu 001; Yaqian Zhou 001; Xuanjing Huang 001; et al. (CoRR, 2025)

Beyond Homogeneous Attention: Memory-Efficient LLMs via Fourier-Approximated KV Cache. - Xiaoran Liu; Siyang He; Qiqi Wang 014; Ruixiao Li; Yuerong Song; Zhigeng Liu; Linlin Li 001; Qun Liu 001; Zengfeng Huang; Qipeng Guo; Ziwei He; Xipeng Qiu (CoRR, 2025)

Sparse-dLLM: Accelerating Diffusion LLMs with Dynamic Cache Eviction. - Yuerong Song; Xiaoran Liu; Ruixiao Li; Zhigeng Liu; Zengfeng Huang; Qipeng Guo; Ziwei He; Xipeng Qiu (CoRR, 2025)