Ziwei He

According to our database, Ziwei He authored at least 30 papers between 2017 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2026

VQKV: High-Fidelity and High-Ratio Cache Compression via Vector-Quantization.

Yixuan Wang, Qingyu Shi, Jiayu Zhou, Dianbo Liu, Ziwei He, Zhouhan Lin

CoRR, March, 2026

One Size Does Not Fit All: Token-Wise Adaptive Compression for KV Cache.

Liming Lu, Kaixi Qiu, Jiayu Zhou, Jushi Kai, Haoyan Zhang, Huanyu Wang, Jingwen Leng, Ziwei He, Zhouhan Lin

CoRR, March, 2026

CoDAR: Continuous Diffusion Language Models are More Powerful Than You Think.

Junzhe Shen, Jieru Zhao, Ziwei He, Zhouhan Lin

CoRR, March, 2026

PonderLM-3: Adaptive Token-Wise Pondering with Differentiable Masking.

He Li, Feichen Song, Boyi Zeng, Shixiang Song, Zhiqin John Xu, Ziwei He, Zhouhan Lin

CoRR, March, 2026

AdaPonderLM: Gated Pondering Language Models with Token-Wise Adaptive Depth.

Shixiang Song, He Li, Zitong Wang, Boyi Zeng, Feichen Song, Yixuan Wang, Zhiqin John Xu, Ziwei He, Zhouhan Lin

CoRR, March, 2026

MOVA: Towards Scalable and Synchronized Video-Audio Generation.

Donghua Yu, Mingshu Chen, Qi Chen, Qi Luo, Qianyi Wu, Qinyuan Cheng, Ruixiao Li, Tianyi Liang, Wenbo Zhang, Wenming Tu, Xiangyu Peng, Yang Gao, Yanru Huo, Ying Zhu, Yinze Luo, Yiyang Zhang, Yuerong Song, Zhe Xu, Zhiyu Zhang, Chenchen Yang, Cheng Chang, Chushu Zhou, Hanfu Chen, Hongnan Ma, Jiaxi Li, Jingqi Tong, Junxi Liu, Ke Chen, Shimin Li, Shiqi Jiang, Songlin Wang, Wei Jiang, Zhaoye Fei, Zhiyuan Ning, Chunguo Li, Chenhui Li, Ziwei He, Zengfeng Huang, Xie Chen, Xipeng Qiu

CoRR, February, 2026

FourierSampler: Unlocking Non-Autoregressive Potential in Diffusion Language Models via Frequency-Guided Generation.

Siyang He, Qiqi Wang, Xiaoran Liu, Hongnan Ma, Yiwei Shi, Yuerong Song, Ying Zhu, Tianyi Liang, Zengfeng Huang, Ziwei He, Xipeng Qiu

CoRR, January, 2026

Sparse-dLLM: Accelerating Diffusion LLMs with Dynamic Cache Eviction.

Yuerong Song, Xiaoran Liu, Ruixiao Li, Zhigeng Liu, Zengfeng Huang, Qipeng Guo, Ziwei He, Xipeng Qiu

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs.

Xiaoran Liu, Yuerong Song, Zhigeng Liu, Zengfeng Huang, Qipeng Guo, Ziwei He, Xipeng Qiu

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

2025

DiRL: An Efficient Post-Training Framework for Diffusion Language Models.

Ying Zhu, Jiaxin Wan, Xiaoran Liu, Siyanag He, Qiqi Wang, Xu Guo, Tianyi Liang, Zengfeng Huang, Ziwei He, Xipeng Qiu

CoRR, December, 2025

Beyond Real: Imaginary Extension of Rotary Position Embeddings for Long-Context LLMs.

Xiaoran Liu, Yuerong Song, Zhigeng Liu, Zengfeng Huang, Qipeng Guo, Zhaoxiang Liu, Shiguo Lian, Ziwei He, Xipeng Qiu

CoRR, December, 2025

AWM: Accurate Weight-Matrix Fingerprint for Large Language Models.

Boyi Zeng, Lin Chen, Ziwei He, Xinbing Wang, Zhouhan Lin

CoRR, October, 2025

Pretraining LLM with Latent Thoughts in Continuous Space.

Boyi Zeng, He Li, Shixiang Song, Yixuan Wang, Ziwei He, Xinbing Wang, Zhouhan Lin

CoRR, September, 2025

Fourier-VLM: Compressing Vision Tokens in the Frequency Domain for Large Vision-Language Models.

Huanyu Wang, Jushi Kai, Haoli Bai, Lu Hou, Bo Jiang, Ziwei He, Zhouhan Lin

CoRR, August, 2025

LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs.

Xiaoran Liu, Zhigeng Liu, Zengfeng Huang, Qipeng Guo, Ziwei He, Xipeng Qiu

CoRR, June, 2025

Beyond Homogeneous Attention: Memory-Efficient LLMs via Fourier-Approximated KV Cache.

Xiaoran Liu, Siyang He, Qiqi Wang, Ruixiao Li, Yuerong Song, Zhigeng Liu, Linlin Li, Qun Liu, Zengfeng Huang, Qipeng Guo, Ziwei He, Xipeng Qiu

CoRR, June, 2025

Pretraining Language Models to Ponder in Continuous Space.

Boyi Zeng, Shixiang Song, Siyuan Huang, Yixuan Wang, He Li, Ziwei He, Xinbing Wang, Zhiyu Li, Zhouhan Lin

CoRR, May, 2025

FreqKV: Frequency Domain Key-Value Compression for Efficient Context Window Extension.

Jushi Kai, Boyi Zeng, Yixuan Wang, Haoli Bai, Ziwei He, Bo Jiang, Zhouhan Lin

CoRR, May, 2025

TreeKV: Smooth Key-Value Cache Compression with Tree Structures.

Ziwei He, Jian Yuan, Haoli Bai, Jingwen Leng, Bo Jiang

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, 2025

WeightedKV: Attention Scores Weighted Key-Value Cache Merging for Large Language Models.

Jian Yuan, Ziwei He, Haoli Bai, Jingwen Leng, Bo Jiang

Proceedings of the 2025 IEEE International Conference on Acoustics, 2025

2024

Fovea Transformer: Efficient Long-Context Modeling with Structured Fine-To-Coarse Attention.

Ziwei He, Jian Yuan, Le Zhou, Jingwen Leng, Bo Jiang

Proceedings of the IEEE International Conference on Acoustics, 2024

Towards Controlled Table-to-Text Generation with Scientific Reasoning.

Zhixin Guo, Jianping Zhou, Jiexing Qi, Mingxuan Yan, Ziwei He, Guanjie Zheng, Zhouhan Lin, Xinbing Wang, Chenghu Zhou

Proceedings of the IEEE International Conference on Acoustics, 2024

2023

Cloud-Edge Collaboration-Based Distribution Network Reconfiguration for Voltage Preventive Control.

Dong Yue, Ziwei He, Chunxia Dou

IEEE Trans. Ind. Informatics, December, 2023

Few-Shot Table-to-Text Generation with Prompt-based Adapter.

Zhixin Guo, Mingxuan Yan, Jiexing Qi, Jianping Zhou, Ziwei He, Zhouhan Lin, Guanjie Zheng, Xinbing Wang

CoRR, 2023

Fourier Transformer: Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator.

Ziwei He, Meng Yang, Minwei Feng, Jingcheng Yin, Xinbing Wang, Jingwen Leng, Zhouhan Lin

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

2022

RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL.

Jiexing Qi, Jingyao Tang, Ziwei He, Xiangpeng Wan, Chenghu Zhou, Xinbing Wang, Quanshi Zhang, Zhouhan Lin

CoRR, 2022

RASAT: Integrating Relational Structures into Pretrained Seq2Seq Model for Text-to-SQL.

Jiexing Qi, Jingyao Tang, Ziwei He, Xiangpeng Wan, Yu Cheng, Chenghu Zhou, Xinbing Wang, Quanshi Zhang, Zhouhan Lin

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

2021

Evaluation of Achievement Effect on Visual Tools for Online Teaching-Learning Program in China During the Covid-19 Pandemic.

Wenyu Wu, Ziwei He, Xinran Yan, Zijian Han, Yaning Li, Chengqi Xue

Proceedings of the Advances in Human Factors in Training, Education, and Learning Sciences, 2021

2019

Half&Half: New Tasks and Benchmarks for Studying Visual Common Sense.

Ashish Singh, Hang Su, SouYoung Jin, Huaizu Jiang, Chetan Manjesh, Geng Luo, Ziwei He, Li Hong, Erik G. Learned-Miller, Rosie Cowell

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2019

2017

A Comparative Study of Different Approaches for Tracking Communities in Evolving Social Networks.

Ziwei He, Etienne Gael Tajeuna, Shengrui Wang, Mohamed Bouguessa

Proceedings of the 2017 IEEE International Conference on Data Science and Advanced Analytics, 2017