Zhanpeng Zeng

According to our database, Zhanpeng Zeng authored at least 8 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

IM-Unpack: Training and Inference with Arbitrarily Low Precision Integers.

Zhanpeng Zeng, Karthikeyan Sankaralingam, Vikas Singh

CoRR, 2024

FrameQuant: Flexible Low-Bit Quantization for Transformers.

Harshavardhan Adepu, Zhanpeng Zeng, Li Zhang, Vikas Singh

CoRR, 2024

2023

VCC: Scaling Transformers to 128K Tokens or More by Prioritizing Important Tokens.

Zhanpeng Zeng, Cole Hawkins, Mingyi Hong, Aston Zhang, Nikolaos Pappas, Vikas Singh, Shuai Zheng

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

LookupFFN: Making Transformers Compute-lite for CPU inference.

Zhanpeng Zeng, Michael Davies, Pranav Pulijala, Karthikeyan Sankaralingam, Vikas Singh

Proceedings of the International Conference on Machine Learning, 2023

Controlled Differential Equations on Long Sequences via Non-standard Wavelets.

Sourav Pal, Zhanpeng Zeng, Sathya N. Ravi, Vikas Singh

Proceedings of the International Conference on Machine Learning, 2023

2022

Multi Resolution Analysis (MRA) for Approximate Self-Attention.

Zhanpeng Zeng, Sourav Pal, Jeffery Kline, Glenn Moo Fung, Vikas Singh

Proceedings of the International Conference on Machine Learning, 2022

2021

You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling.

Zhanpeng Zeng, Yunyang Xiong, Sathya N. Ravi, Shailesh Acharya, Glenn Moo Fung, Vikas Singh

Proceedings of the 38th International Conference on Machine Learning, 2021

Nyströmformer: A Nyström-based Algorithm for Approximating Self-Attention.

Yunyang Xiong, Zhanpeng Zeng, Rudrasis Chakraborty, Mingxing Tan, Glenn Fung, Yin Li, Vikas Singh

Proceedings of the Thirty-Fifth AAAI Conference on Artificial Intelligence, 2021