Zangwei Zheng

According to our database, Zangwei Zheng authored at least 19 papers between 2021 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DSP: Dynamic Sequence Parallelism for Multi-Dimensional Transformers.

Xuanlei Zhao, Shenggan Cheng, Zangwei Zheng, Zheming Yang, Ziming Liu, Yang You

CoRR, 2024

Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization.

Zirui Zhu, Yong Liu, Zangwei Zheng, Huifeng Guo, Yang You

CoRR, 2024

OpenMoE: An Early Effort on Open Mixture-of-Experts Language Models.

Fuzhao Xue, Zian Zheng, Yao Fu, Jinjie Ni, Zangwei Zheng, Wangchunshu Zhou, Yang You

CoRR, 2024

2023

Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline.

Zangwei Zheng, Xiaozhe Ren, Fuzhao Xue, Yang Luo, Xin Jiang, Yang You

CoRR, 2023

Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models.

Zangwei Zheng, Mingyuan Ma, Kai Wang, Ziheng Qin, Xiangyu Yue, Yang You

CoRR, 2023

InfoBatch: Lossless Training Speed Up by Unbiased Dynamic Data Pruning.

Ziheng Qin, Kai Wang, Zangwei Zheng, Jianyang Gu, Xiangyu Peng, Daquan Zhou, Yang You

CoRR, 2023

Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline.

Zangwei Zheng, Xiaozhe Ren, Fuzhao Xue, Yang Luo, Xin Jiang, Yang You

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

To Repeat or Not To Repeat: Insights from Scaling LLM under Token-Crisis.

Fuzhao Xue, Yao Fu, Wangchunshu Zhou, Zangwei Zheng, Yang You

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

A Study on Transformer Configuration and Training Objective.

Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Yongming Chen, Xin Jiang, Yang You

Proceedings of the International Conference on Machine Learning, 2023

Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models.

Zangwei Zheng, Mingyuan Ma, Kai Wang, Ziheng Qin, Xiangyu Yue, Yang You

Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

CAME: Confidence-guided Adaptive Memory Efficient Optimization.

Yang Luo, Xiaozhe Ren, Zangwei Zheng, Zhuo Jiang, Xin Jiang, Yang You

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

CowClip: Reducing CTR Prediction Model Training Time from 12 Hours to 10 Minutes on 1 GPU.

Zangwei Zheng, Pengtai Xu, Xuan Zou, Da Tang, Zhen Li, Chenguang Xi, Peng Wu, Leqi Zou, Yijie Zhu, Ming Chen, Xiangzhuo Ding, Fuzhao Xue, Ziheng Qin, Youlong Cheng, Yang You

Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence, 2023

2022

Prompt Vision Transformer for Domain Generalization.

Zangwei Zheng, Xiangyu Yue, Kai Wang, Yang You

CoRR, 2022

Deeper vs Wider: A Revisit of Transformer Configuration.

Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Xin Jiang, Yang You

CoRR, 2022

CowClip: Reducing CTR Prediction Model Training Time from 12 hours to 10 minutes on 1 GPU.

Zangwei Zheng, Pengtai Xu, Xuan Zou, Da Tang, Zhen Li, Chenguang Xi, Peng Wu, Leqi Zou, Yijie Zhu, Ming Chen, Xiangzhuo Ding, Fuzhao Xue, Ziheng Qing, Youlong Cheng, Yang You

CoRR, 2022

2021

Multi-source Few-shot Domain Adaptation.

Xiangyu Yue, Zangwei Zheng, Colorado Reed, Hari Prasanna Das, Kurt Keutzer, Alberto L. Sangiovanni-Vincentelli

CoRR, 2021

Sparse-MLP: A Fully-MLP Architecture with Conditional Computation.

Yuxuan Lou, Fuzhao Xue, Zangwei Zheng, Yang You

CoRR, 2021

Scene-aware Learning Network for Radar Object Detection.

Zangwei Zheng, Xiangyu Yue, Kurt Keutzer, Alberto L. Sangiovanni-Vincentelli

Proceedings of the ICMR '21: International Conference on Multimedia Retrieval, 2021

Prototypical Cross-Domain Self-Supervised Learning for Few-Shot Unsupervised Domain Adaptation.

Xiangyu Yue, Zangwei Zheng, Shanghang Zhang, Yang Gao, Trevor Darrell, Kurt Keutzer, Alberto L. Sangiovanni-Vincentelli

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2021