Shwai He

According to our database, Shwai He authored at least 40 papers between 2021 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Cognibit: From Digital Exhaustion to Real-World Connection Through Gamified Territory Control and LLM-Powered Twin Networking.

Wanghao Ye, Sihan Chen, Yiting Wang, Shwai He, Bowei Tian, Guoheng Sun, Ziyi Wang, Ziyao Wang, Yexiao He, Zheyu Shen, Meng Liu, Yuning Zhang, Meng Feng, Yifei Dong, Yanhong Qian, Yang Wang, Siyuan Peng, Yilong Dai, Zhenle Duan, Joshua Liu, Lang Xiong, Hanzhang Qin, Ang Li

CoRR, April, 2026

Demystifying When Pruning Works via Representation Hierarchies.

Shwai He, Guoheng Sun, Haichao Zhang, Yun Fu, Ang Li

CoRR, March, 2026

ThinkJEPA: Empowering Latent World Models with Large Vision-Language Reasoning Model.

Haichao Zhang, Yijiang Li, Shwai He, Tushar Nagarajan, Mingfei Chen, Jianglin Lu, Ang Li, Yun Fu

CoRR, March, 2026

MoEless: Efficient MoE LLM Serving via Serverless Computing.

Hanfei Yu, Bei Ouyang, Shwai He, Ang Li, Hao Wang

CoRR, March, 2026

Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping.

Shwai He, Guoheng Sun, Zheyu Shen, Ang Li

Trans. Mach. Learn. Res., 2026

2025

Making Large Language Models Efficient Dense Retrievers.

Yibin Lei, Shwai He, Ang Li, Andrew Yates

CoRR, December, 2025

Understanding and Harnessing Sparsity in Unified Multimodal Models.

Shwai He, Chaorui Deng, Ang Li, Shen Yan

CoRR, December, 2025

Dense Video Understanding with Gated Residual Tokenization.

Haichao Zhang, Wenhao Chai, Shwai He, Ang Li, Yun Fu

CoRR, September, 2025

DualSparse-MoE: Coordinating Tensor/Neuron-Level Sparsity with Expert Partition and Reconstruction.

Weilin Cai, Le Qin, Shwai He, Junwei Cui, Ang Li, Jiayi Huang

CoRR, August, 2025

CogniPair: From LLM Chatbots to Conscious AI Agents - GNWT-Based Multi-Agent Digital Twins for Social Pairing - Dating & Hiring Applications.

Wanghao Ye, Sihan Chen, Yiting Wang, Shwai He, Bowei Tian, Guoheng Sun, Ziyi Wang, Ziyao Wang, Yexiao He, Zheyu Shen, Meng Liu, Yuning Zhang, Meng Feng, Yang Wang, Siyuan Peng, Yilong Dai, Zhenle Duan, Hanzhang Qin, Ang Li

CoRR, June, 2025

CoIn: Counting the Invisible Reasoning Tokens in Commercial Opaque LLM APIs.

Guoheng Sun, Ziyao Wang, Bowei Tian, Meng Liu, Zheyu Shen, Shwai He, Yexiao He, Wanghao Ye, Yiting Wang, Ang Li

CoRR, May, 2025

SymRTLO: Enhancing RTL Code Optimization with LLMs and Neuron-Inspired Symbolic Reasoning.

Yiting Wang, Wanghao Ye, Ping Guo, Yexiao He, Ziyao Wang, Bowei Tian, Shwai He, Guoheng Sun, Zheyu Shen, Sihan Chen, Ankur Srivastava, Qingfu Zhang, Gang Qu, Ang Li

CoRR, April, 2025

Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of Experts.

Shwai He, Weilin Cai, Jiayi Huang, Ang Li

CoRR, March, 2025

Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques.

Shwai He, Daize Dong, Liang Ding, Ang Li

Trans. Mach. Learn. Res., 2025

Towards counterfactual fairness through auxiliary variables.

Bowei Tian, Ziyao Wang, Shwai He, Wanghao Ye, Guoheng Sun, Yucong Dai, Yongkai Wu, Ang Li

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Router-Tuning: A Simple and Effective Approach for Dynamic Depth.

Shwai He, Tao Ge, Guoheng Sun, Bowei Tian, Xiaoyang Wang, Dong Yu

Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, 2025

2024

Accurate prediction of antibody function and structure using bio-inspired antibody language model.

Hongtai Jing, Zhengtao Gao, Sheng Xu, Tao Shen, Zhangzhi Peng, Shwai He, Tao You, Shuang Ye, Wei Lin, Siqi Sun

Briefings Bioinform., July, 2024

Towards counterfactual fairness thorough auxiliary variables.

Bowei Tian, Ziyao Wang, Shwai He, Wanghao Ye, Guoheng Sun, Yucong Dai, Yongkai Wu, Ang Li

CoRR, 2024

Fair Diagnosis: Leveraging Causal Modeling to Mitigate Medical Bias.

Bowei Tian, Yexiao He, Meng Liu, Yucong Dai, Ziyao Wang, Shwai He, Guoheng Sun, Zheyu Shen, Wanghao Ye, Yongkai Wu, Ang Li

CoRR, 2024

Router-Tuning: A Simple and Effective Approach for Enabling Dynamic-Depth in Transformers.

Shwai He, Tao Ge, Guoheng Sun, Bowei Tian, Xiaoyang Wang, Ang Li, Dong Yu

CoRR, 2024

What Matters in Transformers? Not All Attention is Needed.

Shwai He, Guoheng Sun, Zheyu Shen, Ang Li

CoRR, 2024

Demystifying the Compression of Mixture-of-Experts Through a Unified Framework.

Shwai He, Daize Dong, Liang Ding, Ang Li

CoRR, 2024

RESSA: Repair Sparse Vision-Language Models via Sparse Cross-Modality Adaptation.

Shwai He, Tianlong Chen

CoRR, 2024

Loki: Low-rank Keys for Efficient Sparse Attention.

Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi, Abhinav Bhatele

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Reformatted Alignment.

Run-Ze Fan, Xuefeng Li, Haoyang Zou, Junlong Li, Shwai He, Ethan Chern, Jiewen Hu, Pengfei Liu

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2024, 2024

Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning.

Ming Li, Yong Zhang, Shwai He, Zhitao Li, Hongyu Zhao, Jianzong Wang, Ning Cheng, Tianyi Zhou

Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024

Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning.

Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu, Tianyi Zhou

Proceedings of the Findings of the Association for Computational Linguistics, 2024

2023

Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning.

Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Heng Huang, Jiuxiang Gu, Tianyi Zhou

CoRR, 2023

MerA: Merging Pretrained Adapters For Few-Shot Learning.

Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao

CoRR, 2023

SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution.

Shwai He, Chenbo Jiang, Daize Dong, Liang Ding

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2023

NeuralSlice: Neural 3D Triangle Mesh Reconstruction via Slicing 4D Tetrahedral Meshes.

Chenbo Jiang, Jie Yang, Shwai He, Yu-Kun Lai, Lin Gao

Proceedings of the International Conference on Machine Learning, 2023

Merging Experts into One: Improving Computational Efficiency of Mixture of Experts.

Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

PAD-Net: An Efficient Framework for Dynamic Networks.

Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Cherry Hypothesis: Identifying the Cherry on the Cake for Dynamic Networks.

Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao

CoRR, 2022

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters.

Shwai He, Liang Ding, Daize Dong, Miao Zhang, Dacheng Tao

CoRR, 2022

Vega-MT: The JD Explore Academy Translation System for WMT22.

Changtong Zan, Keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao

CoRR, 2022

When Sparsity Meets Dynamic Convolution.

Shwai He, Yuhang Li, Chenbo Jiang, Shi Gu

CoRR, 2022

Vega-MT: The JD Explore Academy Machine Translation System for WMT22.

Changtong Zan, Keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao

Proceedings of the Seventh Conference on Machine Translation, 2022

SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters.

Shwai He, Liang Ding, Daize Dong, Jeremy Zhang, Dacheng Tao

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2022, 2022

2021

Multi-modal Attention Network for Stock Movements Prediction.

Shwai He, Shi Gu

CoRR, 2021