Shiyan Zheng

According to our database, Shiyan Zheng authored at least 15 papers between 2023 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Accelerating grokking through spectral analysis: A multi-method approach to enhancing abstract rule learning in neural networks.

Zhigao Huang, Shiyan Zheng, Miao Pan, Quanfa Li

Knowl. Based Syst., 2026

Removing $$\delta $$-dependence in minimal interpretable model learning: distribution conditions and structural parameters.

Zhigao Huang, Shiyan Zheng, Quanfa Li

J. King Saud Univ. Comput. Inf. Sci., 2026

Dynamic spectral weighting in CausalSelfAttention: Enhancing transformer performance through frequency-based head modulation.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Neurocomputing, 2026

Unlocking the frequency domain in transformers via hybrid spectral gating.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Expert Syst. Appl., 2026

Layer-dependent dynamic spectral weighting for efficient transformer models.

Zhigao Huang, Yanzhong Yu, Shiyan Zheng, Musheng Chen, Quanfa Li

Eng. Appl. Artif. Intell., 2026

Bot Meets Shortcut: How Can LLMs Aid in Handling Unknown Invariance OOD Scenarios?

Shiyan Zheng, Herun Wan, Minnan Luo, Junhang Huang

Proceedings of the Fortieth AAAI Conference on Artificial Intelligence, 2026

2025

Bot Meets Shortcut: How Can LLMs Aid in Handling Unknown Invariance OOD Scenarios?

Shiyan Zheng, Herun Wan, Minnan Luo, Jun Huang

CoRR, November, 2025

Restoring Spectral Symmetry in Gradients: A Normalization Approach for Efficient Neural Network Training.

Zhigao Huang, Nana Gong, Quanfa Li, Tianying Wu, Shiyan Zheng, Miao Pan

Symmetry, 2025

Dynamic Mixture of Experts for Adaptive Computation in Character-Level Transformers.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Inf., 2025

Spectral Adaptive Dropout: Frequency-Based Regularization for Improved Generalization.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Inf., 2025

Spectral momentum integration: hybrid optimization of frequency and time domain gradients.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Frontiers Artif. Intell., 2025

Exploring the impact of fixed theta values in RoPE on character-level language model performance and efficiency.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Frontiers Comput. Sci., 2025

Transformer spectral optimization: From gradient frequency analysis to adaptive spectral integration.

Zhigao Huang, Musheng Chen, Shiyan Zheng

Appl. Soft Comput., 2025

2024

Low-resolution phase shifter-based hybrid precoding for mmWave massive MIMO.

Yipu Yuan, Jung-Lang Yu, Yuzhuo Pan, Shiyan Zheng

EURASIP J. Wirel. Commun. Netw., December, 2024

2023

Design and Implementation of Medical Ultrasound Image Processing System based on MATLAB GUI.

Shiyan Zheng, Haohan Zhang, Haixin Zhao, Bowei Zhang, Yu Zhou, Chuang Han

Proceedings of the 2023 8th International Conference on Multimedia and Image Processing, 2023