Fine-tune Language Models to Approximate Unbiased In-context Learning. - Timothy Chu; Zhao Song 002; Chiwun Yang (CoRR, 2023)

An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent. - Zhao Song 002; Chiwun Yang (CoRR, 2023)

Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights. - Yichuan Deng 002; Zhao Song 002; Shenghao Xie; Chiwun Yang (CoRR, 2023)

A Theoretical Insight into Attack and Defense of Gradient Leakage in Transformer. - Chenyang Li; Zhao Song 002; Weixin Wang 002; Chiwun Yang (CoRR, 2023)

One Pass Streaming Algorithm for Super Long Token Attention Approximation in Sublinear Space. - Raghav Addanki; Chenyang Li; Zhao Song 002; Chiwun Yang (CoRR, 2023)

How to Protect Copyright Data in Optimization of Large Language Models? - Timothy Chu; Zhao Song 002; Chiwun Yang (AAAI, 2024)

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence. - Yichuan Deng 002; Zhao Song 002; Chiwun Yang (CoRR, 2024)

Attention is Naturally Sparse with Gaussian Distributed Input. - Yichuan Deng 002; Zhao Song 002; Chiwun Yang (CoRR, 2024)

Toward Infinite-Long Prefix in Transformer. - Jiuxiang Gu; Yingyu Liang; Zhenmei Shi; Zhao Song 002; Chiwun Yang (CoRR, 2024)

Unlocking the Theory Behind Scaling 1-Bit Neural Networks. - Majid Daliri; Zhao Song 002; Chiwun Yang (CoRR, 2024)

Unlock the Theory behind Scaling 1-bit Neural Networks. - Majid Daliri; Zhao Song 002; Chiwun Yang (CPAL, 2025)

Curse of Attention: A Kernel-Based Perspective for Why Transformers Fail to Generalize on Time Series Forecasting and Beyond. - Yekun Ke; Yingyu Liang; Zhenmei Shi; Zhao Song 002; Chiwun Yang (CPAL, 2025)

Video Latent Flow Matching: Optimal Polynomial Projections for Video Interpolation and Extrapolation. - Yang Cao 020; Zhao Song 002; Chiwun Yang (CoRR, 2025)

ParallelComp: Parallel Long-Context Compressor for Length Extrapolation. - Jing Xiong; Jianghan Shen; Chuanyang Zheng; Zhongwei Wan; Chenyang Zhao; Chiwun Yang; Fanghua Ye 001; Hongxia Yang; Lingpeng Kong; Ngai Wong 001 (CoRR, 2025)

Theoretical Foundation of Flow-Based Time Series Generation: Provable Approximation, Generalization, and Efficiency. - Jiangxuan Long 001; Zhao Song 002; Chiwun Yang (CoRR, 2025)