Faster Algorithm for Structured John Ellipsoid Computation. - Zhao Song 002; Xin Yang 017; Yuanyuan Yang 005; Tianyi Zhou 002 (CoRR, 2022)

Fast Heavy Inner Product Identification Between Weights and Inputs in Neural Network Training. - Lianke Qin; Saayan Mitra; Zhao Song 002; Yuanyuan Yang 005; Tianyi Zhou 002 (IEEE Big Data, 2023)

Space-Efficient Interior Point Method, with Applications to Linear Programming and Maximum Weight Bipartite Matching. - S. Cliff Liu; Zhao Song 002; Hengjie Zhang; Lichen Zhang 003; Tianyi Zhou 002 (ICALP, 2023)

Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time. - Zichang Liu; Jue Wang; Tri Dao; Tianyi Zhou 002; Binhang Yuan; Zhao Song 002; Anshumali Shrivastava; Ce Zhang 001; Yuandong Tian; Christopher Ré; Beidi Chen (ICML, 2023)

Module-wise Adaptive Distillation for Multimodality Foundation Models. - Chen Liang 006; Jiahui Yu; Ming-Hsuan Yang 001; Matthew Brown 001; Yin Cui; Tuo Zhao; Boqing Gong; Tianyi Zhou 002 (NeurIPS, 2023)

Faster Sinkhorn's Algorithm with Small Treewidth. - Zhao Song 002; Tianyi Zhou 002 (CoRR, 2023)

Solving Regularized Exp, Cosh and Sinh Regression Problems. - Zhihang Li; Zhao Song 002; Tianyi Zhou 002 (CoRR, 2023)

Algorithm and Hardness for Dynamic Attention Maintenance in Large Language Models. - Jan van den Brand; Zhao Song 002; Tianyi Zhou 002 (CoRR, 2023)

The Closeness of In-Context Learning and Weight Shifting for Softmax Regression. - Shuai Li 010; Zhao Song 002; Yu Xia 007; Tong Yu 001; Tianyi Zhou 002 (CoRR, 2023)

A Mathematical Abstraction for Balancing the Trade-off Between Creativity and Reality in Large Language Models. - Ritwik Sinha; Zhao Song 002; Tianyi Zhou 002 (CoRR, 2023)

H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models. - Zhenyu Zhang 015; Ying Sheng 007; Tianyi Zhou 002; Tianlong Chen 001; Lianmin Zheng; Ruisi Cai; Zhao Song 002; Yuandong Tian; Christopher Ré; Clark W. Barrett; Zhangyang Wang; Beidi Chen (CoRR, 2023)

Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention. - Yichuan Deng 002; Zhao Song 002; Tianyi Zhou 002 (CoRR, 2023)