Yichuan Deng

According to our database, Yichuan Deng authored at least 22 papers between 2022 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

OpenThoughts: Data Recipes for Reasoning Models.

Etash Kumar Guha, Ryan Marten, Sedrick Keh, Negin Raoof, Georgios Smyrnis, Hritik Bansal, Marianna Nezhurina, Jean Mercat, Trung Vu, Zayne Sprague, Ashima Suvarna, Benjamin Feuer, Liangyu Chen, Zaid Khan, Eric Frankel, Sachin Grover, Caroline Choi, Niklas Muennighoff, Shiye Su, Wanjia Zhao, John Yang, Shreyas Pimpalgaonkar, Kartik Sharma, Charlie Cheng-Jie Ji, Yichuan Deng, Sarah M. Pratt, Vivek Ramanujan, Jon Saad-Falcon, Jeffrey Li, Achal Dave, Alon Albalak, Kushal Arora, Blake Wulfe, Chinmay Hegde, Greg Durrett, Sewoong Oh, Mohit Bansal, Saadia Gabriel, Aditya Grover, Kai-Wei Chang, Vaishaal Shankar, Aaron Gokaslan, Mike A. Merrill, Tatsunori Hashimoto, Yejin Choi, Jenia Jitsev, Reinhard Heckel, Maheswaran Sathiamoorthy, Alexandros G. Dimakis, Ludwig Schmidt

CoRR, June, 2025

Discrepancy Minimization in Input-Sparsity Time.

Yichuan Deng, Xiaoyu Li, Zhao Song, Omri Weinstein

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Streaming Kernel PCA Algorithm With Small Space.

Yichuan Deng, Jiangxuan Long, Zhao Song, Zifan Wang, Han Zhang

Proceedings of the Conference on Parsimony and Learning, 2025

Why Softmax Attention Outperforms Linear Attention.

Yichuan Deng, Zhao Song, Kaijun Yuan, Tianyi Zhou

Proceedings of the IEEE International Conference on Big Data, 2025

2024

Attention is Naturally Sparse with Gaussian Distributed Input.

Yichuan Deng, Zhao Song, Chiwun Yang

CoRR, 2024

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence.

Yichuan Deng, Zhao Song, Chiwun Yang

CoRR, 2024

Zero-th Order Algorithm for Softmax Attention Optimization.

Yichuan Deng, Zhihang Li, Sridhar Mahadevan, Zhao Song

Proceedings of the IEEE International Conference on Big Data, 2024

2023

Unmasking Transformers: A Theoretical Approach to Data Recovery via Attention Weights.

Yichuan Deng, Zhao Song, Shenghao Xie, Chiwun Yang

CoRR, 2023

Superiority of Softmax: Unveiling the Performance Edge Over Linear Attention.

Yichuan Deng, Zhao Song, Tianyi Zhou

CoRR, 2023

Clustered Linear Contextual Bandits with Knapsacks.

Yichuan Deng, Michalis Mamakos, Zhao Song

CoRR, 2023

Convergence of Two-Layer Regression with Nonlinear Units.

Yichuan Deng, Zhao Song, Shenghao Xie

CoRR, 2023

Efficient Algorithm for Solving Hyperbolic Programs.

Yichuan Deng, Zhao Song, Lichen Zhang, Ruizhe Zhang

CoRR, 2023

Faster Robust Tensor Power Method for Arbitrary Order.

Yichuan Deng, Zhao Song, Junze Yin

CoRR, 2023

Attention Scheme Inspired Softmax Regression.

Yichuan Deng, Zhihang Li, Zhao Song

CoRR, 2023

Randomized and Deterministic Attention Sparsification Algorithms for Over-parameterized Feature Dimension.

Yichuan Deng, Sridhar Mahadevan, Zhao Song

CoRR, 2023

An Improved Sample Complexity for Rank-1 Matrix Sensing.

Yichuan Deng, Zhihang Li, Zhao Song

CoRR, 2023

Streaming Kernel PCA Algorithm With Small Space.

Yichuan Deng, Zhao Song, Zifan Wang, Han Zhang

CoRR, 2023

Solving Tensor Low Cycle Rank Approximation.

Yichuan Deng, Yeqi Gao, Zhao Song

Proceedings of the IEEE International Conference on Big Data, 2023

2022

Dynamic Kernel Sparsifiers.

Yichuan Deng, Wenyu Jin, Zhao Song, Xiaorui Sun, Omri Weinstein

CoRR, 2022

Discrepancy Minimization in Input-Sparsity Time.

Yichuan Deng, Zhao Song, Omri Weinstein

CoRR, 2022

A Nearly Optimal Size Coreset Algorithm with Nearly Linear Time.

Yichuan Deng, Zhao Song, Yitan Wang, Yuanyuan Yang

CoRR, 2022

Fast Distance Oracles for Any Symmetric Norm.

Yichuan Deng, Zhao Song, Omri Weinstein, Ruizhe Zhang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022