Joint transceiver design and base station clustering for heterogeneous networks. - Mingyi Hong 001; Meisam Razaviyayn; Ruoyu Sun 001; Zhi-Quan Luo (ACSCC, 2012)

Optimal joint base station assignment and power allocation in a cellular network. - Ruoyu Sun 001; Mingyi Hong 001; Zhi-Quan Luo (SPAWC, 2012)

Joint Base Station Clustering and Beamformer Design for Partial Coordinated Transmission in Heterogenous Networks - Mingyi Hong 001; Ruoyu Sun 001; Hadi Baligh; Zhi-Quan Luo (CoRR, 2012)

Robust SINR-Constrained MISO Downlink Beamforming: When is Semidefinite Programming Relaxation Tight? - Enbin Song; Qingjiang Shi; Maziar Sanjabi; Ruoyu Sun 001; Zhi-Quan Luo (EURASIP J. Wirel. Commun. Netw., 2012)

Long-term transmit point association for coordinated multipoint transmission by stochastic optimization. - Ruoyu Sun 001; Hadi Baligh; Zhi-Quan Luo (SPAWC, 2013)

Two Performance-limiting Factors for Interference Alignment: Channel Diversity Order and the Number of Data Streams Per User. - Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2013)

Joint Base Station Clustering and Beamformer Design for Partial Coordinated Transmission in Heterogeneous Networks. - Mingyi Hong 001; Ruoyu Sun 001; Hadi Baligh; Zhi-Quan Luo (IEEE J. Sel. Areas Commun., 2013)

Globally optimal joint uplink base station association and power control for max-min fairness. - Ruoyu Sun 001; Zhi-Quan Luo (ICASSP, 2014)

Cross Layer Provision of Future Cellular Networks. - Hadi Baligh; Mingyi Hong 001; Wei-Cheng Liao; Zhi-Quan Luo; Meisam Razaviyayn; Maziar Sanjabi; Ruoyu Sun 001 (CoRR, 2014)

Cross-Layer Provision of Future Cellular Networks: A WMMSE-based approach. - Hadi Baligh; Mingyi Hong 001; Wei-Cheng Liao; Zhi-Quan Luo; Meisam Razaviyayn; Maziar Sanjabi; Ruoyu Sun 001 (IEEE Signal Process. Mag., 2014)

Guaranteed Matrix Completion via Nonconvex Factorization. - Ruoyu Sun 001; Zhi-Quan Luo (FOCS, 2015)

Improved Iteration Complexity Bounds of Cyclic Block Coordinate Descent for Convex Problems. - Ruoyu Sun 001; Mingyi Hong 001 (NIPS, 2015)

Interference alignment via Feasible Point Pursuit. - Aritra Konar; Ruoyu Sun 001; Nicholas D. Sidiropoulos; Zhi-Quan Luo (SPAWC, 2015)

Globally Optimal Joint Uplink Base Station Association and Beamforming. - Wei Liu 012; Ruoyu Sun 001; Zhi-Quan Luo; Jiandong Li 001 (CoRR, 2015)

Joint Downlink Base Station Association and Power Control for Max-Min Fairness: Computation and Complexity. - Ruoyu Sun 001; Mingyi Hong 001; Zhi-Quan Luo (IEEE J. Sel. Areas Commun., 2015)

Interference Alignment Using Finite and Dependent Channel Extensions: The Single Beam Case. - Ruoyu Sun 001; Zhi-Quan Luo (IEEE Trans. Inf. Theory, 2015)

Optimization algorithms for big data with application in wireless networks. - Mingyi Hong 001; Wei-Cheng Liao; Ruoyu Sun 001; Zhi-Quan Luo (Big Data over Networks, 2016)

Worst-case Complexity of Cyclic Coordinate Descent: $O(n^2)$ Gap with Randomized Version. - Ruoyu Sun 001; Yinyu Ye 001 (CoRR, 2016)

Guaranteed Matrix Completion via Non-Convex Factorization. - Ruoyu Sun 001; Zhi-Quan Luo (IEEE Trans. Inf. Theory, 2016)

Understanding the Loss Surface of Single-Layered Neural Networks for Binary Classification. - Shiyu Liang; Ruoyu Sun 001; Yixuan Li 001; R. Srikant 001 (ICLR (Workshop), 2018)

Understanding the Loss Surface of Neural Networks for Binary Classification. - Shiyu Liang; Ruoyu Sun 001; Yixuan Li 001; Rayadurgam Srikant (ICML, 2018)

Adding One Neuron Can Eliminate All Bad Local Minima. - Shiyu Liang; Ruoyu Sun 001; Jason D. Lee; R. Srikant 001 (NeurIPS, 2018)

Over-Parameterized Deep Neural Networks Have No Strict Local Minima For Any Continuous Activations. - Dawei Li 010; Tian Ding; Ruoyu Sun 001 (CoRR, 2018)

Max-Sliced Wasserstein Distance and Its Use for GANs. - Ishan Deshpande; Yuan-Ting Hu; Ruoyu Sun 001; Ayis Pyrros; Nasir Siddiqui; Sanmi Koyejo; Zhizhen Zhao 001; David A. Forsyth; Alexander G. Schwing (CVPR, 2019)

On the Convergence of A Class of Adam-Type Algorithms for Non-Convex Optimization. - Xiangyi Chen; Sijia Liu 001; Ruoyu Sun 001; Mingyi Hong 001 (ICLR (Poster), 2019)

Understanding Limitation of Two Symmetrized Orders by Worst-case Complexity. - Peijun Xiao; Zhisheng Xiao; Ruoyu Sun 001 (CoRR, 2019)

Sub-Optimal Local Minima Exist for Almost All Over-parameterized Neural Networks. - Tian Ding; Dawei Li 010; Ruoyu Sun 001 (CoRR, 2019)

Optimization for deep learning: theory and algorithms. - Ruoyu Sun 001 (CoRR, 2019)

Globally Optimal Joint Uplink Base Station Association and Beamforming. - Wei Liu 012; Ruoyu Sun 001; Zhi-Quan Luo (IEEE Trans. Commun., 2019)

Towards a Better Global Loss Landscape of GANs. - Ruoyu Sun 001; Tiantian Fang; Alexander G. Schwing (NeurIPS, 2020)

A Single-Loop Smoothed Gradient Descent-Ascent Algorithm for Nonconvex-Concave Min-Max Problems. - Jiawei Zhang 007; Peijun Xiao; Ruoyu Sun 001; Zhi-Quan Luo (NeurIPS, 2020)

DEED: A General Quantization Scheme for Communication Efficiency in Bits. - Tian Ye 007; Peijun Xiao; Ruoyu Sun 001 (CoRR, 2020)

Global Convergence and Induced Kernels of Gradient-Based Meta-Learning with Neural Nets. - Haoxiang Wang 003; Ruoyu Sun 001; Bo Li 026 (CoRR, 2020)

Landscape of Sparse Linear Network: A Brief Investigation. - Dachao Lin; Ruoyu Sun 001; Zhihua Zhang 004 (CoRR, 2020)

On the Efficiency of Random Permutation for ADMM and Coordinate Descent. - Ruoyu Sun 001; Zhi-Quan Luo; Yinyu Ye 001 (Math. Oper. Res., 2020)

The Global Landscape of Neural Networks: An Overview. - Ruoyu Sun 001; Dawei Li 010; Shiyu Liang; Tian Ding; Rayadurgam Srikant (IEEE Signal Process. Mag., 2020)

PenDer: Incorporating Shape Constraints via Penalized Derivatives. - Akhil Gupta; Lavanya Marla; Ruoyu Sun 001; Naman Shukla; Arinbjörn Kolbeinsson (AAAI, 2021)

RMSprop converges with proper hyper-parameter. - Naichen Shi; Dawei Li 010; Mingyi Hong 001; Ruoyu Sun 001 (ICLR, 2021)

Faster Directional Convergence of Linear Neural Networks under Spherically Symmetric Data. - Dachao Lin; Ruoyu Sun 001; Zhihua Zhang 004 (NeurIPS, 2021)

When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work. - Jiawei Zhang 007; Yushun Zhang; Mingyi Hong 001; Ruoyu Sun 001; Zhi-Quan Luo (NeurIPS, 2021)

On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method. - Dawei Li 010; Ruoyu Sun 001 (CoRR, 2021)

Achieving Small Test Error in Mildly Overparameterized Neural Networks. - Shiyu Liang; Ruoyu Sun 001; R. Srikant 001 (CoRR, 2021)

Momentum Doesn't Change the Implicit Bias. - Bohan Wang; Qi Meng; Huishuai Zhang; Ruoyu Sun 001; Wei Chen 034; Zhi-Ming Ma (CoRR, 2021)

Federated Semi-Supervised Learning with Class Distribution Mismatch. - Zhiguo Wang 005; Xintong Wang; Ruoyu Sun 001; Tsung-Hui Chang (CoRR, 2021)

Towards Understanding the Impact of Model Size on Differential Private Classification. - Yinchen Shen; Zhiguo Wang 005; Ruoyu Sun 001; Xiaojing Shen (CoRR, 2021)

Worst-case complexity of cyclic coordinate descent: O(n2) gap with randomized version. - Ruoyu Sun 001; Yinyu Ye 001 (Math. Program., 2021)

Two Symmetrized Coordinate Descent Methods Can Be O(n2) Times Slower Than the Randomized Version. - Peijun Xiao; Zhisheng Xiao; Ruoyu Sun 001 (SIAM J. Optim., 2021)

Separation of Metabolites and Macromolecules for Short-TE 1H-MRSI Using Learned Component-Specific Representations. - Yahang Li; Zepeng Wang 001; Ruoyu Sun 001; Fan Lam (IEEE Trans. Medical Imaging, 2021)

Global Convergence of MAML and Theory-Inspired Neural Architecture Search for Few-Shot Learning. - Haoxiang Wang 003; Yite Wang; Ruoyu Sun 001; Bo Li 026 (CVPR, 2022)

DigGAN: Discriminator gradIent Gap Regularization for GAN Training with Limited Data. - Tiantian Fang; Ruoyu Sun 001; Alexander G. Schwing (NeurIPS, 2022)

Does Momentum Change the Implicit Regularization on Separable Data? - Bohan Wang; Qi Meng; Huishuai Zhang; Ruoyu Sun 001; Wei Chen 034; Zhi-Ming Ma; Tie-Yan Liu (NeurIPS, 2022)

Stability Analysis and Generalization Bounds of Adversarial Training. - Jiancong Xiao; Yanbo Fan; Ruoyu Sun 001; Jue Wang 001; Zhi-Quan Luo (NeurIPS, 2022)

Adam Can Converge Without Any Modification On Update Rules. - Yushun Zhang; Congliang Chen; Naichen Shi; Ruoyu Sun 001; Zhi-Quan Luo (NeurIPS, 2022)

On the landscape of one-hidden-layer sparse networks and beyond. - Dachao Lin; Ruoyu Sun 001; Zhihua Zhang 004 (Artif. Intell., 2022)

Adversarial Rademacher Complexity of Deep Neural Networks. - Jiancong Xiao; Yanbo Fan; Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2022)

On the Benefit of Width for Neural Networks: Disappearance of Basins. - Dawei Li 010; Tian Ding; Ruoyu Sun 001 (SIAM J. Optim., 2022)

Suboptimal Local Minima Exist for Wide Neural Networks with Smooth Activations. - Tian Ding; Dawei Li 010; Ruoyu Sun 001 (Math. Oper. Res., 2022)

Revisiting Landscape Analysis in Deep Neural Networks: Eliminating Decreasing Paths to Infinity. - Shiyu Liang; Ruoyu Sun 001; R. Srikant 001 (SIAM J. Optim., 2022)

A GNN-Guided Predict-and-Search Framework for Mixed-Integer Linear Programming. - Qingyu Han; Linxin Yang; Qian Chen; Xiang Zhou; Dong Zhang; Akang Wang; Ruoyu Sun 001; Xiaodong Luo (ICLR, 2023)

NTK-SAP: Improving neural network pruning by aligning training dynamics. - Yite Wang; Dawei Li 010; Ruoyu Sun 001 (ICLR, 2023)

Balanced Training for Sparse GANs. - Yite Wang; Jing Wu 020; Naira Hovakimyan; Ruoyu Sun 001 (NeurIPS, 2023)

PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization. - Jiancong Xiao; Ruoyu Sun 001; Zhi-Quan Luo (NeurIPS, 2023)

Invariant Layers for Graphs with Nodes of Different Types. - Dmitry Rybin; Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2023)

Double Dynamic Sparse Training for GANs. - Yite Wang; Jing Wu 020; Naira Hovakimyan; Ruoyu Sun 001 (CoRR, 2023)

Restricted Generative Projection for One-Class Classification and Anomaly Detection. - Feng Xiao; Ruoyu Sun 001; Jicong Fan 001 (CoRR, 2023)

AceGPT, Localizing Large Language Models in Arabic. - Huang Huang; Fei Yu; Jianqing Zhu; Xuening Sun; Hao Cheng; Dingjie Song; Zhihong Chen; Abdulmohsen Alharthi; Bang An 004; Ziche Liu; Zhiyi Zhang 007; Junying Chen; et al. (CoRR, 2023)

How Graph Neural Networks Learn: Lessons from Training Dynamics in Function Space. - Chenxiao Yang; Qitian Wu; David Wipf; Ruoyu Sun 001; Junchi Yan (CoRR, 2023)

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models. - Ziniu Li; Tian Xu 003; Yushun Zhang; Yang Yu 001; Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2023)

Bridging the Gap: Rademacher Complexity in Robust and Standard Generalization. - Jiancong Xiao; Ruoyu Sun 001; Qi Long; Weijie Su 001 (COLT, 2024)

Unlocking Black-Box Prompt Tuning Efficiency via Zeroth-Order Optimization. - Heshen Zhan; Congliang Chen; Tian Ding; Ziniu Li; Ruoyu Sun 001 (EMNLP (Findings), 2024)

LEMON: Lossless model expansion. - Yite Wang; Jiahao Su; Hanlin Lu; Cong Xie; Tianyi Liu; Jianbo Yuan; Haibin Lin; Ruoyu Sun 001; Hongxia Yang (ICLR, 2024)

ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models. - Ziniu Li; Tian Xu 003; Yushun Zhang; Zhihang Lin; Yang Yu 001; Ruoyu Sun 001; Zhi-Quan Luo (ICML, 2024)

PDHG-Unrolled Learning-to-Optimize Method for Large-Scale Linear Programming. - Bingheng Li; Linxin Yang; Yupeng Chen; Senmiao Wang; Haitao Mao; Qian Chen; Yao Ma 001; Akang Wang; Tian Ding; Jiliang Tang; Ruoyu Sun 001 (ICML, 2024)

How Graph Neural Networks Learn: Lessons from Training Dynamics. - Chenxiao Yang; Qitian Wu; David Wipf; Ruoyu Sun 001; Junchi Yan (ICML, 2024)

Provable Adaptivity of Adam under Non-uniform Smoothness. - Bohan Wang; Yushun Zhang; Huishuai Zhang; Qi Meng; Ruoyu Sun 001; Zhi-Ming Ma; Tie-Yan Liu; Zhi-Quan Luo; Wei Chen 034 (KDD, 2024)

AceGPT, Localizing Large Language Models in Arabic. - Huang Huang; Fei Yu; Jianqing Zhu; Xuening Sun; Hao Cheng; Dingjie Song; Zhihong Chen; Mosen Alharthi; Bang An 004; Juncai He 001; Ziche Liu; Junying Chen; et al. (NAACL-HLT, 2024)

SymILO: A Symmetry-Aware Learning Framework for Integer Linear Optimization. - Qian Chen; Tianjian Zhang; Linxin Yang; Qingyu Han; Akang Wang; Ruoyu Sun 001; Xiaodong Luo; Tsung-Hui Chang (NeurIPS, 2024)

On the Power of Small-size Graph Neural Networks for Linear Programming. - Qian Li; Tian Ding; Linxin Yang; Minghui Ouyang; Qingjiang Shi; Ruoyu Sun 001 (NeurIPS, 2024)

Why Transformers Need Adam: A Hessian Perspective. - Yushun Zhang; Congliang Chen; Tian Ding; Ziniu Li; Ruoyu Sun 001; Zhi-Quan Luo (NeurIPS, 2024)

On the Convergence of Adam under Non-uniform Smoothness: Separability from SGDM and Beyond. - Bohan Wang; Huishuai Zhang; Qi Meng; Ruoyu Sun 001; Zhi-Ming Ma; Wei Chen 034 (CoRR, 2024)

Adam-mini: Use Fewer Learning Rates To Gain More. - Yushun Zhang; Congliang Chen; Ziniu Li; Tian Ding; Chenwei Wu 002; Yinyu Ye 001; Zhi-Quan Luo; Ruoyu Sun 001 (CoRR, 2024)

MoFO: Momentum-Filtered Optimizer for Mitigating Forgetting in LLM Fine-Tuning. - Yupeng Chen; Senmiao Wang; Zhihang Lin; Zeyu Qin; Yushun Zhang; Tian Ding; Ruoyu Sun 001 (CoRR, 2024)

Entropic Distribution Matching in Supervised Fine-tuning of LLMs: Less Overfitting and Better Diversity. - Ziniu Li; Congliang Chen; Tian Xu 003; Zeyu Qin; Jiancong Xiao; Ruoyu Sun 001; Zhi-Quan Luo (CoRR, 2024)

Archilles' Heel in Semi-open LLMs: Hiding Bottom against Recovery Attacks. - Hanbo Huang; Yihan Li; Bowen Jiang; Lin Liu; Ruoyu Sun 001; Zhuotao Liu; Shiyu Liang (CoRR, 2024)

An Efficient Unsupervised Framework for Convex Quadratic Programs via Deep Unrolling. - Linxin Yang; Bingheng Li; Tian Ding; Jianghua Wu; Akang Wang; Yuyi Wang 006; Jiliang Tang; Ruoyu Sun 001; Xiaodong Luo (CoRR, 2024)

Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion. - Jianqing Zhu; Huang Huang; Zhihang Lin; Juhao Liang; Zhengyang Tang; Khalid Almubarak; Abdulmohsen Alharthik; Bang An 004; Juncai He 001; Xiangbo Wu; Fei Yu; Junying Chen; et al. (CoRR, 2024)

Second Language (Arabic) Acquisition of LLMs via Progressive Vocabulary Expansion. - Jianqing Zhu; Huang Huang; Zhihang Lin; Juhao Liang; Zhengyang Tang; Khalid Almubarak; Mosen Alharthi; Bang An 004; Juncai He 001; Xiangbo Wu; Fei Yu; Junying Chen; et al. (ACL (1), 2025)

When GNNs meet symmetry in ILPs: an orbit-based feature augmentation approach. - Qian Chen; Lei Li 030; Qian Li; Jianghua Wu; Akang Wang; Ruoyu Sun 001; Xiaodong Luo; Tsung-Hui Chang; Qingjiang Shi (ICLR, 2025)

Preserving Diversity in Supervised Fine-Tuning of Large Language Models. - Ziniu Li; Congliang Chen; Tian Xu 003; Zeyu Qin; Jiancong Xiao; Zhi-Quan Luo; Ruoyu Sun 001 (ICLR, 2025)

Towards Explaining the Power of Constant-depth Graph Neural Networks for Structured Linear Programming. - Qian Li; Minghui Ouyang; Tian Ding; Yuyi Wang 006; Qingjiang Shi; Ruoyu Sun 001 (ICLR, 2025)

Adam-mini: Use Fewer Learning Rates To Gain More. - Yushun Zhang; Congliang Chen; Ziniu Li; Tian Ding; Chenwei Wu 002; Diederik P. Kingma; Yinyu Ye 001; Zhi-Quan Luo; Ruoyu Sun 001 (ICLR, 2025)

Exploring and Improving Initialization for Deep Graph Neural Networks: A Signal Propagation Perspective. - Senmiao Wang; Yupeng Chen; Yushun Zhang; Ruoyu Sun 001; Tian Ding (Trans. Mach. Learn. Res., 2025)

Enabling Scalable Oversight via Self-Evolving Critic. - Zhengyang Tang; Ziniu Li; Zhenyang Xiao; Tian Ding; Ruoyu Sun 001; Benyou Wang; Dayiheng Liu; Fei Huang 005; Tianyu Liu 001; Bowen Yu 002; Junyang Lin (CoRR, 2025)

When GNNs meet symmetry in ILPs: an orbit-based feature augmentation approach. - Chen Qian 006; Lei Li 030; Qian Li; Jianghua Wu; Akang Wang; Ruoyu Sun 001; Xiaodong Luo; Tsung-Hui Chang; Qingjiang Shi (CoRR, 2025)

RealCritic: Towards Effectiveness-Driven Evaluation of Language Model Critiques. - Zhengyang Tang; Ziniu Li; Zhenyang Xiao; Tian Ding; Ruoyu Sun 001; Benyou Wang; Dayiheng Liu; Fei Huang 005; Tianyu Liu 001; Bowen Yu 002; Junyang Lin (CoRR, 2025)

Towards Quantifying the Hessian Structure of Neural Networks. - Zhaorui Dong; Yushun Zhang; Zhi-Quan Luo; Jianfeng Yao; Ruoyu Sun 001 (CoRR, 2025)

Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives. - Yajiao Liu; Congliang Chen; Junchi Yang; Ruoyu Sun 001 (CoRR, 2025)

CoRT: Code-integrated Reasoning within Thinking. - Chengpeng Li 001; Zhengyang Tang; Ziniu Li; Mingfeng Xue; Keqin Bao; Tian Ding; Ruoyu Sun 001; Benyou Wang; Xiang Wang 010; Junyang Lin; Dayiheng Liu (CoRR, 2025)

Bridging Formal Language with Chain-of-Thought Reasoning to Geometry Problem Solving. - Tianyun Yang; Yunwen Li; Ziniu Li; Zhihang Lin; Ruoyu Sun 001; Tian Ding (CoRR, 2025)