Over-Parameterized Deep Neural Networks Have No Strict Local Minima For Any Continuous Activations. - Dawei Li 010; Tian Ding; Ruoyu Sun 001 (CoRR, 2018)

Sub-Optimal Local Minima Exist for Almost All Over-parameterized Neural Networks. - Tian Ding; Dawei Li 010; Ruoyu Sun 001 (CoRR, 2019)

The Global Landscape of Neural Networks: An Overview. - Ruoyu Sun 001; Dawei Li 010; Shiyu Liang; Tian Ding; Rayadurgam Srikant (IEEE Signal Process. Mag., 2020)

RMSprop converges with proper hyper-parameter. - Naichen Shi; Dawei Li 010; Mingyi Hong 001; Ruoyu Sun 001 (ICLR, 2021)

On a Faster R-Linear Convergence Rate of the Barzilai-Borwein Method. - Dawei Li 010; Ruoyu Sun 001 (CoRR, 2021)

On the Benefit of Width for Neural Networks: Disappearance of Basins. - Dawei Li 010; Tian Ding; Ruoyu Sun 001 (SIAM J. Optim., 2022)

Suboptimal Local Minima Exist for Wide Neural Networks with Smooth Activations. - Tian Ding; Dawei Li 010; Ruoyu Sun 001 (Math. Oper. Res., 2022)

NTK-SAP: Improving neural network pruning by aligning training dynamics. - Yite Wang; Dawei Li 010; Ruoyu Sun 001 (ICLR, 2023)