On the Convergence of AdaGrad with Momentum for Training Deep Neural Networks. - Fangyu Zou; Li Shen 005 (CoRR, 2018)

A Sufficient Condition for Convergences of Adam and RMSProp. - Fangyu Zou; Li Shen 005; Zequn Jie; Weizhong Zhang; Wei Liu 005 (CVPR, 2019)

Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration. - Congliang Chen; Li Shen 005; Fangyu Zou; Wei Liu 005 (J. Mach. Learn. Res., 2022)

A Unified Analysis of AdaGrad With Weighted Aggregation and Momentum Acceleration. - Li Shen 008; Congliang Chen; Fangyu Zou; Zequn Jie; Ju Sun; Wei Liu 005 (IEEE Trans. Neural Networks Learn. Syst., 2024)