Scalable Parameter and Memory Efficient Pretraining for LLM: Recent Algorithmic Advances and Benchmarking. - Athanasios Glentis; Jiaxiang Li; Qiulin Shang; Andi Han; Ioannis C. Tsaknakis; Quan Wei 001; Mingyi Hong 001 (CoRR, 2025)

A Minimalist Optimizer Design for LLM Pretraining. - Athanasios Glentis; Jiaxiang Li; Andi Han; Mingyi Hong 001 (CoRR, 2025)