Andrew Gu

According to our database, Andrew Gu authored at least 8 papers between 2021 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

GaLore 2: Large-Scale LLM Pre-Training by Gradient Low-Rank Projection.

DiJia Su, Andrew Gu, Jane Xu, Yuandong Tian, Jiawei Zhao

CoRR, April, 2025

Scaling Llama 3 Training with Efficient Parallelism Strategies.

Weiwei Chu, Xinfeng Xie, Jiecao Yu, Jie Wang, Amar Phanishayee, Chunqiang Tang, Yuchen Hao, Jianyu Huang, Mustafa Ozdal, Jun Wang, Vedanuj Goswami, Naman Goyal, Abhishek Kadian, Andrew Gu, Chris Cai, Feng Tian, Xiaodong Wang, Min Si, Pavan Balaji, Ching-Hsiang Chu, Jongsoo Park

Proceedings of the 52nd Annual International Symposium on Computer Architecture, 2025

TorchTitan: One-stop PyTorch native solution for production ready LLM pretraining.

Wanchao Liang, Tianyu Liu, Less Wright, Will Constable, Andrew Gu, Chien-Chin Huang, Iris Zhang, Wei Feng, Howard Huang, Junjie Wang, Sanket Purandare, Gokul Nadathur, Stratos Idreos

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

SimpleFSDP: Simpler Fully Sharded Data Parallel with torch.compile.

Ruisi Zhang, Tianyu Liu, Will Feng, Andrew Gu, Sanket Purandare, Wanchao Liang, Francisco Massa

CoRR, 2024

TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training.

Wanchao Liang, Tianyu Liu, Less Wright, Will Constable, Andrew Gu, Chien-Chin Huang, Iris Zhang, Wei Feng, Howard Huang, Junjie Wang, Sanket Purandare, Gokul Nadathur, Stratos Idreos

CoRR, 2024

2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Pritam Damania, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Ajit Mathews, Shen Li

Proc. VLDB Endow., 2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Shen Li

CoRR, 2023

2021

Deep Transfer Learning for Infectious Disease Case Detection Using Electronic Medical Records.

Ye Ye, Andrew Gu

CoRR, 2021