TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training. - Wanchao Liang; Tianyu Liu; Less Wright; Will Constable; Andrew Gu; Chien-Chin Huang; Iris Zhang; Wei Feng; Howard Huang; Junjie Wang; Sanket Purandare; Gokul Nadathur; et al. (CoRR, 2024)

TorchTitan: One-stop PyTorch native solution for production ready LLM pretraining. - Wanchao Liang; Tianyu Liu; Less Wright; Will Constable; Andrew Gu; Chien-Chin Huang; Iris Zhang; Wei Feng; Howard Huang; Junjie Wang; Sanket Purandare; Gokul Nadathur; et al. (ICLR, 2025)