Training LLMs with Fault Tolerant HSDP on 100,000 GPUs. - Omkar Salpekar; Rohan Varma; Kenny Yu; Vladimir Ivanov; Yang Wang; Ahmed Sharif; Min Si; Shawn Xu; Feng Tian; Shengbao Zheng; Tristan Rice; Ankush Garg; et al. (CoRR, 2026)