Optimized Network Architectures for Large Language Model Training with Billions of Parameters. - Weiyang Wang; Manya Ghobadi; Kayvon Shakeri; Ying Zhang 022; Naader Hasani (CoRR, 2023)

Rail-only: A Low-Cost High-Performance Network for Training LLMs with Trillion Parameters. - Weiyang Wang; Manya Ghobadi; Kayvon Shakeri; Ying Zhang 022; Naader Hasani (HOTI, 2024)