System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models. - Sam Ade Jacobs; Masahiro Tanaka; Chengming Zhang 006; Minjia Zhang; Reza Yazdani Aminadabi; Shuaiwen Leon Song; Samyam Rajbhandari; Yuxiong He (PODC, 2024)