GSPMD: General and Scalable Parallelization for ML Computation Graphs. - Yuanzhong Xu; HyoukJoong Lee; Dehao Chen; Blake A. Hechtman; Yanping Huang; Rahul Joshi; Maxim Krikun; Dmitry Lepikhin; Andy Ly; Marcello Maggioni; Ruoming Pang; Noam Shazeer; et al. (CoRR, 2021)

Overlap Communication with Dependent Computation via Decomposition in Large Deep Learning Models. - Shibo Wang; Jinliang Wei; Amit Sabne; Andy Davis; Berkin Ilbeyi; Blake Hechtman; Dehao Chen; Karthik Srinivasa Murthy; Marcello Maggioni; Qiao Zhang; Sameer Kumar; Tongfei Guo; et al. (ASPLOS (1), 2023)