PyTorch Distributed: Experiences on Accelerating Data Parallel Training. - Shen Li; Yanli Zhao; Rohan Varma; Omkar Salpekar; Pieter Noordhuis; Teng Li 009; Adam Paszke; Jeff Smith; Brian Vaughan; Pritam Damania; Soumith Chintala (Proc. VLDB Endow., 2020)

PyTorch RPC: Distributed Deep Learning Built on Tensor-Optimized Remote Procedure Calls. - Shen Li; Pritam Damania; Luca Wehrstedt; Rohan Varma; Omkar Salpekar; Pavel Belevich; Howard Huang; Yanli Zhao; Lucas Hosseini; Wanchao Liang; Hongyi Jia; Shihao Xu; et al. (MLSys, 2023)