Less Wright

According to our database, Less Wright authored at least 9 papers between 2021 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Composer 2 Technical Report.

Aaron Chan, Ahmed Shalaby, Alexander Wettig, Aman Sanger, Andrew Zhai, Anurag Ajay, Ashvin Nair, Charlie Snell, Chen Lu, Chen Shen, Emily Jia, Federico Cassano, Hanpeng Liu, Haoyu Chen, Henry Wildermuth, Jacob Jackson, Janet Li, Jediah Katz, Jiajun Yao, Joey Hejna, Josh Warner, Julius Vering, Kevin Frans, Lee Danilek, Less Wright, Lujing Cen, Luke Melas-Kyriazi, Michael Truell, Michiel de Jong, Naman Jain, Nate Schmidt, Nathan Wang, Niklas Muennighoff, Oleg Rybkin, Paul Loh, Phillip Kravtsov, Rishabh Yadav, Sahil Shah, Sam Kottler, Alexander M. Rush, Shengtong Zhang, Shomil Jain, Sriram Sankar, Stefan Heule, Stuart H. Sul, Sualeh Asif, Victor Rong, Wanqi Zhu, William Lin, Yuchen Wu, Yuri Volkov, Yury Zemlyanskiy, Zack Holbrook, Zhiyuan Zhang

CoRR, March, 2026

2025

TorchTitan: One-stop PyTorch native solution for production ready LLM pretraining.

Wanchao Liang, Tianyu Liu, Less Wright, Will Constable, Andrew Gu, Chien-Chin Huang, Iris Zhang, Wei Feng, Howard Huang, Junjie Wang, Sanket Purandare, Gokul Nadathur, Stratos Idreos

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

Accelerating neural network training: An analysis of the AlgoPerf competition.

Priya Kasimbeg, Frank Schneider, Runa Eschenhagen, Juhan Bae, Chandramouli Shama Sastry, Mark Saroufim, Boyuan Feng, Less Wright, Edward Z. Yang, Zachary Nado, Sourabh Medapati, Philipp Hennig, Michael Rabbat, George E. Dahl

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

HadaCore: Tensor Core Accelerated Hadamard Transform Kernel.

Krish Agarwal, Rishi Astra, Adnan Hoque, Mudhakar Srivatsa, Raghu K. Ganti, Less Wright, Sijia Chen

CoRR, 2024

TorchTitan: One-stop PyTorch native solution for production ready LLM pre-training.

Wanchao Liang, Tianyu Liu, Less Wright, Will Constable, Andrew Gu, Chien-Chin Huang, Iris Zhang, Wei Feng, Howard Huang, Junjie Wang, Sanket Purandare, Gokul Nadathur, Stratos Idreos

CoRR, 2024

Accelerating a Triton Fused Kernel for W4A16 Quantized Inference with SplitK work decomposition.

Adnan Hoque, Less Wright, Chih-Chieh Yang, Mudhakar Srivatsa, Raghu K. Ganti

CoRR, 2024

2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Pritam Damania, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Ajit Mathews, Shen Li

Proc. VLDB Endow., 2023

PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Yanli Zhao, Andrew Gu, Rohan Varma, Liang Luo, Chien-Chin Huang, Min Xu, Less Wright, Hamid Shojanazeri, Myle Ott, Sam Shleifer, Alban Desmaison, Can Balioglu, Bernard Nguyen, Geeta Chauhan, Yuchen Hao, Shen Li

CoRR, 2023

2021

Ranger21: a synergistic deep learning optimizer.

Less Wright, Nestor Demeure

CoRR, 2021